2024-04-19T22:21:09.103 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T22:21:09.103 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896 --description orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} --verbose -- /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/orig.config.yaml 2024-04-19T22:21:09.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T22:21:09.218 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896 branch: squid description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7663896' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-only-match: - CEPHADM_ sha1: d0bf63dd179c05751e4be49477389aa290c73089 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: d0bf63dd179c05751e4be49477389aa290c73089 extra_packages: - cephadm workunit: branch: squid sha1: e02d68a84525e0fa855f080a47dd96b350c21c42 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 5868 sha1: d0bf63dd179c05751e4be49477389aa290c73089 sleep_before_teardown: 0 subset: 38/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e02d68a84525e0fa855f080a47dd96b350c21c42/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e02d68a84525e0fa855f080a47dd96b350c21c42 targets: smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7kAqWEH0dEOxO8lsl1FJyGcFPc/N1mEFx0gYPpA9et/DinHwgcTJawNY4Xl7s04OseItQz66z+xOqLKpjf8J0= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLonbdgGqcvbKjHPN19W7Sjnz9rL1+zQo7/Do/zaz1jI2ksxJmB65CMJV5ppfAui14fR/OsfBwzp3omgsRO8QV0= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-19_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T22:21:09.218 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e02d68a84525e0fa855f080a47dd96b350c21c42/qa; will attempt to use it 2024-04-19T22:21:09.219 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e02d68a84525e0fa855f080a47dd96b350c21c42/qa/tasks 2024-04-19T22:21:09.219 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T22:21:09.221 INFO:teuthology.task.internal:Checking packages... 2024-04-19T22:21:09.245 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd0bf63dd179c05751e4be49477389aa290c73089' 2024-04-19T22:21:09.246 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T22:21:09.246 INFO:teuthology.packaging:ref: None 2024-04-19T22:21:09.246 INFO:teuthology.packaging:tag: None 2024-04-19T22:21:09.246 INFO:teuthology.packaging:branch: squid 2024-04-19T22:21:09.246 INFO:teuthology.packaging:sha1: d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:21:09.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-19T22:21:09.718 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2403-ge02d68a8-1jammy 2024-04-19T22:21:09.720 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T22:21:09.726 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T22:21:09.726 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T22:21:09.808 INFO:teuthology.task.internal:Saving configuration 2024-04-19T22:21:09.820 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T22:21:09.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T22:21:09.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 22:14:41.944310', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ448yPIMME5ZpjKwy0xR6X7x1OX1+LN9pegyWP6bzDB'} 2024-04-19T22:21:09.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 22:14:41.945846', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGyyDq7dhdkJQiOhDS5ukE1+LxlyVPWE0BkCn0OR5fEO'} 2024-04-19T22:21:09.914 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T22:21:09.920 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-04-19T22:21:09.920 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-04-19T22:21:09.921 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T22:21:10.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f680a9663a0>, signals=[15]) 2024-04-19T22:21:10.017 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T22:21:10.026 INFO:teuthology.task.internal:Opening connections... 2024-04-19T22:21:10.026 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2024-04-19T22:21:10.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:21:10.107 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-04-19T22:21:10.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:21:10.184 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T22:21:10.190 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-04-19T22:21:10.195 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-04-19T22:21:10.196 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Ubuntu" 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="22.04" 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_CODENAME=jammy 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:ID=ubuntu 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE=debian 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T22:21:10.242 INFO:teuthology.orchestra.run.smithi113.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T22:21:10.243 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T22:21:10.243 INFO:teuthology.orchestra.run.smithi113.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T22:21:10.243 INFO:teuthology.orchestra.run.smithi113.stdout:UBUNTU_CODENAME=jammy 2024-04-19T22:21:10.243 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-04-19T22:21:10.261 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-04-19T22:21:10.267 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-04-19T22:21:10.267 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T22:21:10.315 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T22:21:10.316 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2024-04-19T22:21:10.316 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-19T22:21:10.336 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T22:21:10.345 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T22:21:10.367 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T22:21:10.367 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2024-04-19T22:21:10.369 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-04-19T22:21:10.375 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T22:21:10.387 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T22:21:10.387 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2024-04-19T22:21:10.416 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-04-19T22:21:10.474 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T22:21:10.520 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T22:21:10.538 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T22:21:10.538 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T22:21:10.538 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T22:21:10.539 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T22:21:10.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T22:21:10.544 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-04-19T22:21:10.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T22:21:10.545 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-04-19T22:21:10.590 INFO:teuthology.orchestra.run.smithi113.stdout:5.15.0-56-generic 2024-04-19T22:21:10.591 INFO:teuthology.task.kernel:Running kernel on smithi113: 5.15.0-56-generic 2024-04-19T22:21:10.591 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get clean 2024-04-19T22:21:10.592 INFO:teuthology.orchestra.run.smithi178.stdout:5.15.0-56-generic 2024-04-19T22:21:10.592 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.15.0-56-generic 2024-04-19T22:21:10.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get clean 2024-04-19T22:21:10.724 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get update 2024-04-19T22:21:10.754 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-04-19T22:21:10.889 INFO:teuthology.orchestra.run.smithi113.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T22:21:10.902 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T22:21:10.987 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:21:11.005 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:21:11.069 INFO:teuthology.orchestra.run.smithi113.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T22:21:11.087 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-19T22:21:11.114 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-19T22:21:11.115 INFO:teuthology.orchestra.run.smithi113.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-19T22:21:11.200 INFO:teuthology.orchestra.run.smithi113.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-19T22:21:11.230 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-19T22:21:11.237 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-19T22:21:11.240 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T22:21:11.241 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T22:21:11.241 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-19T22:21:11.250 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-19T22:21:11.255 INFO:teuthology.orchestra.run.smithi113.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-19T22:21:11.256 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-19T22:21:11.256 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-19T22:21:11.277 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-19T22:21:11.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T22:21:11.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T22:21:11.291 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T22:21:11.297 INFO:teuthology.orchestra.run.smithi113.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-19T22:21:11.300 INFO:teuthology.orchestra.run.smithi113.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T22:21:11.300 INFO:teuthology.orchestra.run.smithi113.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-19T22:21:11.310 INFO:teuthology.orchestra.run.smithi113.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-19T22:21:11.314 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T22:21:11.317 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T22:21:11.324 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T22:21:11.324 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T22:21:11.324 INFO:teuthology.orchestra.run.smithi113.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-19T22:21:11.326 INFO:teuthology.orchestra.run.smithi113.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-19T22:21:11.328 INFO:teuthology.orchestra.run.smithi113.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-19T22:21:11.329 INFO:teuthology.orchestra.run.smithi113.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-19T22:21:11.335 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T22:21:11.344 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T22:21:11.347 INFO:teuthology.orchestra.run.smithi113.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-19T22:21:11.349 INFO:teuthology.orchestra.run.smithi113.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-19T22:21:11.421 INFO:teuthology.orchestra.run.smithi113.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T22:21:11.451 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-19T22:21:11.560 INFO:teuthology.orchestra.run.smithi113.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T22:21:11.589 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T22:21:11.788 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-19T22:21:11.869 INFO:teuthology.orchestra.run.smithi113.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-19T22:21:11.909 INFO:teuthology.orchestra.run.smithi113.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T22:21:11.923 INFO:teuthology.orchestra.run.smithi113.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T22:21:11.924 INFO:teuthology.orchestra.run.smithi113.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T22:21:11.939 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-19T22:21:11.954 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-19T22:21:11.954 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-19T22:21:11.985 INFO:teuthology.orchestra.run.smithi113.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T22:21:11.986 INFO:teuthology.orchestra.run.smithi113.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T22:21:11.994 INFO:teuthology.orchestra.run.smithi113.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T22:21:12.016 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-19T22:21:12.017 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-19T22:21:12.024 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-19T22:21:12.157 INFO:teuthology.orchestra.run.smithi113.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T22:21:12.188 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-19T22:21:12.783 INFO:teuthology.orchestra.run.smithi113.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T22:21:12.820 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-19T22:21:12.820 INFO:teuthology.orchestra.run.smithi113.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T22:21:12.833 INFO:teuthology.orchestra.run.smithi113.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T22:21:12.834 INFO:teuthology.orchestra.run.smithi113.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T22:21:12.835 INFO:teuthology.orchestra.run.smithi113.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T22:21:12.836 INFO:teuthology.orchestra.run.smithi113.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T22:21:12.837 INFO:teuthology.orchestra.run.smithi113.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T22:21:12.837 INFO:teuthology.orchestra.run.smithi113.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T22:21:12.857 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-19T22:21:12.864 INFO:teuthology.orchestra.run.smithi113.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T22:21:12.868 INFO:teuthology.orchestra.run.smithi113.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T22:21:12.870 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-19T22:21:12.871 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-19T22:21:12.872 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-19T22:21:12.874 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-19T22:21:12.875 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-19T22:21:12.875 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-19T22:21:12.902 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-19T22:21:12.904 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-19T22:21:13.033 INFO:teuthology.orchestra.run.smithi113.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T22:21:13.069 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-19T22:21:13.115 INFO:teuthology.orchestra.run.smithi113.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T22:21:13.152 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-19T22:21:13.227 INFO:teuthology.orchestra.run.smithi113.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T22:21:13.253 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-19T22:21:13.282 INFO:teuthology.orchestra.run.smithi113.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T22:21:13.315 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-19T22:21:13.316 INFO:teuthology.orchestra.run.smithi113.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T22:21:13.345 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-19T22:21:17.613 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 13.1 MB in 3s (5,217 kB/s) 2024-04-19T22:21:17.618 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 13.1 MB in 3s (5,211 kB/s) 2024-04-19T22:21:18.915 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:21:18.932 DEBUG:teuthology.orchestra.run.smithi113:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T22:21:18.971 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:21:18.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T22:21:18.992 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:21:19.049 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:21:19.191 INFO:teuthology.orchestra.run.smithi113.stdout:Building dependency tree... 2024-04-19T22:21:19.191 INFO:teuthology.orchestra.run.smithi113.stdout:Reading state information... 2024-04-19T22:21:19.256 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-04-19T22:21:19.257 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-04-19T22:21:19.363 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:21:19.363 INFO:teuthology.orchestra.run.smithi113.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:21:19.363 INFO:teuthology.orchestra.run.smithi113.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:21:19.364 INFO:teuthology.orchestra.run.smithi113.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:21:19.364 INFO:teuthology.orchestra.run.smithi113.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T22:21:19.364 INFO:teuthology.orchestra.run.smithi113.stdout: python2.7-minimal 2024-04-19T22:21:19.364 INFO:teuthology.orchestra.run.smithi113.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:21:19.365 INFO:teuthology.orchestra.run.smithi113.stdout:The following additional packages will be installed: 2024-04-19T22:21:19.365 INFO:teuthology.orchestra.run.smithi113.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T22:21:19.365 INFO:teuthology.orchestra.run.smithi113.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T22:21:19.366 INFO:teuthology.orchestra.run.smithi113.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T22:21:19.367 INFO:teuthology.orchestra.run.smithi113.stdout:Suggested packages: 2024-04-19T22:21:19.367 INFO:teuthology.orchestra.run.smithi113.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T22:21:19.367 INFO:teuthology.orchestra.run.smithi113.stdout:Recommended packages: 2024-04-19T22:21:19.367 INFO:teuthology.orchestra.run.smithi113.stdout: thermald 2024-04-19T22:21:19.429 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:21:19.429 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:21:19.429 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:21:19.430 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:21:19.430 INFO:teuthology.orchestra.run.smithi178.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-19T22:21:19.430 INFO:teuthology.orchestra.run.smithi178.stdout: python2.7-minimal 2024-04-19T22:21:19.430 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:21:19.431 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-04-19T22:21:19.431 INFO:teuthology.orchestra.run.smithi178.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T22:21:19.432 INFO:teuthology.orchestra.run.smithi178.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-19T22:21:19.432 INFO:teuthology.orchestra.run.smithi113.stdout:The following NEW packages will be installed: 2024-04-19T22:21:19.432 INFO:teuthology.orchestra.run.smithi113.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T22:21:19.432 INFO:teuthology.orchestra.run.smithi113.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T22:21:19.432 INFO:teuthology.orchestra.run.smithi178.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-19T22:21:19.433 INFO:teuthology.orchestra.run.smithi113.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T22:21:19.433 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-04-19T22:21:19.433 INFO:teuthology.orchestra.run.smithi178.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-19T22:21:19.433 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-04-19T22:21:19.433 INFO:teuthology.orchestra.run.smithi178.stdout: thermald 2024-04-19T22:21:19.434 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages will be upgraded: 2024-04-19T22:21:19.434 INFO:teuthology.orchestra.run.smithi113.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T22:21:19.487 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-04-19T22:21:19.488 INFO:teuthology.orchestra.run.smithi178.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-19T22:21:19.488 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-19T22:21:19.488 INFO:teuthology.orchestra.run.smithi178.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-19T22:21:19.489 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2024-04-19T22:21:19.489 INFO:teuthology.orchestra.run.smithi178.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T22:21:19.570 INFO:teuthology.orchestra.run.smithi113.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T22:21:19.570 INFO:teuthology.orchestra.run.smithi113.stdout:Need to get 113 MB of archives. 2024-04-19T22:21:19.570 INFO:teuthology.orchestra.run.smithi113.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T22:21:19.570 INFO:teuthology.orchestra.run.smithi113.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T22:21:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T22:21:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 113 MB of archives. 2024-04-19T22:21:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-19T22:21:19.670 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-19T22:21:20.351 INFO:teuthology.orchestra.run.smithi113.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T22:21:20.562 INFO:teuthology.orchestra.run.smithi113.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T22:21:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-19T22:21:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-19T22:21:21.632 INFO:teuthology.orchestra.run.smithi113.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T22:21:21.632 INFO:teuthology.orchestra.run.smithi113.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T22:21:21.632 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T22:21:22.363 INFO:teuthology.orchestra.run.smithi113.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T22:21:22.450 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T22:21:22.863 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 113 MB in 3s (37.7 MB/s) 2024-04-19T22:21:23.057 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T22:21:23.690 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-19T22:21:23.690 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-19T22:21:23.691 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-19T22:21:24.054 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-19T22:21:24.137 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-19T22:21:24.519 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-04-19T22:21:24.663 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-19T22:21:25.101 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T22:21:25.105 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:25.205 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:26.677 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-19T22:21:26.681 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:26.752 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:27.323 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T22:21:27.344 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:27.425 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:28.212 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T22:21:28.233 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:28.334 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:28.769 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-19T22:21:28.791 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:28.887 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:29.364 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-19T22:21:29.385 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:29.422 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:34.929 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:35.032 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:35.374 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:35.513 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:35.831 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T22:21:35.853 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T22:21:35.854 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:35.897 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T22:21:35.972 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:36.322 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:36.451 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-19T22:21:36.723 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-19T22:21:36.754 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T22:21:41.466 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T22:21:41.503 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:41.532 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:42.089 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-19T22:21:42.107 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-19T22:21:42.147 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:44.622 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:44.745 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:45.086 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T22:21:45.171 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-19T22:21:45.217 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-19T22:21:45.343 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T22:21:45.472 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:45.628 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-19T22:21:45.733 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:45.859 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-19T22:21:45.979 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:46.882 INFO:teuthology.orchestra.run.smithi113.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:21:46.882 INFO:teuthology.orchestra.run.smithi113.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T22:21:46.882 INFO:teuthology.orchestra.run.smithi113.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:21:46.882 INFO:teuthology.orchestra.run.smithi113.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T22:21:47.174 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:47.289 INFO:teuthology.orchestra.run.smithi178.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:21:47.290 INFO:teuthology.orchestra.run.smithi178.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-19T22:21:47.290 INFO:teuthology.orchestra.run.smithi178.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:21:47.290 INFO:teuthology.orchestra.run.smithi178.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-19T22:21:47.449 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:48.553 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:48.868 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:49.937 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T22:21:50.071 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T22:21:50.197 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:50.211 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-19T22:21:50.254 INFO:teuthology.orchestra.run.smithi113.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T22:21:50.254 INFO:teuthology.orchestra.run.smithi113.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:21:50.337 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-19T22:21:50.467 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-19T22:21:50.520 INFO:teuthology.orchestra.run.smithi178.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T22:21:50.520 INFO:teuthology.orchestra.run.smithi178.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:22:04.489 INFO:teuthology.orchestra.run.smithi178.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T22:22:04.489 INFO:teuthology.orchestra.run.smithi178.stdout:Sourcing file `/etc/default/grub' 2024-04-19T22:22:04.498 INFO:teuthology.orchestra.run.smithi178.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T22:22:04.510 INFO:teuthology.orchestra.run.smithi113.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T22:22:04.511 INFO:teuthology.orchestra.run.smithi113.stdout:Sourcing file `/etc/default/grub' 2024-04-19T22:22:04.521 INFO:teuthology.orchestra.run.smithi113.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T22:22:04.527 INFO:teuthology.orchestra.run.smithi178.stdout:Generating grub configuration file ... 2024-04-19T22:22:04.540 INFO:teuthology.orchestra.run.smithi113.stdout:Generating grub configuration file ... 2024-04-19T22:22:04.809 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:22:04.823 INFO:teuthology.orchestra.run.smithi113.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:22:04.828 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:22:04.849 INFO:teuthology.orchestra.run.smithi113.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:22:05.134 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:22:05.140 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T22:22:05.153 INFO:teuthology.orchestra.run.smithi113.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:22:05.160 INFO:teuthology.orchestra.run.smithi113.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T22:22:05.205 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T22:22:05.210 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T22:22:05.226 INFO:teuthology.orchestra.run.smithi113.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T22:22:05.232 INFO:teuthology.orchestra.run.smithi113.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T22:22:05.363 INFO:teuthology.orchestra.run.smithi178.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T22:22:05.363 INFO:teuthology.orchestra.run.smithi178.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T22:22:05.363 INFO:teuthology.orchestra.run.smithi178.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T22:22:05.394 INFO:teuthology.orchestra.run.smithi113.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T22:22:05.394 INFO:teuthology.orchestra.run.smithi113.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T22:22:05.394 INFO:teuthology.orchestra.run.smithi113.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T22:22:05.397 INFO:teuthology.orchestra.run.smithi178.stdout:done 2024-04-19T22:22:05.433 INFO:teuthology.orchestra.run.smithi113.stdout:done 2024-04-19T22:22:05.858 DEBUG:teuthology.orchestra.run.smithi178:> dpkg -s linux-image-generic 2024-04-19T22:22:05.876 DEBUG:teuthology.orchestra.run.smithi113:> dpkg -s linux-image-generic 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Package: linux-image-generic 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Status: install ok installed 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Priority: optional 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Section: kernel 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Installed-Size: 21 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: amd64 2024-04-19T22:22:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:Source: linux-meta 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:Version: 5.15.0.105.102 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:Recommends: thermald 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:Description: Generic Linux kernel image 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout: This package will always depend on the latest generic kernel image 2024-04-19T22:22:05.878 INFO:teuthology.orchestra.run.smithi178.stdout: available. 2024-04-19T22:22:05.878 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T22:22:05.878 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T22:22:05.878 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T22:22:05.879 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-19T22:22:05.879 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T22:22:05.879 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get clean 2024-04-19T22:22:05.945 INFO:teuthology.orchestra.run.smithi113.stdout:Package: linux-image-generic 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Status: install ok installed 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Priority: optional 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Section: kernel 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Installed-Size: 21 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Architecture: amd64 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Source: linux-meta 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Version: 5.15.0.105.102 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Recommends: thermald 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout:Description: Generic Linux kernel image 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout: This package will always depend on the latest generic kernel image 2024-04-19T22:22:05.946 INFO:teuthology.orchestra.run.smithi113.stdout: available. 2024-04-19T22:22:05.947 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-19T22:22:05.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T22:22:05.947 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T22:22:05.947 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T22:22:05.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi113.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T22:22:05.947 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get clean 2024-04-19T22:22:06.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-04-19T22:22:06.138 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get update 2024-04-19T22:22:06.182 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:22:06.189 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T22:22:06.220 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T22:22:06.267 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-19T22:22:06.380 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:22:06.380 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T22:22:06.451 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T22:22:06.532 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T22:22:06.729 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 110 kB in 1s (204 kB/s) 2024-04-19T22:22:07.687 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:22:07.704 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T22:22:07.756 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:22:07.772 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:22:07.791 DEBUG:teuthology.orchestra.run.smithi113:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T22:22:07.850 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:22:07.935 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-04-19T22:22:07.935 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-04-19T22:22:08.050 INFO:teuthology.orchestra.run.smithi113.stdout:Building dependency tree... 2024-04-19T22:22:08.051 INFO:teuthology.orchestra.run.smithi113.stdout:Reading state information... 2024-04-19T22:22:08.090 INFO:teuthology.orchestra.run.smithi178.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T22:22:08.090 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:22:08.090 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:22:08.091 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:22:08.091 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:22:08.091 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T22:22:08.091 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T22:22:08.092 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:22:08.127 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T22:22:08.128 DEBUG:teuthology.orchestra.run.smithi178:> dpkg -s linux-image-generic 2024-04-19T22:22:08.181 INFO:teuthology.orchestra.run.smithi178.stdout:Package: linux-image-generic 2024-04-19T22:22:08.181 INFO:teuthology.orchestra.run.smithi178.stdout:Status: install ok installed 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Priority: optional 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Section: kernel 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Installed-Size: 21 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: amd64 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Source: linux-meta 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Version: 5.15.0.105.102 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Recommends: thermald 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout:Description: Generic Linux kernel image 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout: This package will always depend on the latest generic kernel image 2024-04-19T22:22:08.182 INFO:teuthology.orchestra.run.smithi178.stdout: available. 2024-04-19T22:22:08.183 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T22:22:08.225 INFO:teuthology.orchestra.run.smithi113.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:22:08.229 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.3pFNMoO12S 2024-04-19T22:22:08.230 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3pFNMoO12S 2024-04-19T22:22:08.263 INFO:teuthology.orchestra.run.smithi113.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-19T22:22:08.265 DEBUG:teuthology.orchestra.run.smithi113:> dpkg -s linux-image-generic 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Package: linux-image-generic 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Status: install ok installed 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Priority: optional 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Section: kernel 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Installed-Size: 21 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Architecture: amd64 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Source: linux-meta 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Version: 5.15.0.105.102 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-19T22:22:08.281 INFO:teuthology.orchestra.run.smithi113.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T22:22:08.282 INFO:teuthology.orchestra.run.smithi113.stdout:Recommends: thermald 2024-04-19T22:22:08.282 INFO:teuthology.orchestra.run.smithi113.stdout:Description: Generic Linux kernel image 2024-04-19T22:22:08.282 INFO:teuthology.orchestra.run.smithi113.stdout: This package will always depend on the latest generic kernel image 2024-04-19T22:22:08.282 INFO:teuthology.orchestra.run.smithi113.stdout: available. 2024-04-19T22:22:08.282 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2024-04-19T22:22:08.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.3pFNMoO12S 2024-04-19T22:22:08.329 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.VzOPM5Sxhr 2024-04-19T22:22:08.330 DEBUG:teuthology.orchestra.run.smithi113:> sudo cp /boot/grub/grub.cfg /tmp/tmp.VzOPM5Sxhr 2024-04-19T22:22:08.386 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.VzOPM5Sxhr 2024-04-19T22:22:08.402 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.3pFNMoO12S is 10KB 2024-04-19T22:22:08.416 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.3pFNMoO12S 2024-04-19T22:22:08.420 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.472 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:22:08.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.506 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.VzOPM5Sxhr is 10KB 2024-04-19T22:22:08.552 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T22:22:08.553 DEBUG:teuthology.orchestra.run.smithi178:> sudo update-grub 2024-04-19T22:22:08.559 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.VzOPM5Sxhr 2024-04-19T22:22:08.564 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.617 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:22:08.617 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.617 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T22:22:08.684 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-19T22:22:08.684 DEBUG:teuthology.orchestra.run.smithi113:> sudo update-grub 2024-04-19T22:22:09.704 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-04-19T22:22:09.705 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T22:22:09.707 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-04-19T22:22:09.869 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:22:09.875 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:22:09.917 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub' 2024-04-19T22:22:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T22:22:09.920 INFO:teuthology.orchestra.run.smithi113.stderr:Generating grub configuration file ... 2024-04-19T22:22:10.075 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-19T22:22:10.081 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-19T22:22:10.148 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:22:10.154 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T22:22:10.196 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T22:22:10.201 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T22:22:10.292 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-19T22:22:10.297 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-19T22:22:10.334 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-19T22:22:10.339 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-19T22:22:10.367 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T22:22:10.367 INFO:teuthology.orchestra.run.smithi178.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T22:22:10.367 INFO:teuthology.orchestra.run.smithi178.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T22:22:10.379 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-04-19T22:22:10.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2024-04-19T22:22:10.483 INFO:teuthology.orchestra.run.smithi113.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-19T22:22:10.483 INFO:teuthology.orchestra.run.smithi113.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-19T22:22:10.483 INFO:teuthology.orchestra.run.smithi113.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-19T22:22:10.499 INFO:teuthology.orchestra.run.smithi113.stderr:done 2024-04-19T22:22:10.517 DEBUG:teuthology.orchestra.run.smithi113:> sudo shutdown -r now 2024-04-19T22:22:40.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-19T22:22:40.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:22:40.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:22:40.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T22:22:40.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:22:40.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:22:58.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-19T22:22:59.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-19T22:23:07.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:23:07.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:08.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:23:08.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:10.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-19T22:23:11.166 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-19T22:23:22.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:23:22.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:23.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:23:23.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:25.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-19T22:23:26.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-19T22:23:41.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:23:41.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:41.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:23:41.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:23:59.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-19T22:24:12.898 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-19T22:24:13.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:24:13.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-19T22:24:13.418 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-04-19T22:24:13.466 INFO:teuthology.orchestra.run.smithi178.stdout:5.15.0-105-generic 2024-04-19T22:24:13.466 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T22:24:13.466 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T22:24:13.466 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T22:24:14.467 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-19T22:24:14.467 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T22:24:14.547 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2024-04-19T22:24:14.570 DEBUG:teuthology.parallel:result is None 2024-04-19T22:24:17.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:24:17.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:24:18.066 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-19T22:24:18.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:24:18.664 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-19T22:24:18.665 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-04-19T22:24:18.711 INFO:teuthology.orchestra.run.smithi113.stdout:5.15.0-105-generic 2024-04-19T22:24:18.711 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-19T22:24:18.711 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T22:24:18.711 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T22:24:19.712 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T22:24:19.713 DEBUG:teuthology.orchestra.run.smithi113:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T22:24:20.061 INFO:teuthology.orchestra.run.smithi113.stdout:ttyS1 2024-04-19T22:24:20.093 DEBUG:teuthology.parallel:result is None 2024-04-19T22:24:20.093 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T22:24:20.104 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T22:24:20.104 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T22:24:20.107 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T22:24:20.113 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T22:24:20.124 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T22:24:20.133 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T22:24:20.133 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T22:24:20.163 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T22:24:20.255 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T22:24:20.262 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T22:24:20.262 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T22:24:20.265 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T22:24:20.287 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T22:24:20.288 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T22:24:20.295 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T22:24:20.296 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T22:24:20.298 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T22:24:20.305 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T22:24:20.305 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T22:24:20.340 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T22:24:20.354 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T22:24:20.362 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T22:24:20.362 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T22:24:20.396 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T22:24:20.401 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T22:24:20.447 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T22:24:20.495 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:24:20.496 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T22:24:20.562 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T22:24:20.568 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T22:24:20.617 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:24:20.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T22:24:20.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2024-04-19T22:24:20.689 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-04-19T22:24:20.759 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T22:24:20.766 INFO:teuthology.task.internal:Starting timer... 2024-04-19T22:24:20.766 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T22:24:20.777 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T22:24:20.786 DEBUG:teuthology.task.selinux:Excluding smithi113: OS 'ubuntu' does not support SELinux 2024-04-19T22:24:20.786 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2024-04-19T22:24:20.786 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T22:24:20.786 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-19T22:24:20.786 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T22:24:20.786 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T22:24:20.796 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T22:24:20.813 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T22:24:20.815 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi113.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T22:31:23.942 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi113.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-04-19T22:31:23.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:31:23.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:31:24.025 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-19T22:31:24.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-19T22:31:24.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:31:24.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T22:31:24.176 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-19T22:31:24.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-19T22:31:24.262 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T22:31:24.272 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T22:31:24.273 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T22:31:24.273 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T22:31:24.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T22:31:24.276 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T22:31:24.301 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T22:31:24.301 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Command line: ntpd -gq 2024-04-19T22:31:24.301 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: ---------------------------------------------------- 2024-04-19T22:31:24.301 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T22:31:24.301 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T22:31:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: corporation. Support and training for ntp-4 are 2024-04-19T22:31:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: available at https://www.nwtime.org/support 2024-04-19T22:31:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: ---------------------------------------------------- 2024-04-19T22:31:24.303 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: proto: precision = 0.043 usec (-24) 2024-04-19T22:31:24.303 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: basedate set to 2022-02-04 2024-04-19T22:31:24.303 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: gps base set to 2022-02-06 (week 2196) 2024-04-19T22:31:24.303 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T22:31:24.304 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T22:31:24.304 INFO:teuthology.orchestra.run.smithi113.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T22:31:24.304 INFO:teuthology.orchestra.run.smithi113.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen normally on 3 enp3s0f1 172.21.15.113:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen normally on 4 lo [::1]:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d7c1%5]:123 2024-04-19T22:31:24.305 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:24 ntpd[17225]: Listening on routing socket on fd #22 for interface updates 2024-04-19T22:31:24.326 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-19T22:31:24.326 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Command line: ntpd -gq 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: ---------------------------------------------------- 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: ntp-4 is maintained by Network Time Foundation, 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: corporation. Support and training for ntp-4 are 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: available at https://www.nwtime.org/support 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: ---------------------------------------------------- 2024-04-19T22:31:24.327 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: proto: precision = 0.044 usec (-24) 2024-04-19T22:31:24.328 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: basedate set to 2022-02-04 2024-04-19T22:31:24.328 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: gps base set to 2022-02-06 (week 2196) 2024-04-19T22:31:24.328 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T22:31:24.328 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T22:31:24.328 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T22:31:24.329 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen normally on 4 lo [::1]:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2024-04-19T22:31:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:24 ntpd[17192]: Listening on routing socket on fd #22 for interface updates 2024-04-19T22:31:25.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:25.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:25.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:25.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:25.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:25.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:25 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:25.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:25 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:26.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:26.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:26.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:26.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:26.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:26.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:26 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:27.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:27.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:27.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:27 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:27.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:27.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:27.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:27.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:27.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:27.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:27 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:28.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:28.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:28.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:28.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:28.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:28.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:28 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:28.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:28.329 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:28 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.304 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:29.304 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:29 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:29.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:29.329 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:29 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:30.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:30.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:30.302 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:30.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:30.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:30.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:30 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:30.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:30.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:30.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:30.327 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:30.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:30.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:30 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:31.303 INFO:teuthology.orchestra.run.smithi113.stdout:19 Apr 22:31:31 ntpd[17225]: ntpd: time slew -0.001594 s 2024-04-19T22:31:31.304 INFO:teuthology.orchestra.run.smithi113.stdout:ntpd: time slew -0.001594s 2024-04-19T22:31:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T22:31:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:19 Apr 22:31:31 ntpd[17225]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T22:31:31.328 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T22:31:31.329 INFO:teuthology.orchestra.run.smithi178.stdout:19 Apr 22:31:31 ntpd[17192]: ntpd: time slew -0.000385 s 2024-04-19T22:31:31.329 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew -0.000385s 2024-04-19T22:31:31.329 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T22:31:31.329 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T22:31:31.329 INFO:teuthology.orchestra.run.smithi178.stderr:19 Apr 22:31:31 ntpd[17192]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T22:31:31.351 INFO:teuthology.orchestra.run.smithi113.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T22:31:31.351 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================== 2024-04-19T22:31:31.351 INFO:teuthology.orchestra.run.smithi113.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.351 INFO:teuthology.orchestra.run.smithi113.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.352 INFO:teuthology.orchestra.run.smithi113.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.352 INFO:teuthology.orchestra.run.smithi113.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.378 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-19T22:31:31.379 INFO:teuthology.run_tasks:Running task install... 2024-04-19T22:31:31.388 DEBUG:teuthology.task.install:project ceph 2024-04-19T22:31:31.388 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd0bf63dd179c05751e4be49477389aa290c73089'}, 'extra_packages': ['cephadm']} 2024-04-19T22:31:31.388 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd0bf63dd179c05751e4be49477389aa290c73089'} 2024-04-19T22:31:31.388 INFO:teuthology.task.install:Using flavor: default 2024-04-19T22:31:31.394 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T22:31:31.394 INFO:teuthology.task.install:extra packages: [] 2024-04-19T22:31:31.395 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-key list | grep Ceph 2024-04-19T22:31:31.395 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2024-04-19T22:31:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T22:31:31.475 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-19T22:31:31.481 INFO:teuthology.orchestra.run.smithi113.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T22:31:31.481 INFO:teuthology.orchestra.run.smithi113.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T22:31:31.482 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T22:31:31.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:31:31.503 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T22:31:31.503 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T22:31:31.503 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T22:31:31.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:31:31.628 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default/ 2024-04-19T22:31:31.628 INFO:teuthology.task.install.deb:Package version is 19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:31:31.734 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default/ 2024-04-19T22:31:31.734 INFO:teuthology.task.install.deb:Package version is 19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:31:31.820 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:31:31.821 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T22:31:31.835 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get update 2024-04-19T22:31:31.843 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:31:31.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T22:31:31.857 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-04-19T22:31:32.014 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:31:32.030 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T22:31:32.043 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-19T22:31:32.043 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T22:31:32.053 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T22:31:32.057 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-19T22:31:32.081 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-19T22:31:32.122 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-19T22:31:32.130 INFO:teuthology.orchestra.run.smithi113.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T22:31:32.157 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy InRelease 2024-04-19T22:31:32.170 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-04-19T22:31:32.197 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-04-19T22:31:32.210 INFO:teuthology.orchestra.run.smithi113.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T22:31:32.239 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-19T22:31:32.250 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-19T22:31:32.278 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-19T22:31:32.324 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-04-19T22:31:32.336 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-04-19T22:31:32.408 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 28.2 kB in 0s (71.3 kB/s) 2024-04-19T22:31:32.410 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 28.2 kB in 0s (76.5 kB/s) 2024-04-19T22:31:33.311 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:31:33.327 DEBUG:teuthology.orchestra.run.smithi113:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2401-gd0bf63dd-1jammy cephadm=19.0.0-2401-gd0bf63dd-1jammy ceph-mds=19.0.0-2401-gd0bf63dd-1jammy ceph-mgr=19.0.0-2401-gd0bf63dd-1jammy ceph-common=19.0.0-2401-gd0bf63dd-1jammy ceph-fuse=19.0.0-2401-gd0bf63dd-1jammy ceph-test=19.0.0-2401-gd0bf63dd-1jammy ceph-volume=19.0.0-2401-gd0bf63dd-1jammy radosgw=19.0.0-2401-gd0bf63dd-1jammy python3-rados=19.0.0-2401-gd0bf63dd-1jammy python3-rgw=19.0.0-2401-gd0bf63dd-1jammy python3-cephfs=19.0.0-2401-gd0bf63dd-1jammy python3-rbd=19.0.0-2401-gd0bf63dd-1jammy libcephfs2=19.0.0-2401-gd0bf63dd-1jammy libcephfs-dev=19.0.0-2401-gd0bf63dd-1jammy librados2=19.0.0-2401-gd0bf63dd-1jammy librbd1=19.0.0-2401-gd0bf63dd-1jammy rbd-fuse=19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:31:33.363 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:31:33.378 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2401-gd0bf63dd-1jammy cephadm=19.0.0-2401-gd0bf63dd-1jammy ceph-mds=19.0.0-2401-gd0bf63dd-1jammy ceph-mgr=19.0.0-2401-gd0bf63dd-1jammy ceph-common=19.0.0-2401-gd0bf63dd-1jammy ceph-fuse=19.0.0-2401-gd0bf63dd-1jammy ceph-test=19.0.0-2401-gd0bf63dd-1jammy ceph-volume=19.0.0-2401-gd0bf63dd-1jammy radosgw=19.0.0-2401-gd0bf63dd-1jammy python3-rados=19.0.0-2401-gd0bf63dd-1jammy python3-rgw=19.0.0-2401-gd0bf63dd-1jammy python3-cephfs=19.0.0-2401-gd0bf63dd-1jammy python3-rbd=19.0.0-2401-gd0bf63dd-1jammy libcephfs2=19.0.0-2401-gd0bf63dd-1jammy libcephfs-dev=19.0.0-2401-gd0bf63dd-1jammy librados2=19.0.0-2401-gd0bf63dd-1jammy librbd1=19.0.0-2401-gd0bf63dd-1jammy rbd-fuse=19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:31:33.390 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2024-04-19T22:31:33.430 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-19T22:31:33.589 INFO:teuthology.orchestra.run.smithi113.stdout:Building dependency tree... 2024-04-19T22:31:33.590 INFO:teuthology.orchestra.run.smithi113.stdout:Reading state information... 2024-04-19T22:31:33.607 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-04-19T22:31:33.607 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-04-19T22:31:33.777 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:31:33.777 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:31:33.777 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:31:33.777 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:31:33.778 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T22:31:33.778 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T22:31:33.778 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T22:31:33.780 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T22:31:33.781 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet zip 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T22:31:33.782 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-19T22:31:33.783 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-04-19T22:31:33.783 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2024-04-19T22:31:33.786 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T22:31:33.786 INFO:teuthology.orchestra.run.smithi113.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-19T22:31:33.786 INFO:teuthology.orchestra.run.smithi113.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-19T22:31:33.787 INFO:teuthology.orchestra.run.smithi113.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-19T22:31:33.787 INFO:teuthology.orchestra.run.smithi113.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-19T22:31:33.787 INFO:teuthology.orchestra.run.smithi113.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-19T22:31:33.787 INFO:teuthology.orchestra.run.smithi113.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T22:31:33.788 INFO:teuthology.orchestra.run.smithi113.stdout:The following additional packages will be installed: 2024-04-19T22:31:33.788 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T22:31:33.788 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-19T22:31:33.788 INFO:teuthology.orchestra.run.smithi113.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-19T22:31:33.788 INFO:teuthology.orchestra.run.smithi113.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-19T22:31:33.789 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T22:31:33.790 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet zip 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout:Suggested packages: 2024-04-19T22:31:33.791 INFO:teuthology.orchestra.run.smithi113.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout:Recommended packages: 2024-04-19T22:31:33.792 INFO:teuthology.orchestra.run.smithi113.stdout: btrfs-tools 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T22:31:33.880 INFO:teuthology.orchestra.run.smithi178.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-19T22:31:33.881 INFO:teuthology.orchestra.run.smithi178.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T22:31:33.882 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-19T22:31:33.883 INFO:teuthology.orchestra.run.smithi178.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout:The following NEW packages will be installed: 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T22:31:33.892 INFO:teuthology.orchestra.run.smithi113.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-19T22:31:33.894 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-19T22:31:33.895 INFO:teuthology.orchestra.run.smithi113.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-19T22:31:33.950 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T22:31:33.951 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 179 MB of archives. 2024-04-19T22:31:33.951 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-19T22:31:33.951 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T22:31:34.062 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T22:31:34.068 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T22:31:34.081 INFO:teuthology.orchestra.run.smithi113.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-19T22:31:34.082 INFO:teuthology.orchestra.run.smithi113.stdout:Need to get 179 MB of archives. 2024-04-19T22:31:34.082 INFO:teuthology.orchestra.run.smithi113.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-19T22:31:34.082 INFO:teuthology.orchestra.run.smithi113.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-19T22:31:34.087 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T22:31:34.182 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T22:31:34.190 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T22:31:34.206 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T22:31:34.212 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T22:31:34.212 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T22:31:34.213 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T22:31:34.224 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-19T22:31:34.227 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-19T22:31:34.230 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-19T22:31:34.231 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-19T22:31:34.240 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-19T22:31:34.243 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-19T22:31:34.245 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-19T22:31:34.247 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T22:31:34.273 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T22:31:34.273 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T22:31:34.274 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T22:31:34.275 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T22:31:34.275 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T22:31:34.275 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T22:31:34.293 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T22:31:34.294 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T22:31:34.294 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T22:31:34.297 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T22:31:34.314 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T22:31:34.315 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T22:31:34.315 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T22:31:34.316 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T22:31:34.317 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T22:31:34.317 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T22:31:34.352 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T22:31:34.353 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T22:31:34.354 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T22:31:34.360 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T22:31:34.375 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2401-gd0bf63dd-1jammy [3,542 kB] 2024-04-19T22:31:34.375 INFO:teuthology.orchestra.run.smithi113.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2401-gd0bf63dd-1jammy [3,542 kB] 2024-04-19T22:31:34.377 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T22:31:34.378 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T22:31:34.378 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T22:31:34.380 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T22:31:34.383 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T22:31:34.384 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T22:31:34.401 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T22:31:34.403 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T22:31:34.407 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T22:31:34.408 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T22:31:34.435 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T22:31:34.439 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T22:31:34.511 INFO:teuthology.orchestra.run.smithi113.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-19T22:31:34.523 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T22:31:34.523 INFO:teuthology.orchestra.run.smithi113.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-19T22:31:34.525 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T22:31:34.526 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T22:31:34.527 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T22:31:34.528 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T22:31:34.563 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T22:31:34.566 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T22:31:34.566 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T22:31:34.589 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T22:31:34.589 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T22:31:34.597 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T22:31:34.597 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T22:31:34.598 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T22:31:34.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T22:31:34.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T22:31:34.600 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T22:31:34.603 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T22:31:34.608 INFO:teuthology.orchestra.run.smithi113.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-19T22:31:34.618 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T22:31:34.620 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T22:31:34.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T22:31:34.640 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T22:31:34.643 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-19T22:31:34.644 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-19T22:31:34.645 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T22:31:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-19T22:31:34.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T22:31:34.654 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T22:31:34.663 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T22:31:34.664 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T22:31:34.664 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T22:31:34.684 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T22:31:34.685 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T22:31:34.694 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T22:31:34.695 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T22:31:34.695 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T22:31:34.698 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T22:31:34.698 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T22:31:34.837 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-19T22:31:34.848 INFO:teuthology.orchestra.run.smithi113.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-19T22:31:34.878 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-19T22:31:34.887 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-19T22:31:34.888 INFO:teuthology.orchestra.run.smithi113.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-19T22:31:34.890 INFO:teuthology.orchestra.run.smithi113.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-19T22:31:34.908 INFO:teuthology.orchestra.run.smithi113.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-19T22:31:35.078 INFO:teuthology.orchestra.run.smithi113.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-19T22:31:35.481 INFO:teuthology.orchestra.run.smithi113.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-19T22:31:35.516 INFO:teuthology.orchestra.run.smithi113.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-19T22:31:35.518 INFO:teuthology.orchestra.run.smithi113.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-19T22:31:35.597 INFO:teuthology.orchestra.run.smithi113.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-19T22:31:35.649 INFO:teuthology.orchestra.run.smithi113.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-19T22:31:35.671 INFO:teuthology.orchestra.run.smithi113.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-19T22:31:35.677 INFO:teuthology.orchestra.run.smithi113.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-19T22:31:35.678 INFO:teuthology.orchestra.run.smithi113.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-19T22:31:35.691 INFO:teuthology.orchestra.run.smithi113.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-19T22:31:35.692 INFO:teuthology.orchestra.run.smithi113.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-19T22:31:35.858 INFO:teuthology.orchestra.run.smithi113.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-19T22:31:35.941 INFO:teuthology.orchestra.run.smithi113.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-19T22:31:35.970 INFO:teuthology.orchestra.run.smithi113.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-19T22:31:35.987 INFO:teuthology.orchestra.run.smithi113.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-19T22:31:36.031 INFO:teuthology.orchestra.run.smithi113.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-19T22:31:36.247 INFO:teuthology.orchestra.run.smithi113.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-19T22:31:36.262 INFO:teuthology.orchestra.run.smithi113.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-19T22:31:36.269 INFO:teuthology.orchestra.run.smithi113.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-19T22:31:36.274 INFO:teuthology.orchestra.run.smithi113.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-19T22:31:36.293 INFO:teuthology.orchestra.run.smithi113.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2401-gd0bf63dd-1jammy [3,218 kB] 2024-04-19T22:31:36.295 INFO:teuthology.orchestra.run.smithi113.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T22:31:36.299 INFO:teuthology.orchestra.run.smithi113.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-19T22:31:36.323 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2401-gd0bf63dd-1jammy [3,218 kB] 2024-04-19T22:31:36.465 INFO:teuthology.orchestra.run.smithi113.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-19T22:31:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-19T22:31:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-19T22:31:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-19T22:31:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-19T22:31:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-19T22:31:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-19T22:31:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-19T22:31:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-19T22:31:37.100 INFO:teuthology.orchestra.run.smithi113.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-19T22:31:37.106 INFO:teuthology.orchestra.run.smithi113.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-19T22:31:37.135 INFO:teuthology.orchestra.run.smithi113.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2401-gd0bf63dd-1jammy [711 kB] 2024-04-19T22:31:37.158 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2401-gd0bf63dd-1jammy [711 kB] 2024-04-19T22:31:37.281 INFO:teuthology.orchestra.run.smithi113.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-19T22:31:37.288 INFO:teuthology.orchestra.run.smithi113.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2401-gd0bf63dd-1jammy [356 kB] 2024-04-19T22:31:37.319 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2401-gd0bf63dd-1jammy [356 kB] 2024-04-19T22:31:37.370 INFO:teuthology.orchestra.run.smithi113.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2401-gd0bf63dd-1jammy [32.8 kB] 2024-04-19T22:31:37.373 INFO:teuthology.orchestra.run.smithi113.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2401-gd0bf63dd-1jammy [180 kB] 2024-04-19T22:31:37.387 INFO:teuthology.orchestra.run.smithi113.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2401-gd0bf63dd-1jammy [65.7 kB] 2024-04-19T22:31:37.394 INFO:teuthology.orchestra.run.smithi113.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2401-gd0bf63dd-1jammy [330 kB] 2024-04-19T22:31:37.404 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2401-gd0bf63dd-1jammy [32.8 kB] 2024-04-19T22:31:37.405 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2401-gd0bf63dd-1jammy [180 kB] 2024-04-19T22:31:37.416 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2401-gd0bf63dd-1jammy [65.7 kB] 2024-04-19T22:31:37.421 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2401-gd0bf63dd-1jammy [330 kB] 2024-04-19T22:31:37.476 INFO:teuthology.orchestra.run.smithi113.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2401-gd0bf63dd-1jammy [6,775 kB] 2024-04-19T22:31:37.506 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2401-gd0bf63dd-1jammy [6,775 kB] 2024-04-19T22:31:37.545 INFO:teuthology.orchestra.run.smithi113.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-19T22:31:37.724 INFO:teuthology.orchestra.run.smithi113.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-19T22:31:37.737 INFO:teuthology.orchestra.run.smithi113.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-19T22:31:37.757 INFO:teuthology.orchestra.run.smithi113.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-19T22:31:37.822 INFO:teuthology.orchestra.run.smithi113.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-19T22:31:38.111 INFO:teuthology.orchestra.run.smithi113.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-19T22:31:38.113 INFO:teuthology.orchestra.run.smithi113.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-19T22:31:38.116 INFO:teuthology.orchestra.run.smithi113.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T22:31:38.116 INFO:teuthology.orchestra.run.smithi113.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-19T22:31:38.119 INFO:teuthology.orchestra.run.smithi113.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-19T22:31:38.339 INFO:teuthology.orchestra.run.smithi113.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-19T22:31:38.578 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2401-gd0bf63dd-1jammy [112 kB] 2024-04-19T22:31:38.581 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2401-gd0bf63dd-1jammy [466 kB] 2024-04-19T22:31:38.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2401-gd0bf63dd-1jammy [25.6 MB] 2024-04-19T22:31:38.776 INFO:teuthology.orchestra.run.smithi113.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-19T22:31:38.782 INFO:teuthology.orchestra.run.smithi113.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-19T22:31:39.072 INFO:teuthology.orchestra.run.smithi113.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-19T22:31:39.072 INFO:teuthology.orchestra.run.smithi113.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-19T22:31:39.074 INFO:teuthology.orchestra.run.smithi113.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-19T22:31:39.076 INFO:teuthology.orchestra.run.smithi113.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-19T22:31:39.078 INFO:teuthology.orchestra.run.smithi113.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-19T22:31:39.080 INFO:teuthology.orchestra.run.smithi113.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-19T22:31:39.081 INFO:teuthology.orchestra.run.smithi113.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-19T22:31:39.083 INFO:teuthology.orchestra.run.smithi113.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-19T22:31:39.264 INFO:teuthology.orchestra.run.smithi113.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-19T22:31:39.387 INFO:teuthology.orchestra.run.smithi113.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2401-gd0bf63dd-1jammy [112 kB] 2024-04-19T22:31:39.450 INFO:teuthology.orchestra.run.smithi113.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2401-gd0bf63dd-1jammy [466 kB] 2024-04-19T22:31:39.622 INFO:teuthology.orchestra.run.smithi113.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2401-gd0bf63dd-1jammy [25.6 MB] 2024-04-19T22:31:39.678 INFO:teuthology.orchestra.run.smithi113.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-19T22:31:39.724 INFO:teuthology.orchestra.run.smithi113.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-19T22:31:39.760 INFO:teuthology.orchestra.run.smithi113.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-19T22:31:39.856 INFO:teuthology.orchestra.run.smithi113.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-19T22:31:39.896 INFO:teuthology.orchestra.run.smithi113.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-19T22:31:39.907 INFO:teuthology.orchestra.run.smithi113.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-19T22:31:39.913 INFO:teuthology.orchestra.run.smithi113.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-19T22:31:39.960 INFO:teuthology.orchestra.run.smithi113.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-19T22:31:39.963 INFO:teuthology.orchestra.run.smithi113.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-19T22:31:39.984 INFO:teuthology.orchestra.run.smithi113.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-19T22:31:40.149 INFO:teuthology.orchestra.run.smithi113.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T22:31:40.423 INFO:teuthology.orchestra.run.smithi113.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-19T22:31:40.442 INFO:teuthology.orchestra.run.smithi113.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-19T22:31:40.596 INFO:teuthology.orchestra.run.smithi113.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-19T22:31:40.625 INFO:teuthology.orchestra.run.smithi113.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-19T22:31:40.784 INFO:teuthology.orchestra.run.smithi113.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-19T22:31:40.786 INFO:teuthology.orchestra.run.smithi113.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-19T22:31:40.787 INFO:teuthology.orchestra.run.smithi113.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-19T22:31:40.810 INFO:teuthology.orchestra.run.smithi113.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-19T22:31:40.815 INFO:teuthology.orchestra.run.smithi113.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-19T22:31:41.623 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2401-gd0bf63dd-1jammy [5,084 kB] 2024-04-19T22:31:42.107 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2401-gd0bf63dd-1jammy [244 kB] 2024-04-19T22:31:42.123 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2401-gd0bf63dd-1jammy [124 kB] 2024-04-19T22:31:42.130 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2401-gd0bf63dd-1jammy [1,525 kB] 2024-04-19T22:31:42.305 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2401-gd0bf63dd-1jammy [6,245 kB] 2024-04-19T22:31:43.023 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2401-gd0bf63dd-1jammy [22.7 MB] 2024-04-19T22:31:46.270 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2401-gd0bf63dd-1jammy [14.0 kB] 2024-04-19T22:31:46.271 INFO:teuthology.orchestra.run.smithi178.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2401-gd0bf63dd-1jammy [869 kB] 2024-04-19T22:31:46.325 INFO:teuthology.orchestra.run.smithi113.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2401-gd0bf63dd-1jammy [5,084 kB] 2024-04-19T22:31:46.339 INFO:teuthology.orchestra.run.smithi178.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2401-gd0bf63dd-1jammy [2,438 kB] 2024-04-19T22:31:46.681 INFO:teuthology.orchestra.run.smithi178.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2401-gd0bf63dd-1jammy [790 kB] 2024-04-19T22:31:46.807 INFO:teuthology.orchestra.run.smithi178.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2401-gd0bf63dd-1jammy [147 kB] 2024-04-19T22:31:46.823 INFO:teuthology.orchestra.run.smithi178.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2401-gd0bf63dd-1jammy [2,295 kB] 2024-04-19T22:31:47.147 INFO:teuthology.orchestra.run.smithi178.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2401-gd0bf63dd-1jammy [8,625 kB] 2024-04-19T22:31:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2401-gd0bf63dd-1jammy [244 kB] 2024-04-19T22:31:47.272 INFO:teuthology.orchestra.run.smithi113.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2401-gd0bf63dd-1jammy [124 kB] 2024-04-19T22:31:47.277 INFO:teuthology.orchestra.run.smithi113.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2401-gd0bf63dd-1jammy [1,525 kB] 2024-04-19T22:31:47.568 INFO:teuthology.orchestra.run.smithi113.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2401-gd0bf63dd-1jammy [6,245 kB] 2024-04-19T22:31:48.266 INFO:teuthology.orchestra.run.smithi178.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2401-gd0bf63dd-1jammy [14.2 kB] 2024-04-19T22:31:48.266 INFO:teuthology.orchestra.run.smithi178.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2401-gd0bf63dd-1jammy [50.7 MB] 2024-04-19T22:31:48.576 INFO:teuthology.orchestra.run.smithi113.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2401-gd0bf63dd-1jammy [22.7 MB] 2024-04-19T22:31:52.305 INFO:teuthology.orchestra.run.smithi113.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2401-gd0bf63dd-1jammy [14.0 kB] 2024-04-19T22:31:52.306 INFO:teuthology.orchestra.run.smithi113.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2401-gd0bf63dd-1jammy [869 kB] 2024-04-19T22:31:52.322 INFO:teuthology.orchestra.run.smithi113.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2401-gd0bf63dd-1jammy [2,438 kB] 2024-04-19T22:31:52.669 INFO:teuthology.orchestra.run.smithi113.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2401-gd0bf63dd-1jammy [790 kB] 2024-04-19T22:31:52.833 INFO:teuthology.orchestra.run.smithi113.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2401-gd0bf63dd-1jammy [147 kB] 2024-04-19T22:31:52.841 INFO:teuthology.orchestra.run.smithi113.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2401-gd0bf63dd-1jammy [2,295 kB] 2024-04-19T22:31:53.156 INFO:teuthology.orchestra.run.smithi113.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2401-gd0bf63dd-1jammy [8,625 kB] 2024-04-19T22:31:54.431 INFO:teuthology.orchestra.run.smithi113.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2401-gd0bf63dd-1jammy [14.2 kB] 2024-04-19T22:31:54.432 INFO:teuthology.orchestra.run.smithi113.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2401-gd0bf63dd-1jammy [50.7 MB] 2024-04-19T22:31:57.844 INFO:teuthology.orchestra.run.smithi178.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2401-gd0bf63dd-1jammy [121 kB] 2024-04-19T22:31:57.846 INFO:teuthology.orchestra.run.smithi178.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2401-gd0bf63dd-1jammy [38.9 kB] 2024-04-19T22:31:57.848 INFO:teuthology.orchestra.run.smithi178.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2401-gd0bf63dd-1jammy [13.4 MB] 2024-04-19T22:31:59.449 INFO:teuthology.orchestra.run.smithi113.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2401-gd0bf63dd-1jammy [121 kB] 2024-04-19T22:31:59.451 INFO:teuthology.orchestra.run.smithi113.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2401-gd0bf63dd-1jammy [38.9 kB] 2024-04-19T22:31:59.453 INFO:teuthology.orchestra.run.smithi113.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2401-gd0bf63dd-1jammy [13.4 MB] 2024-04-19T22:31:59.731 INFO:teuthology.orchestra.run.smithi178.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2401-gd0bf63dd-1jammy [91.2 kB] 2024-04-19T22:32:00.289 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 179 MB in 26s (6,945 kB/s) 2024-04-19T22:32:00.416 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T22:32:00.512 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T22:32:00.517 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T22:32:00.590 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T22:32:00.872 INFO:teuthology.orchestra.run.smithi113.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/d0bf63dd179c05751e4be49477389aa290c73089/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2401-gd0bf63dd-1jammy [91.2 kB] 2024-04-19T22:32:00.910 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T22:32:00.936 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T22:32:00.977 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T22:32:01.322 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T22:32:01.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T22:32:01.388 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T22:32:01.433 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 179 MB in 27s (6,655 kB/s) 2024-04-19T22:32:01.592 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-19T22:32:01.693 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-19T22:32:01.698 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-19T22:32:01.791 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T22:32:01.800 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T22:32:01.826 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:01.874 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:02.136 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T22:32:02.163 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-19T22:32:02.202 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T22:32:02.294 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T22:32:02.321 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:02.361 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:02.514 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T22:32:02.540 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-19T22:32:02.580 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T22:32:02.681 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T22:32:02.709 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:02.748 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:03.026 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T22:32:03.052 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:03.059 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T22:32:03.085 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T22:32:03.101 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:03.125 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T22:32:03.512 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librados2. 2024-04-19T22:32:03.512 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T22:32:03.538 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-librados2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:03.538 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:03.578 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:03.579 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:03.924 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T22:32:03.950 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-19T22:32:03.990 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:32:04.031 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librbd1. 2024-04-19T22:32:04.057 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-librbd1_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:04.098 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:04.352 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-19T22:32:04.378 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-19T22:32:04.418 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T22:32:04.492 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T22:32:04.507 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:04.542 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:04.788 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librados2. 2024-04-19T22:32:04.814 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../007-librados2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:04.828 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2024-04-19T22:32:04.843 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:04.854 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librados2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:04.886 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:05.290 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librbd1. 2024-04-19T22:32:05.317 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../008-librbd1_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:05.348 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librbd1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:05.404 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T22:32:05.431 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:05.489 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:05.742 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T22:32:05.768 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:05.786 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T22:32:05.808 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:05.811 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:05.851 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libcephfs2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:06.053 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T22:32:06.068 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:06.111 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:06.120 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rados. 2024-04-19T22:32:06.135 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:06.179 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rados (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:06.414 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T22:32:06.440 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T22:32:06.481 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T22:32:06.640 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T22:32:06.667 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:06.706 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-ceph-argparse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:06.792 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T22:32:06.818 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T22:32:06.858 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T22:32:06.925 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T22:32:06.941 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:06.984 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cephfs (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:07.136 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T22:32:07.151 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:07.194 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:07.545 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T22:32:07.572 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:08.112 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:08.248 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T22:32:08.274 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T22:32:08.314 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T22:32:08.440 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T22:32:08.467 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-19T22:32:08.507 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T22:32:08.592 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-19T22:32:08.607 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-19T22:32:08.650 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-19T22:32:08.860 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T22:32:08.886 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-19T22:32:08.926 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-19T22:32:08.961 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-19T22:32:08.977 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-19T22:32:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-19T22:32:09.187 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T22:32:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:09.254 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rbd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua5.1. 2024-04-19T22:32:09.358 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-19T22:32:09.398 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-19T22:32:09.674 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T22:32:09.700 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-19T22:32:09.748 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T22:32:09.767 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-any. 2024-04-19T22:32:09.782 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-19T22:32:09.825 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-19T22:32:10.051 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-19T22:32:10.068 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-19T22:32:10.078 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package zip. 2024-04-19T22:32:10.093 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-19T22:32:10.109 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-19T22:32:10.136 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking zip (3.0-12build2) ... 2024-04-19T22:32:10.412 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-19T22:32:10.439 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-19T22:32:10.456 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package unzip. 2024-04-19T22:32:10.478 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-19T22:32:10.483 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-19T22:32:10.523 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-19T22:32:10.841 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package lua5.1. 2024-04-19T22:32:10.867 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-19T22:32:10.915 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-19T22:32:11.052 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package luarocks. 2024-04-19T22:32:11.078 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-19T22:32:11.118 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-19T22:32:11.285 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package lua-any. 2024-04-19T22:32:11.312 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-19T22:32:11.360 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-19T22:32:11.476 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2024-04-19T22:32:11.503 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-librgw2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:11.542 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:11.763 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package zip. 2024-04-19T22:32:11.789 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-19T22:32:11.829 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking zip (3.0-12build2) ... 2024-04-19T22:32:12.095 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T22:32:12.110 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:12.141 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package unzip. 2024-04-19T22:32:12.153 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:12.167 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-19T22:32:12.207 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-19T22:32:12.456 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T22:32:12.483 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T22:32:12.523 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T22:32:12.686 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package luarocks. 2024-04-19T22:32:12.713 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-19T22:32:12.761 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-19T22:32:12.809 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T22:32:12.836 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:12.875 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:13.102 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librgw2. 2024-04-19T22:32:13.117 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../025-librgw2_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:13.153 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librgw2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:13.304 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2024-04-19T22:32:13.331 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:13.696 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T22:32:13.723 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:13.765 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:14.133 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-19T22:32:14.159 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-19T22:32:14.199 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T22:32:14.486 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T22:32:14.512 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:14.552 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libradosstriper1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:14.701 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2024-04-19T22:32:14.728 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:14.776 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:14.955 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-common. 2024-04-19T22:32:14.982 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:15.030 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:15.322 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T22:32:15.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T22:32:15.380 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T22:32:15.624 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T22:32:15.651 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T22:32:15.691 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T22:32:16.194 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T22:32:16.221 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T22:32:16.260 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T22:32:16.486 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-base. 2024-04-19T22:32:16.512 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:16.561 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-base (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:16.563 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T22:32:16.590 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T22:32:16.630 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T22:32:16.925 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T22:32:16.951 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T22:32:16.991 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T22:32:17.148 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-19T22:32:17.175 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-19T22:32:17.215 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-19T22:32:17.227 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T22:32:17.254 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T22:32:17.293 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T22:32:17.476 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cheroot. 2024-04-19T22:32:17.502 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-19T22:32:17.534 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T22:32:17.596 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-portend. 2024-04-19T22:32:17.623 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-19T22:32:17.663 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T22:32:17.837 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-19T22:32:17.864 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-19T22:32:17.904 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-19T22:32:17.999 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T22:32:18.026 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T22:32:18.066 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T22:32:18.209 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-19T22:32:18.235 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-19T22:32:18.275 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-19T22:32:18.369 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T22:32:18.395 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T22:32:18.435 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T22:32:18.562 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-19T22:32:18.588 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-19T22:32:18.620 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-19T22:32:18.781 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T22:32:18.807 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T22:32:18.847 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T22:32:18.923 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-tempora. 2024-04-19T22:32:18.950 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-19T22:32:18.989 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-19T22:32:19.134 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T22:32:19.160 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T22:32:19.200 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T22:32:19.293 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-portend. 2024-04-19T22:32:19.319 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-19T22:32:19.359 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-19T22:32:19.536 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T22:32:19.563 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T22:32:19.611 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T22:32:19.637 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-19T22:32:19.664 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-19T22:32:19.695 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-19T22:32:19.914 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2024-04-19T22:32:19.940 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T22:32:19.973 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T22:32:19.989 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T22:32:20.000 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-19T22:32:20.040 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-19T22:32:20.301 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T22:32:20.327 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T22:32:20.367 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T22:32:20.394 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T22:32:20.421 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-19T22:32:20.460 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-19T22:32:20.670 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T22:32:20.697 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T22:32:20.722 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T22:32:20.736 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T22:32:20.749 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-19T22:32:20.788 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-19T22:32:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2024-04-19T22:32:21.083 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T22:32:21.091 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T22:32:21.118 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-19T22:32:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T22:32:21.158 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-19T22:32:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-mako. 2024-04-19T22:32:21.487 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-19T22:32:21.517 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T22:32:21.527 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T22:32:21.544 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T22:32:21.587 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T22:32:21.839 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T22:32:21.866 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T22:32:21.895 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T22:32:21.922 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T22:32:21.978 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T22:32:22.006 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T22:32:22.273 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2024-04-19T22:32:22.299 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T22:32:22.339 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T22:32:22.375 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T22:32:22.402 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-19T22:32:22.442 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-19T22:32:22.676 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T22:32:22.691 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T22:32:22.734 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T22:32:22.745 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-webob. 2024-04-19T22:32:22.772 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-19T22:32:22.811 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-19T22:32:22.978 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T22:32:22.994 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T22:32:23.037 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T22:32:23.164 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T22:32:23.191 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-19T22:32:23.234 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T22:32:23.340 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T22:32:23.367 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T22:32:23.406 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T22:32:23.559 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T22:32:23.586 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-19T22:32:23.626 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T22:32:23.718 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T22:32:23.745 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T22:32:23.784 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T22:32:23.870 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-paste. 2024-04-19T22:32:23.886 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-19T22:32:23.920 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T22:32:24.140 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T22:32:24.166 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T22:32:24.214 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T22:32:24.265 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T22:32:24.292 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-19T22:32:24.332 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T22:32:24.551 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-idna. 2024-04-19T22:32:24.577 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-19T22:32:24.585 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T22:32:24.612 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-19T22:32:24.617 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T22:32:24.651 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-19T22:32:24.903 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T22:32:24.918 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T22:32:24.938 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T22:32:24.964 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-19T22:32:24.970 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T22:32:25.004 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-19T22:32:25.290 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests. 2024-04-19T22:32:25.316 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T22:32:25.316 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T22:32:25.342 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-19T22:32:25.348 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T22:32:25.391 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T22:32:25.626 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T22:32:25.652 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T22:32:25.692 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T22:32:25.754 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-certifi. 2024-04-19T22:32:25.781 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-19T22:32:25.820 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-19T22:32:25.971 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T22:32:25.997 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:26.028 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:26.107 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-idna. 2024-04-19T22:32:26.133 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-19T22:32:26.165 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-19T22:32:26.428 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T22:32:26.454 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:26.460 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-urllib3. 2024-04-19T22:32:26.486 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-19T22:32:26.526 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T22:32:26.636 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:26.830 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-requests. 2024-04-19T22:32:26.856 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-19T22:32:26.896 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T22:32:26.922 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T22:32:26.948 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T22:32:26.989 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T22:32:27.208 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T22:32:27.234 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-19T22:32:27.292 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T22:32:27.299 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T22:32:27.318 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T22:32:27.367 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T22:32:27.595 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T22:32:27.621 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:27.661 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:27.712 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T22:32:27.738 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:27.778 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:28.058 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T22:32:28.084 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:28.116 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:28.148 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T22:32:28.175 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:28.214 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:28.427 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T22:32:28.453 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-19T22:32:28.493 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-19T22:32:28.780 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T22:32:28.806 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-19T22:32:28.835 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T22:32:28.862 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:28.901 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:28.938 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-19T22:32:29.283 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T22:32:29.310 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:29.349 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:29.728 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T22:32:29.755 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:29.794 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mon (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:29.980 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2024-04-19T22:32:29.996 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-ceph_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:30.030 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:30.308 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T22:32:30.334 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:30.374 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:30.398 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T22:32:30.425 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:30.464 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-osd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:30.778 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T22:32:30.805 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:30.844 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:31.248 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2024-04-19T22:32:31.274 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-cephadm_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:31.314 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:31.510 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph. 2024-04-19T22:32:31.537 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../066-ceph_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:31.575 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T22:32:31.576 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:31.591 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T22:32:31.642 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T22:32:31.887 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T22:32:31.914 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:31.954 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:31.970 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T22:32:31.985 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T22:32:32.028 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T22:32:32.291 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T22:32:32.317 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:32.357 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mds (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:32.877 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package cephadm. 2024-04-19T22:32:32.904 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../069-cephadm_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:32.943 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:33.075 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-babel. 2024-04-19T22:32:33.103 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T22:32:33.141 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T22:32:33.263 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T22:32:33.290 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-19T22:32:33.329 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-19T22:32:33.461 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T22:32:33.477 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T22:32:33.511 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T22:32:33.657 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-19T22:32:33.684 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T22:32:33.732 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T22:32:33.856 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T22:32:33.883 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:33.914 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:34.227 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T22:32:34.242 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T22:32:34.276 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T22:32:34.571 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2024-04-19T22:32:34.598 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T22:32:34.638 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T22:32:34.787 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-babel. 2024-04-19T22:32:34.814 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-19T22:32:34.853 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T22:32:34.958 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T22:32:34.985 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:35.024 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:35.190 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T22:32:35.217 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-19T22:32:35.265 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T22:32:35.610 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T22:32:35.637 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:35.668 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:35.988 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T22:32:36.015 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T22:32:36.055 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T22:32:36.299 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-routes. 2024-04-19T22:32:36.313 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T22:32:36.326 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-19T22:32:36.329 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T22:32:36.363 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T22:32:36.366 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T22:32:36.653 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T22:32:36.666 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:36.694 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:37.000 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T22:32:37.027 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T22:32:37.066 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T22:32:37.387 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T22:32:37.414 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T22:32:37.445 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T22:32:37.731 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T22:32:37.758 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T22:32:37.798 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T22:32:37.933 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-19T22:32:37.960 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-19T22:32:37.999 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T22:32:38.495 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T22:32:38.499 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T22:32:38.521 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-19T22:32:38.526 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:38.561 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T22:32:38.651 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:38.873 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-19T22:32:38.888 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-19T22:32:38.922 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-19T22:32:39.234 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T22:32:39.261 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-19T22:32:39.316 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T22:32:39.530 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T22:32:39.557 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T22:32:39.596 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T22:32:39.900 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T22:32:39.927 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T22:32:39.966 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T22:32:40.001 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T22:32:40.017 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:40.162 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:40.312 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T22:32:40.339 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T22:32:40.378 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T22:32:40.673 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T22:32:40.700 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-19T22:32:40.731 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T22:32:41.019 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T22:32:41.046 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T22:32:41.085 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T22:32:41.141 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T22:32:41.168 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-19T22:32:41.207 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-19T22:32:41.405 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T22:32:41.432 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T22:32:41.468 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T22:32:41.471 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T22:32:41.484 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-19T22:32:41.518 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-19T22:32:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T22:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T22:32:41.811 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T22:32:41.812 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-19T22:32:41.847 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T22:32:41.849 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T22:32:42.125 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T22:32:42.146 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T22:32:42.152 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-19T22:32:42.173 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T22:32:42.191 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-19T22:32:42.203 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T22:32:42.512 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T22:32:42.540 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-19T22:32:42.578 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-19T22:32:42.884 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T22:32:42.912 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:42.950 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:43.165 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T22:32:43.192 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-19T22:32:43.231 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T22:32:43.245 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T22:32:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T22:32:43.312 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T22:32:43.501 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T22:32:43.529 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-19T22:32:43.560 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-19T22:32:43.648 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T22:32:43.676 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T22:32:43.715 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T22:32:43.896 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T22:32:43.924 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-19T22:32:43.963 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T22:32:43.976 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2024-04-19T22:32:44.003 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T22:32:44.051 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T22:32:44.262 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2024-04-19T22:32:44.278 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T22:32:44.320 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T22:32:44.624 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T22:32:44.635 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T22:32:44.640 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T22:32:44.651 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:44.682 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T22:32:44.693 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:44.996 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T22:32:45.003 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2024-04-19T22:32:45.019 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:45.023 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-19T22:32:45.053 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:45.063 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T22:32:45.374 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T22:32:45.401 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T22:32:45.440 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T22:32:45.711 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package jq. 2024-04-19T22:32:45.738 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-19T22:32:45.777 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-19T22:32:46.029 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package socat. 2024-04-19T22:32:46.045 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-19T22:32:46.088 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-19T22:32:46.391 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T22:32:46.419 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-19T22:32:46.457 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-19T22:32:46.804 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-test. 2024-04-19T22:32:46.831 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:46.870 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-test (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T22:32:47.544 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:47.582 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-volume (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:47.878 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T22:32:47.894 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:47.937 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:48.215 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-19T22:32:48.242 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-19T22:32:48.273 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-19T22:32:48.611 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-19T22:32:48.639 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-19T22:32:48.677 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-19T22:32:49.024 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T22:32:49.051 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T22:32:49.090 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T22:32:49.275 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T22:32:49.290 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2401-gd0bf63dd-1jammy_all.deb ... 2024-04-19T22:32:49.325 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-volume (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:49.521 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pkg-config. 2024-04-19T22:32:49.548 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-19T22:32:49.587 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-19T22:32:49.629 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T22:32:49.656 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:49.695 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libcephfs-dev (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:49.841 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T22:32:49.868 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T22:32:49.907 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T22:32:50.006 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-19T22:32:50.034 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-19T22:32:50.064 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-19T22:32:50.345 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-19T22:32:50.361 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T22:32:50.373 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-19T22:32:50.388 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T22:32:50.402 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-19T22:32:50.427 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T22:32:50.713 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T22:32:50.741 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T22:32:50.773 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T22:32:50.780 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T22:32:50.801 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-19T22:32:50.856 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T22:32:51.109 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T22:32:51.136 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T22:32:51.175 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T22:32:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package pkg-config. 2024-04-19T22:32:51.273 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-19T22:32:51.312 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-19T22:32:51.478 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T22:32:51.506 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T22:32:51.545 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T22:32:51.564 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T22:32:51.581 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-19T22:32:51.623 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-19T22:32:51.898 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2024-04-19T22:32:51.925 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-19T22:32:51.973 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T22:32:52.076 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-19T22:32:52.104 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-19T22:32:52.143 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-19T22:32:52.293 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T22:32:52.321 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T22:32:52.359 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T22:32:52.446 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T22:32:52.474 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T22:32:52.512 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T22:32:52.816 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T22:32:52.843 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-19T22:32:52.848 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T22:32:52.875 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T22:32:52.882 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-19T22:32:52.906 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T22:32:53.152 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T22:32:53.179 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-19T22:32:53.200 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-toml. 2024-04-19T22:32:53.218 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-19T22:32:53.228 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-19T22:32:53.267 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T22:32:53.538 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-py. 2024-04-19T22:32:53.561 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T22:32:53.565 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-19T22:32:53.589 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T22:32:53.604 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-19T22:32:53.636 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T22:32:53.933 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pygments. 2024-04-19T22:32:53.957 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T22:32:53.960 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-19T22:32:53.984 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T22:32:53.999 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T22:32:54.023 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T22:32:54.293 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T22:32:54.308 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T22:32:54.381 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T22:32:54.479 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T22:32:54.506 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-19T22:32:54.545 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-19T22:32:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-toml. 2024-04-19T22:32:54.892 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-19T22:32:54.931 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-19T22:32:55.155 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2024-04-19T22:32:55.183 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../116-radosgw_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:55.222 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:55.234 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T22:32:55.262 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-19T22:32:55.301 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T22:32:55.638 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T22:32:55.665 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-19T22:32:55.704 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-19T22:32:55.974 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T22:32:56.001 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-19T22:32:56.033 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T22:32:56.040 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-19T22:32:56.061 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:56.100 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:56.404 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T22:32:56.655 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T22:32:56.765 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T22:32:56.803 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package radosgw. 2024-04-19T22:32:56.830 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../116-radosgw_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:56.869 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking radosgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:57.002 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T22:32:57.324 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T22:32:57.689 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T22:32:57.704 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2401-gd0bf63dd-1jammy_amd64.deb ... 2024-04-19T22:32:57.747 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking rbd-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:57.749 INFO:teuthology.orchestra.run.smithi178.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T22:32:57.984 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:58.070 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-19T22:32:58.519 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-19T22:32:58.638 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-19T22:32:58.806 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2024-04-19T22:32:58.875 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-19T22:32:59.055 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T22:32:59.221 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-19T22:32:59.384 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T22:32:59.644 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T22:32:59.660 INFO:teuthology.orchestra.run.smithi113.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-19T22:32:59.715 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:32:59.770 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T22:33:00.021 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T22:33:00.241 INFO:teuthology.orchestra.run.smithi113.stdout:Adding system user cephadm....done 2024-04-19T22:33:00.290 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T22:33:00.397 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-19T22:33:00.407 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T22:33:00.648 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-19T22:33:00.692 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T22:33:00.891 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-19T22:33:01.017 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-19T22:33:01.078 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T22:33:01.268 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T22:33:01.329 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T22:33:01.519 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-19T22:33:01.581 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-19T22:33:01.646 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-19T22:33:01.857 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T22:33:01.956 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-19T22:33:02.091 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T22:33:02.299 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-19T22:33:02.343 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T22:33:02.592 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-19T22:33:02.594 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:02.853 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T22:33:02.869 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-19T22:33:02.979 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-19T22:33:03.103 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-19T22:33:03.105 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-19T22:33:03.231 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T22:33:03.363 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-19T22:33:03.491 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-19T22:33:03.614 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-19T22:33:03.848 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-ceph-argparse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:03.901 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-19T22:33:03.930 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-19T22:33:03.994 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T22:33:04.099 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-19T22:33:04.104 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T22:33:04.359 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-19T22:33:04.480 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T22:33:04.485 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-19T22:33:04.590 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T22:33:04.611 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-19T22:33:04.858 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T22:33:04.889 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-19T22:33:05.125 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T22:33:05.278 INFO:teuthology.orchestra.run.smithi113.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-19T22:33:05.303 INFO:teuthology.orchestra.run.smithi113.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-19T22:33:05.357 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-19T22:33:05.443 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up zip (3.0-12build2) ... 2024-04-19T22:33:05.484 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-19T22:33:05.578 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T22:33:05.834 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-19T22:33:05.961 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-19T22:33:06.237 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-19T22:33:06.263 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T22:33:06.506 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T22:33:06.522 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-19T22:33:06.624 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T22:33:06.741 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T22:33:06.848 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up zip (3.0-12build2) ... 2024-04-19T22:33:07.015 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-19T22:33:07.051 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T22:33:07.446 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T22:33:07.680 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T22:33:07.709 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-19T22:33:07.985 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-19T22:33:08.090 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T22:33:08.120 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-19T22:33:08.263 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-19T22:33:08.367 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T22:33:08.547 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-19T22:33:08.709 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T22:33:08.960 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T22:33:08.973 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-19T22:33:09.086 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:09.233 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-19T22:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T22:33:09.626 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-19T22:33:09.697 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T22:33:09.927 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-19T22:33:10.304 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-19T22:33:10.547 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-19T22:33:10.681 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:10.852 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-19T22:33:10.957 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-idna (3.3-1) ... 2024-04-19T22:33:11.096 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:11.230 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T22:33:11.275 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-19T22:33:11.489 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T22:33:11.632 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T22:33:11.750 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T22:33:12.051 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T22:33:12.302 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T22:33:12.489 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-19T22:33:12.553 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:12.688 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T22:33:12.749 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:12.900 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-19T22:33:12.989 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T22:33:13.168 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-19T22:33:13.265 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T22:33:13.295 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-19T22:33:13.412 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-19T22:33:13.533 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T22:33:13.705 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-19T22:33:13.784 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T22:33:13.990 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-19T22:33:14.035 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T22:33:14.241 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T22:33:14.367 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-19T22:33:14.420 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T22:33:14.668 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-19T22:33:14.713 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T22:33:14.839 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T22:33:14.936 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-19T22:33:15.140 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T22:33:15.229 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-19T22:33:15.433 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T22:33:15.463 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T22:33:15.684 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-19T22:33:15.706 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-19T22:33:15.810 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-19T22:33:15.936 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T22:33:15.974 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-19T22:33:16.025 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T22:33:16.100 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-19T22:33:16.254 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T22:33:16.380 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T22:33:16.385 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-19T22:33:16.511 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-19T22:33:16.782 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T22:33:16.820 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-19T22:33:17.033 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-19T22:33:17.113 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-19T22:33:17.159 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T22:33:17.381 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-19T22:33:17.410 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:17.499 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-19T22:33:17.536 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T22:33:17.625 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-19T22:33:17.739 INFO:teuthology.orchestra.run.smithi113.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-19T22:33:17.845 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T22:33:18.002 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-19T22:33:18.136 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-19T22:33:18.181 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T22:33:18.447 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T22:33:18.546 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-19T22:33:18.574 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T22:33:18.780 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-19T22:33:18.833 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T22:33:18.881 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-19T22:33:19.084 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T22:33:19.140 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-19T22:33:19.267 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-19T22:33:19.412 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T22:33:19.585 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-19T22:33:19.789 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T22:33:19.886 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-19T22:33:20.082 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T22:33:20.196 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-19T22:33:20.346 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-19T22:33:20.418 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T22:33:20.544 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:20.623 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-19T22:33:20.661 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:20.779 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-19T22:33:20.890 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-19T22:33:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:21.233 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:21.235 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-19T22:33:21.359 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T22:33:21.621 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T22:33:21.635 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:21.753 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:21.872 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:21.914 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-19T22:33:22.069 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T22:33:22.069 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T22:33:22.266 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-19T22:33:22.392 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librados2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.519 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.597 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.645 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-19T22:33:22.723 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.849 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.923 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libcephfs2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:22.975 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T22:33:23.049 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libradosstriper1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:23.175 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-19T22:33:23.452 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librbd1 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:23.578 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-modules-core (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:23.704 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:23.898 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T22:33:23.898 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T22:33:24.204 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.330 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.380 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libcephfs-dev (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.456 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.481 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rados (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.582 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.599 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librgw2 (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:24.725 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-19T22:33:24.725 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:25.301 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2024-04-19T22:33:25.696 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2024-04-19T22:33:25.838 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2024-04-19T22:33:25.856 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T22:33:25.870 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rbd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:25.996 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T22:33:26.021 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up rbd-fuse (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:26.181 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:26.302 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T22:33:26.307 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cephfs (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:26.433 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-common (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:26.785 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:26.927 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:27.010 INFO:teuthology.orchestra.run.smithi113.stdout:Adding group ceph....done 2024-04-19T22:33:27.386 INFO:teuthology.orchestra.run.smithi113.stdout:Adding system user ceph....done 2024-04-19T22:33:27.393 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T22:33:27.394 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T22:33:27.505 INFO:teuthology.orchestra.run.smithi113.stdout:Setting system user ceph properties....done 2024-04-19T22:33:27.523 INFO:teuthology.orchestra.run.smithi113.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T22:33:27.660 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T22:33:27.838 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:27.988 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T22:33:28.190 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T22:33:28.477 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-test (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:28.602 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up radosgw (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:28.882 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:29.080 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T22:33:29.080 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T22:33:29.098 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T22:33:29.098 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T22:33:29.541 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:29.596 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-base (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:29.757 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T22:33:29.758 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T22:33:29.922 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T22:33:30.234 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:30.381 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mds (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:30.527 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T22:33:30.527 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T22:33:30.609 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T22:33:30.609 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T22:33:31.027 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:31.100 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:31.128 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:31.263 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:31.312 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T22:33:31.313 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T22:33:31.479 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T22:33:31.479 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T22:33:31.777 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-osd (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:31.981 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.045 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T22:33:32.045 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T22:33:32.124 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.250 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.401 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-volume (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.519 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.628 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.763 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mon (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:32.778 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-19T22:33:32.870 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T22:33:32.976 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T22:33:32.976 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T22:33:33.057 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T22:33:33.464 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-cephadm (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:33.607 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:33.733 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-dashboard (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:33.901 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-volume (19.0.0-2401-gd0bf63dd-1jammy) ... 2024-04-19T22:33:34.157 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T22:33:34.270 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-19T22:33:34.406 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-19T22:33:34.558 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-19T22:33:34.884 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T22:33:34.890 DEBUG:teuthology.parallel:result is None 2024-04-19T22:33:35.668 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-19T22:33:36.351 INFO:teuthology.orchestra.run.smithi113.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T22:33:36.356 DEBUG:teuthology.parallel:result is None 2024-04-19T22:33:36.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:33:36.684 DEBUG:teuthology.orchestra.run.smithi113:> dpkg-query -W -f '${Version}' ceph 2024-04-19T22:33:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:33:36.704 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:33:36.704 INFO:teuthology.task.install:The correct ceph version 19.0.0-2401-gd0bf63dd-1jammy is installed. 2024-04-19T22:33:36.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:33:36.937 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2024-04-19T22:33:36.956 INFO:teuthology.orchestra.run.smithi178.stdout:19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:33:36.956 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2401-gd0bf63dd-1jammy 2024-04-19T22:33:36.956 INFO:teuthology.task.install:The correct ceph version 19.0.0-2401-gd0bf63dd-1jammy is installed. 2024-04-19T22:33:36.958 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T22:33:36.959 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:33:36.959 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T22:33:36.972 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:33:36.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T22:33:37.012 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T22:33:37.012 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:33:37.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T22:33:37.028 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T22:33:37.082 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:33:37.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T22:33:37.094 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T22:33:37.147 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T22:33:37.147 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:33:37.147 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T22:33:37.159 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T22:33:37.215 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:33:37.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T22:33:37.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T22:33:37.280 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T22:33:37.281 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:33:37.281 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T22:33:37.294 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T22:33:37.351 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:33:37.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T22:33:37.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T22:33:37.421 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-19T22:33:37.523 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': 'd0bf63dd179c05751e4be49477389aa290c73089', 'cephadm_mode': 'cephadm-package'} 2024-04-19T22:33:37.523 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:33:37.524 INFO:tasks.cephadm:Cluster fsid is dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:33:37.524 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-19T22:33:37.524 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.113', 'mon.c': '[v2:172.21.15.113:3301,v1:172.21.15.113:6790]', 'mon.b': '172.21.15.178'} 2024-04-19T22:33:37.524 INFO:tasks.cephadm:First mon is mon.a on smithi113 2024-04-19T22:33:37.525 INFO:tasks.cephadm:First mgr is y 2024-04-19T22:33:37.525 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-19T22:33:37.525 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname $(hostname -s) 2024-04-19T22:33:37.539 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2024-04-19T22:33:37.563 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 on all hosts... 2024-04-19T22:33:37.563 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 pull 2024-04-19T22:33:37.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 pull 2024-04-19T22:33:37.747 INFO:teuthology.orchestra.run.smithi113.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089... 2024-04-19T22:33:37.761 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089... 2024-04-19T22:34:33.325 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-19T22:34:33.325 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_version": "ceph version 19.0.0-2401-gd0bf63dd (d0bf63dd179c05751e4be49477389aa290c73089) squid (dev)", 2024-04-19T22:34:33.325 INFO:teuthology.orchestra.run.smithi113.stdout: "image_id": "044b88a464c745d1a532c17a66a301b05e696f95453442e00a0dc9465ded4f0d", 2024-04-19T22:34:33.325 INFO:teuthology.orchestra.run.smithi113.stdout: "repo_digests": [ 2024-04-19T22:34:33.325 INFO:teuthology.orchestra.run.smithi113.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7c88d0c70431e4a73a853860688a551a69c08a8f0f7b00ee258de4bf7c7072d1" 2024-04-19T22:34:33.326 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2024-04-19T22:34:33.326 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 19.0.0-2401-gd0bf63dd (d0bf63dd179c05751e4be49477389aa290c73089) squid (dev)", 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "044b88a464c745d1a532c17a66a301b05e696f95453442e00a0dc9465ded4f0d", 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7c88d0c70431e4a73a853860688a551a69c08a8f0f7b00ee258de4bf7c7072d1" 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2024-04-19T22:34:34.576 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-04-19T22:34:34.624 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph 2024-04-19T22:34:34.639 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2024-04-19T22:34:34.653 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /etc/ceph 2024-04-19T22:34:34.696 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2024-04-19T22:34:34.709 INFO:tasks.cephadm:Writing seed config... 2024-04-19T22:34:34.710 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [global] ms type = async 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-04-19T22:34:34.711 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-04-19T22:34:34.712 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-19T22:34:34.712 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:34:34.712 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-19T22:34:34.744 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dd3df874-fe9c-11ee-bc92-c7b262605968 mon election default strategy = 3 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-04-19T22:34:34.745 DEBUG:teuthology.orchestra.run.smithi113:mon.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service 2024-04-19T22:34:34.789 DEBUG:teuthology.orchestra.run.smithi113:mgr.y> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y.service 2024-04-19T22:34:34.833 INFO:tasks.cephadm:Bootstrapping... 2024-04-19T22:34:34.833 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 -v bootstrap --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.113 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-19T22:34:35.039 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-04-19T22:34:35.039 INFO:teuthology.orchestra.run.smithi113.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089', '-v', 'bootstrap', '--fsid', 'dd3df874-fe9c-11ee-bc92-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.113', '--skip-admin-label'] 2024-04-19T22:34:35.040 INFO:teuthology.orchestra.run.smithi113.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-19T22:34:35.040 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying podman|docker is present... 2024-04-19T22:34:35.040 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying lvm2 is present... 2024-04-19T22:34:35.040 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying time synchronization is in place... 2024-04-19T22:34:35.047 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-19T22:34:35.047 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-19T22:34:35.051 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-19T22:34:35.051 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.054 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-04-19T22:34:35.055 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-04-19T22:34:35.058 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-04-19T22:34:35.058 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.062 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-04-19T22:34:35.062 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout masked 2024-04-19T22:34:35.065 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-04-19T22:34:35.065 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.069 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-04-19T22:34:35.069 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-04-19T22:34:35.072 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-04-19T22:34:35.072 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.076 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout enabled 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout active 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:Unit ntp.service is enabled and running 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:Repeating the final host check... 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:docker (/usr/bin/docker) is present 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl is present 2024-04-19T22:34:35.080 INFO:teuthology.orchestra.run.smithi113.stdout:lvcreate is present 2024-04-19T22:34:35.083 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-19T22:34:35.083 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-19T22:34:35.086 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-19T22:34:35.086 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.089 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-04-19T22:34:35.089 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-04-19T22:34:35.093 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-04-19T22:34:35.094 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.097 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-04-19T22:34:35.097 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout masked 2024-04-19T22:34:35.100 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-04-19T22:34:35.101 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.104 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-04-19T22:34:35.104 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-04-19T22:34:35.107 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-04-19T22:34:35.107 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout inactive 2024-04-19T22:34:35.110 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout enabled 2024-04-19T22:34:35.114 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stdout active 2024-04-19T22:34:35.114 INFO:teuthology.orchestra.run.smithi113.stdout:Unit ntp.service is enabled and running 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Host looks OK 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Cluster fsid: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Acquiring lock 139948742322032 on /run/cephadm/dd3df874-fe9c-11ee-bc92-c7b262605968.lock 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Lock 139948742322032 acquired on /run/cephadm/dd3df874-fe9c-11ee-bc92-c7b262605968.lock 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying IP 172.21.15.113 port 3300 ... 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying IP 172.21.15.113 port 6789 ... 2024-04-19T22:34:35.115 INFO:teuthology.orchestra.run.smithi113.stdout:Base mon IP(s) is [172.21.15.113:3300, 172.21.15.113:6789], mon addrv is [v2:172.21.15.113:3300,v1:172.21.15.113:6789] 2024-04-19T22:34:35.117 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-04-19T22:34:35.117 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.113 metric 100 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.113 metric 100 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.113 metric 100 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.113 metric 100 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.113 metric 100 2024-04-19T22:34:35.118 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.113 metric 100 2024-04-19T22:34:35.119 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-19T22:34:35.119 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-19T22:34:35.119 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1792sec pref medium 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2024-04-19T22:34:35.121 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.0/20` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.0/20` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.1/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.1/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.2/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.0.2/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.15.254/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Mon IP `172.21.15.113` is in CIDR network `172.21.15.254/32` 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-04-19T22:34:35.123 INFO:teuthology.orchestra.run.smithi113.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-19T22:34:35.124 INFO:teuthology.orchestra.run.smithi113.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089... 2024-04-19T22:34:35.407 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/docker: stdout d0bf63dd179c05751e4be49477389aa290c73089: Pulling from ceph-ci/ceph 2024-04-19T22:34:35.407 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/docker: stdout Digest: sha256:7c88d0c70431e4a73a853860688a551a69c08a8f0f7b00ee258de4bf7c7072d1 2024-04-19T22:34:35.407 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:34:35.407 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 2024-04-19T22:34:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:ceph: stdout ceph version 19.0.0-2401-gd0bf63dd (d0bf63dd179c05751e4be49477389aa290c73089) squid (dev) 2024-04-19T22:34:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:Ceph version: ceph version 19.0.0-2401-gd0bf63dd (d0bf63dd179c05751e4be49477389aa290c73089) squid (dev) 2024-04-19T22:34:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:Extracting ceph user uid/gid from container image... 2024-04-19T22:34:38.174 INFO:teuthology.orchestra.run.smithi113.stdout:stat: stdout 167 167 2024-04-19T22:34:38.174 INFO:teuthology.orchestra.run.smithi113.stdout:Creating initial keys... 2024-04-19T22:34:39.445 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-authtool: stdout AQB+8SJmGhU5NhAAZj3jM7ljhJkRLmt4VJumbA== 2024-04-19T22:34:40.725 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-authtool: stdout AQCA8SJmUvRSCxAAupV9N0QnLW+Fex8I8DLCXw== 2024-04-19T22:34:41.997 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-authtool: stdout AQCB8SJm5Bl8HBAAJNK6RUjs3LKaPuV8fI5kbw== 2024-04-19T22:34:41.997 INFO:teuthology.orchestra.run.smithi113.stdout:Creating initial monmap... 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool for a [v2:172.21.15.113:3300,v1:172.21.15.113:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:setting min_mon_release = quincy 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: set fsid to dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:34:43.336 INFO:teuthology.orchestra.run.smithi113.stdout:Creating mon... 2024-04-19T22:34:44.632 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.066+0000 7f5802031c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-04-19T22:34:44.632 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.066+0000 7f5802031c80 1 imported monmap: 2024-04-19T22:34:44.632 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-04-19T22:34:44.665 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:44.665 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:44.665 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.066+0000 7f5802031c80 0 /usr/bin/ceph-mon: set fsid to dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: RocksDB version: 7.9.2 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Git sha 0 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Compile date 2024-04-19 06:21:11 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: DB SUMMARY 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: DB Session ID: C4PGFPCDDYONZVFIYNYK 2024-04-19T22:34:44.666 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.error_if_exists: 0 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.create_if_missing: 1 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.paranoid_checks: 1 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.env: 0x55cb67668c60 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.fs: PosixFileSystem 2024-04-19T22:34:44.667 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.info_log: 0x55cb68928d20 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.statistics: (nil) 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.use_fsync: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_log_file_size: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_fallocate: 1 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-04-19T22:34:44.668 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.use_direct_reads: 0 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.create_missing_column_families: 0 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.db_log_dir: 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.wal_dir: 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.advise_random_on_open: 1 2024-04-19T22:34:44.669 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.write_buffer_manager: 0x55cb688fd360 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.rate_limiter: (nil) 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.unordered_write: 0 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-19T22:34:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.row_cache: None 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.wal_filter: None 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.two_write_queues: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.manual_wal_flush: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.wal_compression: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.atomic_flush: 0 2024-04-19T22:34:44.671 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.log_readahead_size: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_background_jobs: 2 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_background_compactions: -1 2024-04-19T22:34:44.672 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_subcompactions: 1 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_total_wal_size: 0 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_open_files: -1 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bytes_per_sync: 0 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-04-19T22:34:44.673 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_background_flushes: -1 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Compression algorithms supported: 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kZSTD supported: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kXpressCompression supported: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kZlibCompression supported: 1 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kSnappyCompression supported: 1 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kLZ4Compression supported: 1 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: kBZip2Compression supported: 0 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-04-19T22:34:44.674 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.merge_operator: 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_filter: None 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_filter_factory: None 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-04-19T22:34:44.675 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cb68928e20) 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-04-19T22:34:44.676 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x55cb6892d090 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-04-19T22:34:44.677 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-04-19T22:34:44.678 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression: NoCompression 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.num_levels: 7 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-19T22:34:44.679 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.level: 32767 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-04-19T22:34:44.680 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.enabled: false 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-19T22:34:44.681 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.arena_block_size: 1048576 2024-04-19T22:34:44.682 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-19T22:34:44.683 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.table_properties_collectors: 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.inplace_update_support: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.bloom_locality: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.max_successive_merges: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.force_consistency_checks: 1 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.ttl: 2592000 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-04-19T22:34:44.684 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enable_blob_files: false 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.min_blob_size: 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_file_size: 268435456 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.685 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 21d49123-330a-46d8-8abb-afc9951127e2 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.070+0000 7f5802031c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f5802031c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cb689f8000 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f5802031c80 4 rocksdb: DB pointer 0x55cb689e8000 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f57f219c700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-19T22:34:44.686 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f57f219c700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-19T22:34:44.687 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-19T22:34:44.688 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x55cb6892d090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f5802031c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f5802031c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph-mon: stderr debug 2024-04-19T22:34:44.074+0000 7f5802031c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-04-19T22:34:44.689 INFO:teuthology.orchestra.run.smithi113.stdout:create mon.a on 2024-04-19T22:34:44.903 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-19T22:34:45.106 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-04-19T22:34:45.342 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target -> /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target. 2024-04-19T22:34:45.343 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target -> /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target. 2024-04-19T22:34:45.642 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a 2024-04-19T22:34:45.643 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service: Unit ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service not loaded. 2024-04-19T22:34:45.836 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target.wants/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service. 2024-04-19T22:34:45.845 INFO:teuthology.orchestra.run.smithi113.stdout:firewalld does not appear to be present 2024-04-19T22:34:45.845 INFO:teuthology.orchestra.run.smithi113.stdout:Not possible to enable service . firewalld.service is not available 2024-04-19T22:34:45.845 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mon to start... 2024-04-19T22:34:45.845 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mon... 2024-04-19T22:34:47.285 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:47 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.148623+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout cluster: 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout id: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout services: 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.166235s) 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-19T22:34:47.883 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout data: 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout pgs: 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e1e921700 1 Processor -- start 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e1e921700 1 -- start start 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e1e921700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e1e921700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18079740 con 0x7f9e18104a50 2024-04-19T22:34:47.884 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e17fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e17fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43402/0 (socket says 172.21.15.113:43402) 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.182+0000 7f9e17fff700 1 -- 172.21.15.113:0/4001758348 learned_addr learned my addr 172.21.15.113:0/4001758348 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 -- 172.21.15.113:0/4001758348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181053b0 con 0x7f9e18104a50 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 --2- 172.21.15.113:0/4001758348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0098a0 tx=0x7f9e0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b86a65ddc0e8f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e16ffd700 1 -- 172.21.15.113:0/4001758348 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e0c004160 con 0x7f9e18104a50 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e16ffd700 1 -- 172.21.15.113:0/4001758348 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0c004300 con 0x7f9e18104a50 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e16ffd700 1 -- 172.21.15.113:0/4001758348 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e0c0036a0 con 0x7f9e18104a50 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/4001758348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 msgr2=0x7f9e18104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 --2- 172.21.15.113:0/4001758348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0098a0 tx=0x7f9e0c009bb0 comp rx=0 tx=0).stop 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/4001758348 shutdown_connections 2024-04-19T22:34:47.885 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 --2- 172.21.15.113:0/4001758348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e18104e70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/4001758348 >> 172.21.15.113:0/4001758348 conn(0x7f9e181006d0 msgr2=0x7f9e18102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/4001758348 shutdown_connections 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/4001758348 wait complete. 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 Processor -- start 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- start start 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181058e0 con 0x7f9e18104a50 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43412/0 (socket says 172.21.15.113:43412) 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 -- 172.21.15.113:0/720402811 learned_addr learned my addr 172.21.15.113:0/720402811 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:47.886 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 -- 172.21.15.113:0/720402811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1819bff0 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e17fff700 1 --2- 172.21.15.113:0/720402811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e0c003db0 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0c011630 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e0c011950 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1819c280 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1819ef70 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e0c011af0 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.186+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e0c01c450 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.190+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e18063890 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.190+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9e0c004260 con 0x7f9e18104a50 2024-04-19T22:34:47.887 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.314+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f9e18195010 con 0x7f9e18104a50 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e157fa700 1 -- 172.21.15.113:0/720402811 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9e18195010 con 0x7f9e18104a50 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 msgr2=0x7f9e1819bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 --2- 172.21.15.113:0/720402811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c004750 comp rx=0 tx=0).stop 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 shutdown_connections 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 --2- 172.21.15.113:0/720402811 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e18104a50 0x7f9e1819bab0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 >> 172.21.15.113:0/720402811 conn(0x7f9e181006d0 msgr2=0x7f9e181920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 shutdown_connections 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:47.318+0000 7f9e1e921700 1 -- 172.21.15.113:0/720402811 wait complete. 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:mon is available 2024-04-19T22:34:47.888 INFO:teuthology.orchestra.run.smithi113.stdout:Assimilating anything we can from ceph.conf... 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152058+0000 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152235+0000 mon.a (mon.0) 3 : cluster 0 monmap epoch 1 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152247+0000 mon.a (mon.0) 4 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152262+0000 mon.a (mon.0) 5 : cluster 0 last_changed 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152275+0000 mon.a (mon.0) 6 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152286+0000 mon.a (mon.0) 7 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152298+0000 mon.a (mon.0) 8 : cluster 0 election_strategy: 1 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.152311+0000 mon.a (mon.0) 9 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.154236+0000 mon.a (mon.0) 10 : cluster 0 fsmap 2024-04-19T22:34:48.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.156606+0000 mon.a (mon.0) 11 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-04-19T22:34:48.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: cluster 2024-04-19T22:34:47.157109+0000 mon.a (mon.0) 12 : cluster 0 mgrmap e1: no daemons active 2024-04-19T22:34:48.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:48 smithi113 bash[21046]: audit 2024-04-19T22:34:47.318252+0000 mon.a (mon.0) 13 : audit 0 from='client.? 172.21.15.113:0/720402811' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-19T22:34:49.285 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:49 smithi113 bash[21046]: audit 2024-04-19T22:34:48.916120+0000 mon.a (mon.0) 14 : audit 1 from='client.? 172.21.15.113:0/1805823351' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-19T22:34:49.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:49 smithi113 bash[21046]: audit 2024-04-19T22:34:48.918706+0000 mon.a (mon.0) 15 : audit 1 from='client.? 172.21.15.113:0/1805823351' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [global] 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout fsid = dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.113:3300,v1:172.21.15.113:6789] 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-19T22:34:49.555 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [osd] 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 Processor -- start 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- start start 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:49.556 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94106c10 con 0x7f0d94106220 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40470/0 (socket says 172.21.15.113:40470) 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 -- 172.21.15.113:0/2343634166 learned_addr learned my addr 172.21.15.113:0/2343634166 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 -- 172.21.15.113:0/2343634166 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d94107420 con 0x7f0d94106220 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- 172.21.15.113:0/2343634166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0d840098a0 tx=0x7f0d84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d11d5cf8797004 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d91d9b700 1 -- 172.21.15.113:0/2343634166 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84004160 con 0x7f0d94106220 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d91d9b700 1 -- 172.21.15.113:0/2343634166 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d84004300 con 0x7f0d94106220 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d91d9b700 1 -- 172.21.15.113:0/2343634166 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d840036a0 con 0x7f0d94106220 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/2343634166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 msgr2=0x7f0d94106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 --2- 172.21.15.113:0/2343634166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0d840098a0 tx=0x7f0d84009bb0 comp rx=0 tx=0).stop 2024-04-19T22:34:49.557 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/2343634166 shutdown_connections 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 --2- 172.21.15.113:0/2343634166 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d94106640 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/2343634166 >> 172.21.15.113:0/2343634166 conn(0x7f0d941017e0 msgr2=0x7f0d94103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/2343634166 shutdown_connections 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/2343634166 wait complete. 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 Processor -- start 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- start start 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94107950 con 0x7f0d94106220 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40486/0 (socket says 172.21.15.113:40486) 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 -- 172.21.15.113:0/1805823351 learned_addr learned my addr 172.21.15.113:0/1805823351 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 -- 172.21.15.113:0/1805823351 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9407c1d0 con 0x7f0d94106220 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d92d9d700 1 --2- 172.21.15.113:0/1805823351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0d84000c00 tx=0x7f0d84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:49.558 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84003db0 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d84011630 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9407a3c0 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.786+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84011950 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.790+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9407a900 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.790+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d8401a460 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.790+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0d8401b780 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.790+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d94063890 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.790+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0d84031020 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.914+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0d94193080 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+340 (secure 0 0 0) 0x7f0d8401b9d0 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d7bfff700 1 -- 172.21.15.113:0/1805823351 <== mon.0 v2:172.21.15.113:3300/0 8 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f0d8401ad20 con 0x7f0d94106220 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 msgr2=0x7f0d9407bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 --2- 172.21.15.113:0/1805823351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0d84000c00 tx=0x7f0d84004750 comp rx=0 tx=0).stop 2024-04-19T22:34:49.559 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 shutdown_connections 2024-04-19T22:34:49.560 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 --2- 172.21.15.113:0/1805823351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d94106220 0x7f0d9407bc90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:49.560 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 >> 172.21.15.113:0/1805823351 conn(0x7f0d941017e0 msgr2=0x7f0d941905d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:49.560 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 shutdown_connections 2024-04-19T22:34:49.560 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:48.918+0000 7f0d99072700 1 -- 172.21.15.113:0/1805823351 wait complete. 2024-04-19T22:34:49.560 INFO:teuthology.orchestra.run.smithi113.stdout:Generating new minimal ceph.conf... 2024-04-19T22:34:51.035 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:50 smithi113 bash[21046]: audit 2024-04-19T22:34:50.608428+0000 mon.a (mon.0) 16 : audit 0 from='client.? 172.21.15.113:0/2212050520' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f7771d1d700 1 Processor -- start 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f7771d1d700 1 -- start start 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f7771d1d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f7771d1d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f776c108e10 con 0x7f776c108420 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f776b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f776b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40492/0 (socket says 172.21.15.113:40492) 2024-04-19T22:34:51.238 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f776b7fe700 1 -- 172.21.15.113:0/2621138014 learned_addr learned my addr 172.21.15.113:0/2621138014 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:51.239 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f776b7fe700 1 -- 172.21.15.113:0/2621138014 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c109620 con 0x7f776c108420 2024-04-19T22:34:51.239 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.465+0000 7f776b7fe700 1 --2- 172.21.15.113:0/2621138014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f775c0098a0 tx=0x7f775c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f7754a4e8eca56 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:51.239 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776a7fc700 1 -- 172.21.15.113:0/2621138014 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c004160 con 0x7f776c108420 2024-04-19T22:34:51.243 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776a7fc700 1 -- 172.21.15.113:0/2621138014 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f775c004300 con 0x7f776c108420 2024-04-19T22:34:51.243 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776a7fc700 1 -- 172.21.15.113:0/2621138014 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c011a60 con 0x7f776c108420 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2621138014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 msgr2=0x7f776c108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 --2- 172.21.15.113:0/2621138014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f775c0098a0 tx=0x7f775c009bb0 comp rx=0 tx=0).stop 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2621138014 shutdown_connections 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 --2- 172.21.15.113:0/2621138014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c108840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2621138014 >> 172.21.15.113:0/2621138014 conn(0x7f776c07b7d0 msgr2=0x7f776c07bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2621138014 shutdown_connections 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2621138014 wait complete. 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 Processor -- start 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- start start 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f776c10c9d0 con 0x7f776c108420 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:51.244 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40504/0 (socket says 172.21.15.113:40504) 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776b7fe700 1 -- 172.21.15.113:0/2212050520 learned_addr learned my addr 172.21.15.113:0/2212050520 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776b7fe700 1 -- 172.21.15.113:0/2212050520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c19c8d0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f776b7fe700 1 --2- 172.21.15.113:0/2212050520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fb0 tx=0x7f775c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c0039e0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f775c01a8c0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c19cb60 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c024800 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c19f850 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f775c022020 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.469+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f775c0193c0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.473+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774c005150 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.473+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f775c01adc0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f774c005710 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7768ff9700 1 -- 172.21.15.113:0/2212050520 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f775c02dde0 con 0x7f776c108420 2024-04-19T22:34:51.245 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 msgr2=0x7f776c19c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 --2- 172.21.15.113:0/2212050520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f775c009fb0 tx=0x7f775c011ae0 comp rx=0 tx=0).stop 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 shutdown_connections 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 --2- 172.21.15.113:0/2212050520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f776c108420 0x7f776c19c390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 >> 172.21.15.113:0/2212050520 conn(0x7f776c07b7d0 msgr2=0x7f776c1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 shutdown_connections 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:50.605+0000 7f7771d1d700 1 -- 172.21.15.113:0/2212050520 wait complete. 2024-04-19T22:34:51.246 INFO:teuthology.orchestra.run.smithi113.stdout:Restarting the monitor... 2024-04-19T22:34:51.535 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:51 smithi113 systemd[1]: Stopping Ceph mon.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T22:34:51.535 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:51 smithi113 bash[21046]: debug 2024-04-19T22:34:51.369+0000 7fbee5eaf700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-19T22:34:51.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:51 smithi113 bash[21046]: debug 2024-04-19T22:34:51.369+0000 7fbee5eaf700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-19T22:34:52.112 INFO:teuthology.orchestra.run.smithi113.stdout:Setting public_network to 172.21.0.0/20,172.21.0.2/32,172.21.0.1/32,172.21.15.254/32 in mon config section 2024-04-19T22:34:52.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:51 smithi113 bash[21430]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-mon-a 2024-04-19T22:34:52.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:52 smithi113 bash[21490]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-mon-a 2024-04-19T22:34:52.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:52 smithi113 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-19T22:34:52.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:52 smithi113 systemd[1]: Stopped Ceph mon.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:34:52.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:52 smithi113 systemd[1]: Started Ceph mon.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.257+0000 7f11e82a5c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.257+0000 7f11e82a5c80 0 ceph version 19.0.0-2401-gd0bf63dd (d0bf63dd179c05751e4be49477389aa290c73089) squid (dev), process ceph-mon, pid 7 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.257+0000 7f11e82a5c80 0 pidfile_write: ignore empty --pid-file 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 0 load: jerasure load: lrc 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: RocksDB version: 7.9.2 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Git sha 0 2024-04-19T22:34:53.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Compile date 2024-04-19 06:21:11 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: DB SUMMARY 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: DB Session ID: 6TOS0Q41T2G5NSMEH8MI 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: CURRENT file: CURRENT 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: IDENTITY file: IDENTITY 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 91863 ; 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.error_if_exists: 0 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.create_if_missing: 0 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.paranoid_checks: 1 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-19T22:34:53.537 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.env: 0x562c701d0c60 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.fs: PosixFileSystem 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.info_log: 0x562c70ef3ae0 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.statistics: (nil) 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.use_fsync: 0 2024-04-19T22:34:53.538 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_log_file_size: 0 2024-04-19T22:34:53.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-19T22:34:53.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-04-19T22:34:53.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_fallocate: 1 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.use_direct_reads: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.create_missing_column_families: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.db_log_dir: 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.wal_dir: 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-04-19T22:34:53.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.advise_random_on_open: 1 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.write_buffer_manager: 0x562c70ec61e0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.rate_limiter: (nil) 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.unordered_write: 0 2024-04-19T22:34:53.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.row_cache: None 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.wal_filter: None 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.two_write_queues: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.manual_wal_flush: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.wal_compression: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.atomic_flush: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-04-19T22:34:53.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.log_readahead_size: 0 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_background_jobs: 2 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_background_compactions: -1 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_subcompactions: 1 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-19T22:34:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_total_wal_size: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_open_files: -1 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bytes_per_sync: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_background_flushes: -1 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Compression algorithms supported: 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-19T22:34:53.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kZSTD supported: 0 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kXpressCompression supported: 0 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kZlibCompression supported: 1 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kSnappyCompression supported: 1 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kLZ4Compression supported: 1 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: kBZip2Compression supported: 0 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.merge_operator: 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_filter: None 2024-04-19T22:34:53.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_filter_factory: None 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562c70ef3be0) 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cache_index_and_filter_blocks: 1 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: pin_top_level_index_and_filter: 1 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: index_type: 0 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: data_block_index_type: 0 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: index_shortening: 1 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: data_block_hash_table_util_ratio: 0.750000 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: checksum: 4 2024-04-19T22:34:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: no_block_cache: 0 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_cache: 0x562c70ef5090 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_cache_name: BinnedLRUCache 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_cache_options: 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: capacity : 536870912 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: num_shard_bits : 4 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: strict_capacity_limit : 0 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: high_pri_pool_ratio: 0.000 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_cache_compressed: (nil) 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: persistent_cache: (nil) 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_size: 4096 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_size_deviation: 10 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_restart_interval: 16 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: index_block_restart_interval: 1 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: metadata_block_size: 4096 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: partition_filters: 0 2024-04-19T22:34:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: use_delta_encoding: 1 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: filter_policy: bloomfilter 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: whole_key_filtering: 1 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: verify_compression: 0 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: read_amp_bytes_per_bit: 0 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: format_version: 5 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: enable_index_compression: 1 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: block_align: 0 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: max_auto_readahead_size: 262144 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: prepopulate_block_cache: 0 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: initial_auto_readahead_size: 8192 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: num_file_reads_for_auto_readahead: 2 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-04-19T22:34:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression: NoCompression 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.num_levels: 7 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-19T22:34:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.level: 32767 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.enabled: false 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-19T22:34:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-19T22:34:53.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.arena_block_size: 1048576 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-19T22:34:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.table_properties_collectors: 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.inplace_update_support: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.bloom_locality: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.max_successive_merges: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.force_consistency_checks: 1 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.ttl: 2592000 2024-04-19T22:34:53.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enable_blob_files: false 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.min_blob_size: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_file_size: 268435456 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-19T22:34:53.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 21d49123-330a-46d8-8abb-afc9951127e2 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1713566093269148, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1713566093270210, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 88141, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 272, "table_properties": {"data_size": 86242, "index_size": 245, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 10988, "raw_average_key_size": 47, "raw_value_size": 80117, "raw_average_value_size": 346, "num_data_blocks": 11, "num_entries": 231, "num_filter_entries": 231, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713566093, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "21d49123-330a-46d8-8abb-afc9951127e2", "db_session_id": "6TOS0Q41T2G5NSMEH8MI", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1713566093270311, "job": 1, "event": "recovery_finished"} 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.265+0000 7f11e82a5c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-19T22:34:53.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562c70fea000 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 4 rocksdb: DB pointer 0x562c70fd4000 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11d6a08700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11d6a08700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: ** DB Stats ** 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Uptime(secs): 0.0 total, 0.0 interval 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-19T22:34:53.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: ** Compaction Stats [default] ** 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: L0 2/0 87.91 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Sum 2/0 87.91 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: ** Compaction Stats [default] ** 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 128.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Uptime(secs): 0.0 total, 0.0 interval 2024-04-19T22:34:53.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Flush(GB): cumulative 0.000, interval 0.000 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: AddFile(Total Files): cumulative 0, interval 0 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: AddFile(L0 Files): cumulative 0, interval 0 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: AddFile(Keys): cumulative 0, interval 0 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Cumulative compaction: 0.00 GB write, 22.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Interval compaction: 0.00 GB write, 22.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Block cache BinnedLRUCache@0x562c70ef5090#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: ** File Read Latency Histogram By Level [default] ** 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] at bind addrs [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 1 mon.a@-1(???) e1 preinit fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:53.558 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).mds e1 new map 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).mds e1 print_map 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: e1 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: enable_multiple, ever_enabled_multiple: 1,1 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: legacy client fscid: -1 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: No filesystems configured 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: debug 2024-04-19T22:34:53.269+0000 7f11e82a5c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.298925+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-04-19T22:34:53.559 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.298996+0000 mon.a (mon.0) 2 : cluster 0 monmap epoch 1 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299006+0000 mon.a (mon.0) 3 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299015+0000 mon.a (mon.0) 4 : cluster 0 last_changed 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299024+0000 mon.a (mon.0) 5 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299039+0000 mon.a (mon.0) 6 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299048+0000 mon.a (mon.0) 7 : cluster 0 election_strategy: 1 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299059+0000 mon.a (mon.0) 8 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299458+0000 mon.a (mon.0) 9 : cluster 0 fsmap 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299484+0000 mon.a (mon.0) 10 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-04-19T22:34:53.560 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:53 smithi113 bash[21528]: cluster 2024-04-19T22:34:53.299897+0000 mon.a (mon.0) 11 : cluster 0 mgrmap e1: no daemons active 2024-04-19T22:34:54.271 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 Processor -- start 2024-04-19T22:34:54.271 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- start start 2024-04-19T22:34:54.271 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:54.271 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f33f010fa10 con 0x7f33f010d050 2024-04-19T22:34:54.272 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:54.273 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40506/0 (socket says 172.21.15.113:40506) 2024-04-19T22:34:54.273 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 -- 172.21.15.113:0/1247435951 learned_addr learned my addr 172.21.15.113:0/1247435951 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 -- 172.21.15.113:0/1247435951 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f010fb90 con 0x7f33f010d050 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- 172.21.15.113:0/1247435951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098a0 tx=0x7f33e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938671adf10b492a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33eeffd700 1 -- 172.21.15.113:0/1247435951 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0004160 con 0x7f33f010d050 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33eeffd700 1 -- 172.21.15.113:0/1247435951 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f33e0004300 con 0x7f33f010d050 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33eeffd700 1 -- 172.21.15.113:0/1247435951 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0011a60 con 0x7f33f010d050 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- 172.21.15.113:0/1247435951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 msgr2=0x7f33f010f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 --2- 172.21.15.113:0/1247435951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098a0 tx=0x7f33e0009bb0 comp rx=0 tx=0).stop 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- 172.21.15.113:0/1247435951 shutdown_connections 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 --2- 172.21.15.113:0/1247435951 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f010f440 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- 172.21.15.113:0/1247435951 >> 172.21.15.113:0/1247435951 conn(0x7f33f007b7d0 msgr2=0x7f33f007dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- 172.21.15.113:0/1247435951 shutdown_connections 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- 172.21.15.113:0/1247435951 wait complete. 2024-04-19T22:34:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 Processor -- start 2024-04-19T22:34:54.275 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- start start 2024-04-19T22:34:54.275 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:54.277 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33f64c9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f33f0110bb0 con 0x7f33f010d050 2024-04-19T22:34:54.277 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:54.277 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40512/0 (socket says 172.21.15.113:40512) 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 -- 172.21.15.113:0/3162939096 learned_addr learned my addr 172.21.15.113:0/3162939096 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 -- 172.21.15.113:0/3162939096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f01a0c50 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33effff700 1 --2- 172.21.15.113:0/3162939096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f33e0011700 tx=0x7f33e0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.405+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0003aa0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f33e001a8c0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f01a0ee0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e00248a0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f01a3bd0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33e0022020 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f33e00193c0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f0063890 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.409+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f33e0042dd0 con 0x7f33f010d050 2024-04-19T22:34:54.278 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.537+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f33f01a3f70 con 0x7f33f010d050 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33ed7fa700 1 -- 172.21.15.113:0/3162939096 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 169+0+0 (secure 0 0 0) 0x7f33e0031020 con 0x7f33f010d050 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 msgr2=0x7f33f01a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 --2- 172.21.15.113:0/3162939096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f33e0011700 tx=0x7f33e0011ae0 comp rx=0 tx=0).stop 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 shutdown_connections 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 --2- 172.21.15.113:0/3162939096 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33f010d050 0x7f33f01a0710 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 >> 172.21.15.113:0/3162939096 conn(0x7f33f007b7d0 msgr2=0x7f33f007c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 shutdown_connections 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:53.545+0000 7f33f64c9700 1 -- 172.21.15.113:0/3162939096 wait complete. 2024-04-19T22:34:54.279 INFO:teuthology.orchestra.run.smithi113.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-19T22:34:54.306 INFO:teuthology.orchestra.run.smithi113.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-19T22:34:54.306 INFO:teuthology.orchestra.run.smithi113.stdout:Creating mgr... 2024-04-19T22:34:54.307 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-19T22:34:54.307 INFO:teuthology.orchestra.run.smithi113.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-19T22:34:54.640 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:54 smithi113 bash[21528]: audit 2024-04-19T22:34:53.546759+0000 mon.a (mon.0) 12 : audit 1 from='client.? 172.21.15.113:0/3162939096' entity='client.admin' 2024-04-19T22:34:54.640 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:34:54.648 INFO:teuthology.orchestra.run.smithi113.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y 2024-04-19T22:34:54.648 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y.service: Unit ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y.service not loaded. 2024-04-19T22:34:54.856 INFO:teuthology.orchestra.run.smithi113.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968.target.wants/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service. 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:firewalld does not appear to be present 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:Not possible to enable service . firewalld.service is not available 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:firewalld does not appear to be present 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mgr to start... 2024-04-19T22:34:54.865 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mgr... 2024-04-19T22:34:54.904 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:34:56.522 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:34:56 smithi113 bash[21528]: audit 2024-04-19T22:34:56.349928+0000 mon.a (mon.0) 13 : audit 0 from='client.? 172.21.15.113:0/2164733819' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-19T22:34:56.522 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:56 smithi113 bash[21785]: debug 2024-04-19T22:34:56.265+0000 7fe37e69e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsid": "dd3df874-fe9c-11ee-bc92-c7b262605968", 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "health": { 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-19T22:34:56.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 0 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-19T22:34:56.909 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "a" 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-19T22:34:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-19T22:34:56.920 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-19T22:34:56.920 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-19T22:34:56.920 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:34:56.921 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "restful" 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:34:56.922 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modified": "2024-04-19T22:34:47.153358+0000", 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 Processor -- start 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- start start 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000796e0 con 0x7f5d00106cc0 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40540/0 (socket says 172.21.15.113:40540) 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 -- 172.21.15.113:0/3588736671 learned_addr learned my addr 172.21.15.113:0/3588736671 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 -- 172.21.15.113:0/3588736671 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d001095f0 con 0x7f5d00106cc0 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- 172.21.15.113:0/3588736671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098a0 tx=0x7f5cfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128ed0e0722b9715 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:56.923 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d04caf700 1 -- 172.21.15.113:0/3588736671 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc004160 con 0x7f5d00106cc0 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d04caf700 1 -- 172.21.15.113:0/3588736671 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5cfc004300 con 0x7f5d00106cc0 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d04caf700 1 -- 172.21.15.113:0/3588736671 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc011a60 con 0x7f5d00106cc0 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/3588736671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 msgr2=0x7f5d001090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 --2- 172.21.15.113:0/3588736671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098a0 tx=0x7f5cfc009bb0 comp rx=0 tx=0).stop 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/3588736671 shutdown_connections 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 --2- 172.21.15.113:0/3588736671 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d001090b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/3588736671 >> 172.21.15.113:0/3588736671 conn(0x7f5d001006d0 msgr2=0x7f5d00102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/3588736671 shutdown_connections 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/3588736671 wait complete. 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 Processor -- start 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- start start 2024-04-19T22:34:56.924 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0010a560 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40542/0 (socket says 172.21.15.113:40542) 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 -- 172.21.15.113:0/2164733819 learned_addr learned my addr 172.21.15.113:0/2164733819 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 -- 172.21.15.113:0/2164733819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0019c870 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d05cb1700 1 --2- 172.21.15.113:0/2164733819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc011700 tx=0x7f5cfc011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc003aa0 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f5cfc01a8c0 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc0248a0 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.213+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0019cb00 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.217+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0019f7f0 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.217+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cfc022020 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.217+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5cfc0193c0 con 0x7f5d00106cc0 2024-04-19T22:34:56.925 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.217+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d00063890 con 0x7f5d00106cc0 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.217+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5cfc042dd0 con 0x7f5d00106cc0 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.345+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5d0019fb90 con 0x7f5d00106cc0 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.345+0000 7f5cf6ffd700 1 -- 172.21.15.113:0/2164733819 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f5cfc031020 con 0x7f5d00106cc0 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 msgr2=0x7f5d0019c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 --2- 172.21.15.113:0/2164733819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc011700 tx=0x7f5cfc011ae0 comp rx=0 tx=0).stop 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 shutdown_connections 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 --2- 172.21.15.113:0/2164733819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d00106cc0 0x7f5d0019c330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 >> 172.21.15.113:0/2164733819 conn(0x7f5d001006d0 msgr2=0x7f5d00101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 shutdown_connections 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:56.349+0000 7f5d07f15700 1 -- 172.21.15.113:0/2164733819 wait complete. 2024-04-19T22:34:56.926 INFO:teuthology.orchestra.run.smithi113.stdout:mgr not available, waiting (1/15)... 2024-04-19T22:34:58.151 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:57 smithi113 bash[21785]: debug 2024-04-19T22:34:57.821+0000 7fe37e69e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:34:58.151 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:57 smithi113 bash[21785]: debug 2024-04-19T22:34:57.917+0000 7fe37e69e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:34:58.152 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:58 smithi113 bash[21785]: debug 2024-04-19T22:34:58.161+0000 7fe37e69e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:34:59.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:58 smithi113 bash[21785]: debug 2024-04-19T22:34:58.949+0000 7fe37e69e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:34:59.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:59 smithi113 bash[21785]: debug 2024-04-19T22:34:59.057+0000 7fe37e69e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:34:59.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:59 smithi113 bash[21785]: debug 2024-04-19T22:34:59.161+0000 7fe37e69e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:34:59.773 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:59 smithi113 bash[21785]: debug 2024-04-19T22:34:59.513+0000 7fe37e69e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:34:59.774 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:59 smithi113 bash[21785]: debug 2024-04-19T22:34:59.625+0000 7fe37e69e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:34:59.774 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:34:59 smithi113 bash[21785]: debug 2024-04-19T22:34:59.729+0000 7fe37e69e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:35:00.536 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21528]: audit 2024-04-19T22:35:00.078328+0000 mon.a (mon.0) 14 : audit 0 from='client.? 172.21.15.113:0/1686071110' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-19T22:35:00.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21785]: debug 2024-04-19T22:35:00.085+0000 7fe37e69e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:35:00.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21785]: debug 2024-04-19T22:35:00.329+0000 7fe37e69e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:35:00.643 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:00.643 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsid": "dd3df874-fe9c-11ee-bc92-c7b262605968", 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "health": { 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-19T22:35:00.644 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 0 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "a" 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-19T22:35:00.646 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-19T22:35:00.647 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-19T22:35:00.651 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.652 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "restful" 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:00.653 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modified": "2024-04-19T22:34:47.153358+0000", 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 Processor -- start 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- start start 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffa50108e50 con 0x7ffa50108460 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4e59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4e59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35042/0 (socket says 172.21.15.113:35042) 2024-04-19T22:35:00.654 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4e59c700 1 -- 172.21.15.113:0/3604437012 learned_addr learned my addr 172.21.15.113:0/3604437012 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4e59c700 1 -- 172.21.15.113:0/3604437012 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa50109660 con 0x7ffa50108460 2024-04-19T22:35:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4e59c700 1 --2- 172.21.15.113:0/3604437012 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa400098a0 tx=0x7ffa40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4595d6b0ca2dae7e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4d59a700 1 -- 172.21.15.113:0/3604437012 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa40004160 con 0x7ffa50108460 2024-04-19T22:35:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4d59a700 1 -- 172.21.15.113:0/3604437012 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7ffa40004300 con 0x7ffa50108460 2024-04-19T22:35:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa4d59a700 1 -- 172.21.15.113:0/3604437012 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa40011a60 con 0x7ffa50108460 2024-04-19T22:35:00.658 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- 172.21.15.113:0/3604437012 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 msgr2=0x7ffa50108880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:00.658 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 --2- 172.21.15.113:0/3604437012 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa400098a0 tx=0x7ffa40009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:00.658 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- 172.21.15.113:0/3604437012 shutdown_connections 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 --2- 172.21.15.113:0/3604437012 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa50108880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- 172.21.15.113:0/3604437012 >> 172.21.15.113:0/3604437012 conn(0x7ffa5007b840 msgr2=0x7ffa5007bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- 172.21.15.113:0/3604437012 shutdown_connections 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.941+0000 7ffa54cad700 1 -- 172.21.15.113:0/3604437012 wait complete. 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 Processor -- start 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 -- start start 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5010ca10 con 0x7ffa50108460 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa4e59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa4e59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35046/0 (socket says 172.21.15.113:35046) 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa4e59c700 1 -- 172.21.15.113:0/1686071110 learned_addr learned my addr 172.21.15.113:0/1686071110 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa4e59c700 1 -- 172.21.15.113:0/1686071110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5019c930 con 0x7ffa50108460 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa4e59c700 1 --2- 172.21.15.113:0/1686071110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009fb0 tx=0x7ffa40011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:00.659 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa400039e0 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7ffa4001a8c0 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa40024800 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5019cbc0 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa40022020 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5019cfe0 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffa4000b670 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.945+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa50063890 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:34:59.949+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ffa4001aa70 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.073+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffa5019fc20 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa3f7fe700 1 -- 172.21.15.113:0/1686071110 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ffa4001a430 con 0x7ffa50108460 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 msgr2=0x7ffa5019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 --2- 172.21.15.113:0/1686071110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009fb0 tx=0x7ffa40011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 shutdown_connections 2024-04-19T22:35:00.660 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 --2- 172.21.15.113:0/1686071110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa50108460 0x7ffa5019c3f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:00.661 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 >> 172.21.15.113:0/1686071110 conn(0x7ffa5007b840 msgr2=0x7ffa5010a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:00.661 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 shutdown_connections 2024-04-19T22:35:00.661 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:00.077+0000 7ffa54cad700 1 -- 172.21.15.113:0/1686071110 wait complete. 2024-04-19T22:35:00.661 INFO:teuthology.orchestra.run.smithi113.stdout:mgr not available, waiting (2/15)... 2024-04-19T22:35:00.955 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21785]: debug 2024-04-19T22:35:00.585+0000 7fe37e69e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:35:00.955 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21785]: debug 2024-04-19T22:35:00.697+0000 7fe37e69e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:35:00.955 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:00 smithi113 bash[21785]: debug 2024-04-19T22:35:00.965+0000 7fe37e69e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:35:01.655 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:01 smithi113 bash[21785]: debug 2024-04-19T22:35:01.369+0000 7fe37e69e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:01.655 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:01 smithi113 bash[21785]: debug 2024-04-19T22:35:01.601+0000 7fe37e69e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:35:01.949 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:01 smithi113 bash[21785]: debug 2024-04-19T22:35:01.717+0000 7fe37e69e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:35:02.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:01 smithi113 bash[21785]: debug 2024-04-19T22:35:01.956+0000 7fe37e69e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:03.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:02 smithi113 bash[21785]: debug 2024-04-19T22:35:02.948+0000 7fe37e69e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:35:03.287 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:03 smithi113 bash[21785]: debug 2024-04-19T22:35:03.060+0000 7fe37e69e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:35:03.749 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:03 smithi113 bash[21785]: debug 2024-04-19T22:35:03.352+0000 7fe37e69e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:35:03.749 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:03 smithi113 bash[21785]: debug 2024-04-19T22:35:03.468+0000 7fe37e69e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:35:04.033 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:03 smithi113 bash[21528]: audit 2024-04-19T22:35:03.748376+0000 mon.a (mon.0) 15 : audit 0 from='client.? 172.21.15.113:0/2419758371' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-19T22:35:04.033 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:03 smithi113 bash[21785]: debug 2024-04-19T22:35:03.920+0000 7fe37e69e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:35:04.286 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21785]: debug 2024-04-19T22:35:04.040+0000 7fe37e69e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsid": "dd3df874-fe9c-11ee-bc92-c7b262605968", 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "health": { 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-19T22:35:04.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 0 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "a" 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-19T22:35:04.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-19T22:35:04.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:04.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-19T22:35:04.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-19T22:35:04.304 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-19T22:35:04.305 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "restful" 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modified": "2024-04-19T22:34:47.153358+0000", 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:04.306 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 Processor -- start 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 -- start start 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40796c0 con 0x7f92a4104ad0 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35060/0 (socket says 172.21.15.113:35060) 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a2ffd700 1 -- 172.21.15.113:0/569006665 learned_addr learned my addr 172.21.15.113:0/569006665 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a2ffd700 1 -- 172.21.15.113:0/569006665 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a4105430 con 0x7f92a4104ad0 2024-04-19T22:35:04.307 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a2ffd700 1 --2- 172.21.15.113:0/569006665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92940098a0 tx=0x7f9294009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36546746e53fea8d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a1ffb700 1 -- 172.21.15.113:0/569006665 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294004160 con 0x7f92a4104ad0 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a1ffb700 1 -- 172.21.15.113:0/569006665 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f9294004300 con 0x7f92a4104ad0 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a1ffb700 1 -- 172.21.15.113:0/569006665 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294011a60 con 0x7f92a4104ad0 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 -- 172.21.15.113:0/569006665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 msgr2=0x7f92a4104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 --2- 172.21.15.113:0/569006665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92940098a0 tx=0x7f9294009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 -- 172.21.15.113:0/569006665 shutdown_connections 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 --2- 172.21.15.113:0/569006665 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a4104ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.604+0000 7f92a94a1700 1 -- 172.21.15.113:0/569006665 >> 172.21.15.113:0/569006665 conn(0x7f92a41006d0 msgr2=0x7f92a4102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- 172.21.15.113:0/569006665 shutdown_connections 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- 172.21.15.113:0/569006665 wait complete. 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 Processor -- start 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- start start 2024-04-19T22:35:04.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4106460 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35070/0 (socket says 172.21.15.113:35070) 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a2ffd700 1 -- 172.21.15.113:0/2419758371 learned_addr learned my addr 172.21.15.113:0/2419758371 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a2ffd700 1 -- 172.21.15.113:0/2419758371 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a419c840 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a2ffd700 1 --2- 172.21.15.113:0/2419758371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9294011700 tx=0x7f9294011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294003aa0 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f929401a8c0 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a419cad0 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92940248a0 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9294022020 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a419f7c0 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f929401aa70 con 0x7f92a4104ad0 2024-04-19T22:35:04.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.608+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a4063890 con 0x7f92a4104ad0 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.612+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9294033080 con 0x7f92a4104ad0 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f92a402dbd0 con 0x7f92a4104ad0 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f928bfff700 1 -- 172.21.15.113:0/2419758371 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f929401a430 con 0x7f92a4104ad0 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 msgr2=0x7f92a419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 --2- 172.21.15.113:0/2419758371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9294011700 tx=0x7f9294011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 shutdown_connections 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 --2- 172.21.15.113:0/2419758371 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a4104ad0 0x7f92a419c300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 >> 172.21.15.113:0/2419758371 conn(0x7f92a41006d0 msgr2=0x7f92a4192ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 shutdown_connections 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:03.744+0000 7f92a94a1700 1 -- 172.21.15.113:0/2419758371 wait complete. 2024-04-19T22:35:04.310 INFO:teuthology.orchestra.run.smithi113.stdout:mgr not available, waiting (3/15)... 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: cluster 2024-04-19T22:35:04.047570+0000 mon.a (mon.0) 16 : cluster 1 Activating manager daemon y 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: cluster 2024-04-19T22:35:04.055083+0000 mon.a (mon.0) 17 : cluster 0 mgrmap e2: y(active, starting, since 0.00775756s) 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.057138+0000 mon.a (mon.0) 18 : audit 0 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.057458+0000 mon.a (mon.0) 19 : audit 0 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.057776+0000 mon.a (mon.0) 20 : audit 0 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.058074+0000 mon.a (mon.0) 21 : audit 0 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.058601+0000 mon.a (mon.0) 22 : audit 0 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: cluster 2024-04-19T22:35:04.084461+0000 mon.a (mon.0) 23 : cluster 1 Manager daemon y is now available 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.095887+0000 mon.a (mon.0) 24 : audit 1 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:35:05.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.098826+0000 mon.a (mon.0) 25 : audit 1 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:35:05.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.103104+0000 mon.a (mon.0) 26 : audit 1 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' 2024-04-19T22:35:05.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.106241+0000 mon.a (mon.0) 27 : audit 1 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' 2024-04-19T22:35:05.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:04 smithi113 bash[21528]: audit 2024-04-19T22:35:04.109395+0000 mon.a (mon.0) 28 : audit 1 from='mgr.14100 172.21.15.113:0/1192839472' entity='mgr.y' 2024-04-19T22:35:06.325 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:06 smithi113 bash[21528]: cluster 2024-04-19T22:35:05.063009+0000 mon.a (mon.0) 29 : cluster 0 mgrmap e3: y(active, since 1.01568s) 2024-04-19T22:35:08.308 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsid": "dd3df874-fe9c-11ee-bc92-c7b262605968", 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "health": { 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 0 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:08.309 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "a" 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-19T22:35:08.310 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-19T22:35:08.311 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "restful" 2024-04-19T22:35:08.312 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ], 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "modified": "2024-04-19T22:34:47.153358+0000", 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout }, 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-19T22:35:08.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.216+0000 7f13eb3c0700 1 Processor -- start 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.216+0000 7f13eb3c0700 1 -- start start 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.216+0000 7f13eb3c0700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.216+0000 7f13eb3c0700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4079f30 con 0x7f13e4104b30 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35140/0 (socket says 172.21.15.113:35140) 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 -- 172.21.15.113:0/4251732989 learned_addr learned my addr 172.21.15.113:0/4251732989 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 -- 172.21.15.113:0/4251732989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e4105490 con 0x7f13e4104b30 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- 172.21.15.113:0/4251732989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098a0 tx=0x7f13e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641fac0ba6334cc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d7fff700 1 -- 172.21.15.113:0/4251732989 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e0004160 con 0x7f13e4104b30 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d7fff700 1 -- 172.21.15.113:0/4251732989 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f13e0004300 con 0x7f13e4104b30 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d7fff700 1 -- 172.21.15.113:0/4251732989 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e0011a60 con 0x7f13e4104b30 2024-04-19T22:35:08.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/4251732989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 msgr2=0x7f13e4104f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/4251732989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098a0 tx=0x7f13e0009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/4251732989 shutdown_connections 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/4251732989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e4104f50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/4251732989 >> 172.21.15.113:0/4251732989 conn(0x7f13e41006f0 msgr2=0x7f13e4102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/4251732989 shutdown_connections 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/4251732989 wait complete. 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 Processor -- start 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- start start 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41064c0 con 0x7f13e4104b30 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35148/0 (socket says 172.21.15.113:35148) 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 -- 172.21.15.113:0/1565382702 learned_addr learned my addr 172.21.15.113:0/1565382702 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:08.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 -- 172.21.15.113:0/1565382702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e419c850 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13e915c700 1 --2- 172.21.15.113:0/1565382702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009870 tx=0x7f13e0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e0003af0 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f13e001a8c0 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e0019960 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e419cae0 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.220+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e419f7d0 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) ==== 46241+0+0 (secure 0 0 0) 0x7f13e0022020 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e4063890 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13d67fc700 1 --2- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 0x7f13d003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13e004d060 con 0x7f13e4104b30 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13e895b700 1 --2- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 0x7f13d003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.224+0000 7f13e895b700 1 --2- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 0x7f13d003b480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13d8006fd0 tx=0x7f13d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:08.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.228+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f13e002cdf0 con 0x7f13e4104b30 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.740+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f13e402dbd0 con 0x7f13e4104b30 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.740+0000 7f13d67fc700 1 -- 172.21.15.113:0/1565382702 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f13e004cdc0 con 0x7f13e4104b30 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 msgr2=0x7f13d003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 0x7f13d003b480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13d8006fd0 tx=0x7f13d8006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 msgr2=0x7f13e419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/1565382702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009870 tx=0x7f13e0011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 shutdown_connections 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/1565382702 >> v2:172.21.15.113:6800/2885784740 conn(0x7f13d0038fc0 0x7f13d003b480 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 --2- 172.21.15.113:0/1565382702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13e4104b30 0x7f13e419c310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 >> 172.21.15.113:0/1565382702 conn(0x7f13e41006f0 msgr2=0x7f13e4192f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 shutdown_connections 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:07.744+0000 7f13eb3c0700 1 -- 172.21.15.113:0/1565382702 wait complete. 2024-04-19T22:35:08.317 INFO:teuthology.orchestra.run.smithi113.stdout:mgr is available 2024-04-19T22:35:08.330 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:08 smithi113 bash[21528]: cluster 2024-04-19T22:35:07.057674+0000 mon.a (mon.0) 30 : cluster 0 mgrmap e4: y(active, since 3s) 2024-04-19T22:35:08.330 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:08 smithi113 bash[21528]: audit 2024-04-19T22:35:07.744140+0000 mon.a (mon.0) 31 : audit 0 from='client.? 172.21.15.113:0/1565382702' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-19T22:35:10.037 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:09 smithi113 bash[21528]: audit 2024-04-19T22:35:09.592691+0000 mon.a (mon.0) 32 : audit 1 from='client.? 172.21.15.113:0/946299' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [global] 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout fsid = dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-19T22:35:10.252 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout [osd] 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.216+0000 7fc395b3b700 1 Processor -- start 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.216+0000 7fc395b3b700 1 -- start start 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010fa10 con 0x7fc39010d050 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56278/0 (socket says 172.21.15.113:56278) 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 -- 172.21.15.113:0/534035415 learned_addr learned my addr 172.21.15.113:0/534035415 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 -- 172.21.15.113:0/534035415 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39010fb90 con 0x7fc39010d050 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- 172.21.15.113:0/534035415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3840098a0 tx=0x7fc384009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156ef6407a1687c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38e7fc700 1 -- 172.21.15.113:0/534035415 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc384004160 con 0x7fc39010d050 2024-04-19T22:35:10.253 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38e7fc700 1 -- 172.21.15.113:0/534035415 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fc384004300 con 0x7fc39010d050 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38e7fc700 1 -- 172.21.15.113:0/534035415 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc384011a60 con 0x7fc39010d050 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/534035415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 msgr2=0x7fc39010f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 --2- 172.21.15.113:0/534035415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3840098a0 tx=0x7fc384009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/534035415 shutdown_connections 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 --2- 172.21.15.113:0/534035415 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc39010f440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/534035415 >> 172.21.15.113:0/534035415 conn(0x7fc39007b7d0 msgr2=0x7fc39007dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/534035415 shutdown_connections 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/534035415 wait complete. 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 Processor -- start 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- start start 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc390110bb0 con 0x7fc39010d050 2024-04-19T22:35:10.254 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56282/0 (socket says 172.21.15.113:56282) 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 -- 172.21.15.113:0/946299 learned_addr learned my addr 172.21.15.113:0/946299 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 -- 172.21.15.113:0/946299 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3901a0c50 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38f7fe700 1 --2- 172.21.15.113:0/946299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc384011700 tx=0x7fc384011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc384003aa0 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fc38401a8c0 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/946299 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3901a0ee0 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3840248a0 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.220+0000 7fc395b3b700 1 -- 172.21.15.113:0/946299 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901a3bd0 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) ==== 46241+0+0 (secure 0 0 0) 0x7fc384022020 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc38cff9700 1 --2- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 0x7fc37803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc38404d490 con 0x7fc39010d050 2024-04-19T22:35:10.255 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc38effd700 1 --2- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 0x7fc37803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370005120 con 0x7fc39010d050 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.224+0000 7fc38effd700 1 --2- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 0x7fc37803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc380006fd0 tx=0x7fc380006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.228+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc38402de20 con 0x7fc39010d050 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.588+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc370002400 con 0x7fc39010d050 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.588+0000 7fc38cff9700 1 -- 172.21.15.113:0/946299 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+282 (secure 0 0 0) 0x7fc38401aa70 con 0x7fc39010d050 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 msgr2=0x7fc37803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 --2- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 0x7fc37803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc380006fd0 tx=0x7fc380006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 msgr2=0x7fc3901a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 --2- 172.21.15.113:0/946299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc384011700 tx=0x7fc384011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 shutdown_connections 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 --2- 172.21.15.113:0/946299 >> v2:172.21.15.113:6800/2885784740 conn(0x7fc378038fc0 0x7fc37803b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:10.256 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 --2- 172.21.15.113:0/946299 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc39010d050 0x7fc3901a0710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:10.257 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 >> 172.21.15.113:0/946299 conn(0x7fc39007b7d0 msgr2=0x7fc39007c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:10.257 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 shutdown_connections 2024-04-19T22:35:10.257 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:09.592+0000 7fc3767fc700 1 -- 172.21.15.113:0/946299 wait complete. 2024-04-19T22:35:10.257 INFO:teuthology.orchestra.run.smithi113.stdout:Enabling cephadm module... 2024-04-19T22:35:12.037 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:11 smithi113 bash[21528]: audit 2024-04-19T22:35:11.608188+0000 mon.a (mon.0) 33 : audit 1 from='client.? 172.21.15.113:0/731851108' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-19T22:35:12.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:11 smithi113 bash[21785]: ignoring --setuser ceph since I am not root 2024-04-19T22:35:12.038 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:11 smithi113 bash[21785]: ignoring --setgroup ceph since I am not root 2024-04-19T22:35:12.038 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:11 smithi113 bash[21785]: debug 2024-04-19T22:35:11.848+0000 7f5edcbea200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:35:12.313 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15ede45700 1 Processor -- start 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15ede45700 1 -- start start 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15ede45700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15ede45700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8108e10 con 0x7f15e8108420 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56288/0 (socket says 172.21.15.113:56288) 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.128+0000 7f15e77fe700 1 -- 172.21.15.113:0/2494542717 learned_addr learned my addr 172.21.15.113:0/2494542717 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 -- 172.21.15.113:0/2494542717 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e8109620 con 0x7f15e8108420 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 --2- 172.21.15.113:0/2494542717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0098a0 tx=0x7f15dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeb9bdea2e19d89 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e67fc700 1 -- 172.21.15.113:0/2494542717 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15dc004160 con 0x7f15e8108420 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e67fc700 1 -- 172.21.15.113:0/2494542717 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f15dc004300 con 0x7f15e8108420 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e67fc700 1 -- 172.21.15.113:0/2494542717 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15dc011a60 con 0x7f15e8108420 2024-04-19T22:35:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/2494542717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 msgr2=0x7f15e8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 --2- 172.21.15.113:0/2494542717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0098a0 tx=0x7f15dc009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/2494542717 shutdown_connections 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 --2- 172.21.15.113:0/2494542717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e8108840 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/2494542717 >> 172.21.15.113:0/2494542717 conn(0x7f15e807b7d0 msgr2=0x7f15e807bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/2494542717 shutdown_connections 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/2494542717 wait complete. 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 Processor -- start 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- start start 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f15e810c9d0 con 0x7f15e8108420 2024-04-19T22:35:12.315 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56290/0 (socket says 172.21.15.113:56290) 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 -- 172.21.15.113:0/731851108 learned_addr learned my addr 172.21.15.113:0/731851108 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 -- 172.21.15.113:0/731851108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e819c8d0 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e77fe700 1 --2- 172.21.15.113:0/731851108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009fb0 tx=0x7f15dc011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15dc0039e0 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f15dc01a8c0 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15dc024800 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e819cb60 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.132+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e819f850 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) ==== 46241+0+0 (secure 0 0 0) 0x7f15dc022020 con 0x7f15e8108420 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15e4ff9700 1 --2- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 0x7f15d003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:12.316 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e8063890 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f15dc04cfe0 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15e6ffd700 1 --2- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 0x7f15d003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.136+0000 7f15e6ffd700 1 --2- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 0x7f15d003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15d8006fd0 tx=0x7f15d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.140+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f15dc016260 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.604+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f15e819fc30 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.656+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f15dc00be50 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15e4ff9700 1 -- 172.21.15.113:0/731851108 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mgrmap(e 5) ==== 46252+0+0 (secure 0 0 0) 0x7f15dc011d10 con 0x7f15e8108420 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 msgr2=0x7f15d003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 --2- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 0x7f15d003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15d8006fd0 tx=0x7f15d8006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 msgr2=0x7f15e819c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 --2- 172.21.15.113:0/731851108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009fb0 tx=0x7f15dc011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:12.317 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 shutdown_connections 2024-04-19T22:35:12.318 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 --2- 172.21.15.113:0/731851108 >> v2:172.21.15.113:6800/2885784740 conn(0x7f15d0039000 0x7f15d003b4c0 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15d8006fd0 tx=0x7f15d8006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:12.318 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 --2- 172.21.15.113:0/731851108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15e8108420 0x7f15e819c390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:12.318 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 >> 172.21.15.113:0/731851108 conn(0x7f15e807b7d0 msgr2=0x7f15e81056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:12.318 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 shutdown_connections 2024-04-19T22:35:12.318 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:11.660+0000 7f15ede45700 1 -- 172.21.15.113:0/731851108 wait complete. 2024-04-19T22:35:12.962 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:12 smithi113 bash[21528]: audit 2024-04-19T22:35:11.660010+0000 mon.a (mon.0) 34 : audit 1 from='client.? 172.21.15.113:0/731851108' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-19T22:35:12.962 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:12 smithi113 bash[21528]: cluster 2024-04-19T22:35:11.664270+0000 mon.a (mon.0) 35 : cluster 0 mgrmap e5: y(active, since 7s) 2024-04-19T22:35:13.771 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:13 smithi113 bash[21528]: audit 2024-04-19T22:35:13.631687+0000 mon.a (mon.0) 36 : audit 0 from='client.? 172.21.15.113:0/1670761157' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-19T22:35:13.771 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:13 smithi113 bash[21785]: debug 2024-04-19T22:35:13.428+0000 7f5edcbea200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:35:13.771 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:13 smithi113 bash[21785]: debug 2024-04-19T22:35:13.524+0000 7f5edcbea200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:35:14.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:13 smithi113 bash[21785]: debug 2024-04-19T22:35:13.776+0000 7f5edcbea200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 Processor -- start 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- start start 2024-04-19T22:35:14.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0079700 con 0x7f6cd0106ca0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56314/0 (socket says 172.21.15.113:56314) 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 -- 172.21.15.113:0/3354471595 learned_addr learned my addr 172.21.15.113:0/3354471595 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 -- 172.21.15.113:0/3354471595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01095d0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 --2- 172.21.15.113:0/3354471595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00098a0 tx=0x7f6cc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5dddfffbbefa68 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6ccd59a700 1 -- 172.21.15.113:0/3354471595 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cc0004160 con 0x7f6cd0106ca0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6ccd59a700 1 -- 172.21.15.113:0/3354471595 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f6cc0004300 con 0x7f6cd0106ca0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6ccd59a700 1 -- 172.21.15.113:0/3354471595 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cc0011a60 con 0x7f6cd0106ca0 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/3354471595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 msgr2=0x7f6cd0109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:14.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/3354471595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00098a0 tx=0x7f6cc0009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/3354471595 shutdown_connections 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/3354471595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0109090 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/3354471595 >> 172.21.15.113:0/3354471595 conn(0x7f6cd01006d0 msgr2=0x7f6cd0102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/3354471595 shutdown_connections 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/3354471595 wait complete. 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 Processor -- start 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- start start 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cd4ce4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010a590 con 0x7f6cd0106ca0 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56328/0 (socket says 172.21.15.113:56328) 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 -- 172.21.15.113:0/1670761157 learned_addr learned my addr 172.21.15.113:0/1670761157 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:14.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.144+0000 7f6cce59c700 1 -- 172.21.15.113:0/1670761157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0106a60 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cce59c700 1 --2- 172.21.15.113:0/1670761157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cc0003af0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd0104c50 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f6cc001a8c0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd0105190 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cc0019960 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 46252+0+0 (secure 0 0 0) 0x7f6cc0022020 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd0063890 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 --2- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 0x7f6cb803b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6cc004d1f0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6ccdd9b700 1 -- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 msgr2=0x7f6cb803b4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.148+0000 7f6ccdd9b700 1 --2- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 0x7f6cb803b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.156+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6cc004cf50 con 0x7f6cd0106ca0 2024-04-19T22:35:14.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.352+0000 7f6ccdd9b700 1 -- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 msgr2=0x7f6cb803b4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.352+0000 7f6ccdd9b700 1 --2- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 0x7f6cb803b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.628+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6cd01057d0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.628+0000 7f6cbf7fe700 1 -- 172.21.15.113:0/1670761157 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f6cc0019bb0 con 0x7f6cd0106ca0 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.628+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 msgr2=0x7f6cb803b4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.628+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 0x7f6cb803b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 msgr2=0x7f6cd0106520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/1670761157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc0011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 shutdown_connections 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/1670761157 >> v2:172.21.15.113:6800/2885784740 conn(0x7f6cb8039010 0x7f6cb803b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 --2- 172.21.15.113:0/1670761157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cd0106ca0 0x7f6cd0106520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 >> 172.21.15.113:0/1670761157 conn(0x7f6cd01006d0 msgr2=0x7f6cd0101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 shutdown_connections 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:13.632+0000 7f6cd4ce4700 1 -- 172.21.15.113:0/1670761157 wait complete. 2024-04-19T22:35:14.209 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for the mgr to restart... 2024-04-19T22:35:14.210 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mgr epoch 5... 2024-04-19T22:35:14.854 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:14 smithi113 bash[21785]: debug 2024-04-19T22:35:14.580+0000 7f5edcbea200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:35:14.855 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:14 smithi113 bash[21785]: debug 2024-04-19T22:35:14.692+0000 7f5edcbea200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:35:14.855 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:14 smithi113 bash[21785]: debug 2024-04-19T22:35:14.796+0000 7f5edcbea200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:35:15.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:15 smithi113 bash[21785]: debug 2024-04-19T22:35:15.156+0000 7f5edcbea200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:35:15.538 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:15 smithi113 bash[21785]: debug 2024-04-19T22:35:15.268+0000 7f5edcbea200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:35:15.538 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:15 smithi113 bash[21785]: debug 2024-04-19T22:35:15.372+0000 7f5edcbea200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:35:16.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:15 smithi113 bash[21785]: debug 2024-04-19T22:35:15.728+0000 7f5edcbea200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:35:16.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:15 smithi113 bash[21785]: debug 2024-04-19T22:35:15.964+0000 7f5edcbea200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:35:16.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:16 smithi113 bash[21785]: debug 2024-04-19T22:35:16.228+0000 7f5edcbea200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:35:16.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:16 smithi113 bash[21785]: debug 2024-04-19T22:35:16.340+0000 7f5edcbea200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:35:17.017 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:16 smithi113 bash[21785]: debug 2024-04-19T22:35:16.616+0000 7f5edcbea200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:35:17.287 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:17 smithi113 bash[21785]: debug 2024-04-19T22:35:17.024+0000 7f5edcbea200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:17.288 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:17 smithi113 bash[21785]: debug 2024-04-19T22:35:17.260+0000 7f5edcbea200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:35:17.787 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:17 smithi113 bash[21785]: debug 2024-04-19T22:35:17.380+0000 7f5edcbea200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:35:17.788 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:17 smithi113 bash[21785]: debug 2024-04-19T22:35:17.624+0000 7f5edcbea200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:19.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:18 smithi113 bash[21785]: debug 2024-04-19T22:35:18.652+0000 7f5edcbea200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:35:19.038 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:18 smithi113 bash[21785]: debug 2024-04-19T22:35:18.767+0000 7f5edcbea200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:35:19.537 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21785]: debug 2024-04-19T22:35:19.059+0000 7f5edcbea200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:35:19.538 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21785]: debug 2024-04-19T22:35:19.171+0000 7f5edcbea200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:35:20.037 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21785]: debug 2024-04-19T22:35:19.623+0000 7f5edcbea200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21785]: debug 2024-04-19T22:35:19.747+0000 7f5edcbea200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: cluster 2024-04-19T22:35:19.772410+0000 mon.a (mon.0) 37 : cluster 1 Active manager daemon y restarted 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: cluster 2024-04-19T22:35:19.772859+0000 mon.a (mon.0) 38 : cluster 1 Activating manager daemon y 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: cluster 2024-04-19T22:35:19.776980+0000 mon.a (mon.0) 39 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: cluster 2024-04-19T22:35:19.777155+0000 mon.a (mon.0) 40 : cluster 0 mgrmap e6: y(active, starting, since 0.00448324s) 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: audit 2024-04-19T22:35:19.779836+0000 mon.a (mon.0) 41 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: audit 2024-04-19T22:35:19.781609+0000 mon.a (mon.0) 42 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: audit 2024-04-19T22:35:19.782684+0000 mon.a (mon.0) 43 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: audit 2024-04-19T22:35:19.782790+0000 mon.a (mon.0) 44 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:35:20.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: audit 2024-04-19T22:35:19.782935+0000 mon.a (mon.0) 45 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:35:20.039 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:19 smithi113 bash[21528]: cluster 2024-04-19T22:35:19.812583+0000 mon.a (mon.0) 46 : cluster 1 Manager daemon y is now available 2024-04-19T22:35:21.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: cephadm 2024-04-19T22:35:19.831184+0000 mgr.y (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.833865+0000 mon.a (mon.0) 47 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.837113+0000 mon.a (mon.0) 48 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.842079+0000 mon.a (mon.0) 49 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.846314+0000 mon.a (mon.0) 50 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.855299+0000 mon.a (mon.0) 51 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:19.858728+0000 mon.a (mon.0) 52 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:20.340295+0000 mon.a (mon.0) 53 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: audit 2024-04-19T22:35:20.345744+0000 mon.a (mon.0) 54 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:21.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:20 smithi113 bash[21528]: cluster 2024-04-19T22:35:20.784127+0000 mon.a (mon.0) 55 : cluster 0 mgrmap e7: y(active, since 1.01145s) 2024-04-19T22:35:21.455 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:21.455 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-19T22:35:21.455 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 Processor -- start 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- start start 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280796c0 con 0x7f7e28104ac0 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e26d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e26d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56336/0 (socket says 172.21.15.113:56336) 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e26d9d700 1 -- 172.21.15.113:0/4042392183 learned_addr learned my addr 172.21.15.113:0/4042392183 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e26d9d700 1 -- 172.21.15.113:0/4042392183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e28105420 con 0x7f7e28104ac0 2024-04-19T22:35:21.456 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e26d9d700 1 --2- 172.21.15.113:0/4042392183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0098a0 tx=0x7f7e1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bbab76b300fedf server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e25d9b700 1 -- 172.21.15.113:0/4042392183 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1c004160 con 0x7f7e28104ac0 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e25d9b700 1 -- 172.21.15.113:0/4042392183 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f7e1c004300 con 0x7f7e28104ac0 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e25d9b700 1 -- 172.21.15.113:0/4042392183 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1c011a60 con 0x7f7e28104ac0 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/4042392183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 msgr2=0x7f7e28104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/4042392183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0098a0 tx=0x7f7e1c009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/4042392183 shutdown_connections 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/4042392183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e28104ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/4042392183 >> 172.21.15.113:0/4042392183 conn(0x7f7e281006a0 msgr2=0x7f7e28102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/4042392183 shutdown_connections 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/4042392183 wait complete. 2024-04-19T22:35:21.457 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 Processor -- start 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.052+0000 7f7e2d1f5700 1 -- start start 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2d1f5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2d1f5700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28106450 con 0x7f7e28104ac0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e26d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e26d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:56348/0 (socket says 172.21.15.113:56348) 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e26d9d700 1 -- 172.21.15.113:0/3832643196 learned_addr learned my addr 172.21.15.113:0/3832643196 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e26d9d700 1 -- 172.21.15.113:0/3832643196 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2819c830 con 0x7f7e28104ac0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e26d9d700 1 --2- 172.21.15.113:0/3832643196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1c003af0 con 0x7f7e28104ac0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f7e1c01a8c0 con 0x7f7e28104ac0 2024-04-19T22:35:21.458 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2819cac0 con 0x7f7e28104ac0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1c019960 con 0x7f7e28104ac0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2819f7b0 con 0x7f7e28104ac0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 46252+0+0 (secure 0 0 0) 0x7f7e1c022020 con 0x7f7e28104ac0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e1c04e7d0 con 0x7f7e28104ac0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2659c700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.056+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 --> v2:172.21.15.113:6800/2885784740 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7e28063890 con 0x7f7e10038fc0 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.260+0000 7f7e2659c700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.260+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.664+0000 7f7e2659c700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:21.459 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:15.664+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:16.468+0000 7f7e2659c700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:16.468+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:18.072+0000 7f7e2659c700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2885784740 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:18.072+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:19.771+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f7e1c00b430 con 0x7f7e28104ac0 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:19.771+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 msgr2=0x7f7e1003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:19.771+0000 7f7e0ffff700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.775+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mgrmap(e 7) ==== 46146+0+0 (secure 0 0 0) 0x7f7e1c0375e0 con 0x7f7e28104ac0 2024-04-19T22:35:21.460 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.775+0000 7f7e0ffff700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 0x7f7e1003eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.775+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 --> v2:172.21.15.113:6800/2227053540 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7e1c04fe50 con 0x7f7e1003c710 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.775+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 0x7f7e1003eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.779+0000 7f7e2659c700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 0x7f7e1003eb00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e18003a10 tx=0x7f7e18009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.779+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f7e1c04fe50 con 0x7f7e1003c710 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 --> v2:172.21.15.113:6800/2227053540 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7e28062670 con 0x7f7e1003c710 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e0ffff700 1 -- 172.21.15.113:0/3832643196 <== mgr.14120 v2:172.21.15.113:6800/2227053540 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f7e28062670 con 0x7f7e1003c710 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 msgr2=0x7f7e1003eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 0x7f7e1003eb00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e18003a10 tx=0x7f7e18009290 comp rx=0 tx=0).stop 2024-04-19T22:35:21.461 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 msgr2=0x7f7e2819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/3832643196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 shutdown_connections 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2227053540 conn(0x7f7e1003c710 0x7f7e1003eb00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/3832643196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e28104ac0 0x7f7e2819c2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 --2- 172.21.15.113:0/3832643196 >> v2:172.21.15.113:6800/2885784740 conn(0x7f7e10038fc0 0x7f7e1003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 >> 172.21.15.113:0/3832643196 conn(0x7f7e281006a0 msgr2=0x7f7e28192ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 shutdown_connections 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:20.791+0000 7f7e2d1f5700 1 -- 172.21.15.113:0/3832643196 wait complete. 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:mgr epoch 5 is available 2024-04-19T22:35:21.462 INFO:teuthology.orchestra.run.smithi113.stdout:Setting orchestrator backend to cephadm... 2024-04-19T22:35:22.103 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: audit 2024-04-19T22:35:20.783630+0000 mgr.y (mgr.14120) 2 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: audit 2024-04-19T22:35:20.795915+0000 mgr.y (mgr.14120) 3 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: cephadm 2024-04-19T22:35:20.819098+0000 mgr.y (mgr.14120) 4 : cephadm 1 [19/Apr/2024:22:35:20] ENGINE Bus STARTING 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: cephadm 2024-04-19T22:35:20.934339+0000 mgr.y (mgr.14120) 5 : cephadm 1 [19/Apr/2024:22:35:20] ENGINE Serving on https://172.21.15.113:7150 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: cephadm 2024-04-19T22:35:21.035610+0000 mgr.y (mgr.14120) 6 : cephadm 1 [19/Apr/2024:22:35:21] ENGINE Serving on http://172.21.15.113:8765 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: cephadm 2024-04-19T22:35:21.035764+0000 mgr.y (mgr.14120) 7 : cephadm 1 [19/Apr/2024:22:35:21] ENGINE Bus STARTED 2024-04-19T22:35:22.104 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:21 smithi113 bash[21528]: audit 2024-04-19T22:35:21.066592+0000 mon.a (mon.0) 56 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:23.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:22 smithi113 bash[21528]: cluster 2024-04-19T22:35:21.851516+0000 mon.a (mon.0) 57 : cluster 0 mgrmap e8: y(active, since 2s) 2024-04-19T22:35:23.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:22 smithi113 bash[21528]: audit 2024-04-19T22:35:22.741235+0000 mon.a (mon.0) 58 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:23.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:22 smithi113 bash[21528]: audit 2024-04-19T22:35:22.788336+0000 mon.a (mon.0) 59 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.311+0000 7f65d3397700 1 Processor -- start 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.311+0000 7f65d3397700 1 -- start start 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc105b00 con 0x7f65cc105110 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34928/0 (socket says 172.21.15.113:34928) 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 -- 172.21.15.113:0/2870389574 learned_addr learned my addr 172.21.15.113:0/2870389574 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 -- 172.21.15.113:0/2870389574 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc106310 con 0x7f65cc105110 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- 172.21.15.113:0/2870389574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009e80 tx=0x7f65bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c04c02d27b84b0d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:23.374 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65cbfff700 1 -- 172.21.15.113:0/2870389574 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc017070 con 0x7f65cc105110 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65cbfff700 1 -- 172.21.15.113:0/2870389574 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f65bc00b8c0 con 0x7f65cc105110 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65cbfff700 1 -- 172.21.15.113:0/2870389574 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc004470 con 0x7f65cc105110 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/2870389574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 msgr2=0x7f65cc105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 --2- 172.21.15.113:0/2870389574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009e80 tx=0x7f65bc00b330 comp rx=0 tx=0).stop 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/2870389574 shutdown_connections 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 --2- 172.21.15.113:0/2870389574 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc105530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/2870389574 >> 172.21.15.113:0/2870389574 conn(0x7f65cc100690 msgr2=0x7f65cc102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/2870389574 shutdown_connections 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/2870389574 wait complete. 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 Processor -- start 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- start start 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1096c0 con 0x7f65cc105110 2024-04-19T22:35:23.375 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34936/0 (socket says 172.21.15.113:34936) 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 -- 172.21.15.113:0/1948417520 learned_addr learned my addr 172.21.15.113:0/1948417520 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 -- 172.21.15.113:0/1948417520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc19c940 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d1133700 1 --2- 172.21.15.113:0/1948417520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009fd0 tx=0x7f65bc00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc021020 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f65bc003d00 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc19cbd0 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65bc017040 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.315+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc19f8c0 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f65bc024020 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b8005120 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65ca7fc700 1 --2- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 0x7f65b403b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f65bc00f050 con 0x7f65cc105110 2024-04-19T22:35:23.376 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65d0932700 1 --2- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 0x7f65b403b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.319+0000 7f65d0932700 1 --2- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 0x7f65b403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006fd0 tx=0x7f65c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.323+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f65bc02b020 con 0x7f65cc105110 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.727+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f65b8000bc0 con 0x7f65b4039000 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.735+0000 7f65ca7fc700 1 -- 172.21.15.113:0/1948417520 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65b8000bc0 con 0x7f65b4039000 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 msgr2=0x7f65b403b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 --2- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 0x7f65b403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006fd0 tx=0x7f65c0006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 msgr2=0x7f65cc19c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 --2- 172.21.15.113:0/1948417520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009fd0 tx=0x7f65bc00be90 comp rx=0 tx=0).stop 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 shutdown_connections 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 --2- 172.21.15.113:0/1948417520 >> v2:172.21.15.113:6800/2227053540 conn(0x7f65b4039000 0x7f65b403b4c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 --2- 172.21.15.113:0/1948417520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f65cc105110 0x7f65cc19c400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 >> 172.21.15.113:0/1948417520 conn(0x7f65cc100690 msgr2=0x7f65cc1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 shutdown_connections 2024-04-19T22:35:23.377 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:22.739+0000 7f65d3397700 1 -- 172.21.15.113:0/1948417520 wait complete. 2024-04-19T22:35:24.288 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:23 smithi113 bash[21528]: audit 2024-04-19T22:35:22.733398+0000 mgr.y (mgr.14120) 8 : audit 0 from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956fbe6700 1 Processor -- start 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956fbe6700 1 -- start start 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956fbe6700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956fbe6700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f956810fa10 con 0x7f956810d050 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956d982700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956d982700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34946/0 (socket says 172.21.15.113:34946) 2024-04-19T22:35:25.132 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956d982700 1 -- 172.21.15.113:0/4089644630 learned_addr learned my addr 172.21.15.113:0/4089644630 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956d982700 1 -- 172.21.15.113:0/4089644630 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956810fb90 con 0x7f956810d050 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956d982700 1 --2- 172.21.15.113:0/4089644630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95580098a0 tx=0x7f9558009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e221816085689b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956c980700 1 -- 172.21.15.113:0/4089644630 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9558004160 con 0x7f956810d050 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956c980700 1 -- 172.21.15.113:0/4089644630 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f9558004300 con 0x7f956810d050 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.183+0000 7f956c980700 1 -- 172.21.15.113:0/4089644630 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9558011a60 con 0x7f956810d050 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/4089644630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 msgr2=0x7f956810f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 --2- 172.21.15.113:0/4089644630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95580098a0 tx=0x7f9558009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/4089644630 shutdown_connections 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 --2- 172.21.15.113:0/4089644630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f956810f440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/4089644630 >> 172.21.15.113:0/4089644630 conn(0x7f956807b820 msgr2=0x7f956807dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:25.133 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/4089644630 shutdown_connections 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/4089644630 wait complete. 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 Processor -- start 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- start start 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9568110bc0 con 0x7f956810d050 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d982700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d982700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34954/0 (socket says 172.21.15.113:34954) 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d982700 1 -- 172.21.15.113:0/2153236569 learned_addr learned my addr 172.21.15.113:0/2153236569 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d982700 1 -- 172.21.15.113:0/2153236569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95681a0c50 con 0x7f956810d050 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d982700 1 --2- 172.21.15.113:0/2153236569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9558011700 tx=0x7f9558011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9558003aa0 con 0x7f956810d050 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f955801a8c0 con 0x7f956810d050 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95681a0ee0 con 0x7f956810d050 2024-04-19T22:35:25.134 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95580248a0 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95681a3bd0 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f9558022020 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9568063890 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 --2- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 0x7f955003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f955804d0b0 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d181700 1 --2- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 0x7f955003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.187+0000 7f956d181700 1 --2- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 0x7f955003b520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f955c006fd0 tx=0x7f955c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.195+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f95580212c0 con 0x7f956810d050 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.559+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f956807c9f0 con 0x7f9550039060 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.559+0000 7f9566ffd700 1 -- 172.21.15.113:0/2153236569 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f956807c9f0 con 0x7f9550039060 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 msgr2=0x7f955003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 --2- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 0x7f955003b520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f955c006fd0 tx=0x7f955c006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 msgr2=0x7f95681a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 --2- 172.21.15.113:0/2153236569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9558011700 tx=0x7f9558011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 shutdown_connections 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 --2- 172.21.15.113:0/2153236569 >> v2:172.21.15.113:6800/2227053540 conn(0x7f9550039060 0x7f955003b520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 --2- 172.21.15.113:0/2153236569 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f956810d050 0x7f95681a0710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 >> 172.21.15.113:0/2153236569 conn(0x7f956807b820 msgr2=0x7f956807c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 shutdown_connections 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:24.563+0000 7f956fbe6700 1 -- 172.21.15.113:0/2153236569 wait complete. 2024-04-19T22:35:25.136 INFO:teuthology.orchestra.run.smithi113.stdout:Generating ssh key... 2024-04-19T22:35:25.150 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:24 smithi113 bash[21528]: audit 2024-04-19T22:35:24.565780+0000 mgr.y (mgr.14120) 9 : audit 0 from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: Generating public/private rsa key pair. 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: Your identification has been saved in /tmp/tmp0z664bdz/key. 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: Your public key has been saved in /tmp/tmp0z664bdz/key.pub. 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: The key fingerprint is: 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: SHA256:s5fsKqpNmTBY3fA7x8NKmb9LSHgPYKCoxkNHp8GR09I ceph-dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: The key's randomart image is: 2024-04-19T22:35:26.554 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: +---[RSA 3072]----+ 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: | o+*. | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: |...B+E | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: |o..o* o | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: |+o.. o * | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: |o+o . X S | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: |. .o * O = . | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: | + o = + | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: | o .. + | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: | ..o. .+o. | 2024-04-19T22:35:26.555 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:26 smithi113 bash[21785]: +----[SHA256]-----+ 2024-04-19T22:35:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 Processor -- start 2024-04-19T22:35:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- start start 2024-04-19T22:35:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7500108e10 con 0x7f7500108420 2024-04-19T22:35:27.202 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34968/0 (socket says 172.21.15.113:34968) 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 -- 172.21.15.113:0/3968271662 learned_addr learned my addr 172.21.15.113:0/3968271662 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 -- 172.21.15.113:0/3968271662 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7500109620 con 0x7f7500108420 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 --2- 172.21.15.113:0/3968271662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f74f00098a0 tx=0x7f74f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693ed0e4110ec21b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f74ff7fe700 1 -- 172.21.15.113:0/3968271662 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0004160 con 0x7f7500108420 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f74ff7fe700 1 -- 172.21.15.113:0/3968271662 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f74f0004300 con 0x7f7500108420 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f74ff7fe700 1 -- 172.21.15.113:0/3968271662 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0011a60 con 0x7f7500108420 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- 172.21.15.113:0/3968271662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 msgr2=0x7f7500108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 --2- 172.21.15.113:0/3968271662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f74f00098a0 tx=0x7f74f0009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- 172.21.15.113:0/3968271662 shutdown_connections 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 --2- 172.21.15.113:0/3968271662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f7500108840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:27.203 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- 172.21.15.113:0/3968271662 >> 172.21.15.113:0/3968271662 conn(0x7f750007b7d0 msgr2=0x7f750007bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- 172.21.15.113:0/3968271662 shutdown_connections 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- 172.21.15.113:0/3968271662 wait complete. 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 Processor -- start 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- start start 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7507095700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f750010c9d0 con 0x7f7500108420 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34974/0 (socket says 172.21.15.113:34974) 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.067+0000 7f7504e31700 1 -- 172.21.15.113:0/2589856720 learned_addr learned my addr 172.21.15.113:0/2589856720 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f7504e31700 1 -- 172.21.15.113:0/2589856720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750019c8d0 con 0x7f7500108420 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f7504e31700 1 --2- 172.21.15.113:0/2589856720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74f0011700 tx=0x7f74f0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f00039e0 con 0x7f7500108420 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750019cb60 con 0x7f7500108420 2024-04-19T22:35:27.204 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f74f001a8c0 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0024810 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750019f850 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f74f0022020 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7500063890 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 --2- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 0x7f74e803b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f74f004d0f0 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fffff700 1 --2- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 0x7f74e803b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.071+0000 7f74fffff700 1 --2- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 0x7f74e803b4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74f4006fd0 tx=0x7f74f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.075+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f74f000b3e0 con 0x7f7500108420 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.435+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7500105dc0 con 0x7f74e8039010 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.567+0000 7f74fdffb700 1 -- 172.21.15.113:0/2589856720 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7500105dc0 con 0x7f74e8039010 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 msgr2=0x7f74e803b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:27.205 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 --2- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 0x7f74e803b4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74f4006fd0 tx=0x7f74f4006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 msgr2=0x7f750019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 --2- 172.21.15.113:0/2589856720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74f0011700 tx=0x7f74f0011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 shutdown_connections 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 --2- 172.21.15.113:0/2589856720 >> v2:172.21.15.113:6800/2227053540 conn(0x7f74e8039010 0x7f74e803b4d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 --2- 172.21.15.113:0/2589856720 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7500108420 0x7f750019c390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 >> 172.21.15.113:0/2589856720 conn(0x7f750007b7d0 msgr2=0x7f75001056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 shutdown_connections 2024-04-19T22:35:27.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:26.571+0000 7f7507095700 1 -- 172.21.15.113:0/2589856720 wait complete. 2024-04-19T22:35:27.878 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:27 smithi113 bash[21528]: audit 2024-04-19T22:35:26.442775+0000 mgr.y (mgr.14120) 10 : audit 0 from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:27.879 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:27 smithi113 bash[21528]: cephadm 2024-04-19T22:35:26.443034+0000 mgr.y (mgr.14120) 11 : cephadm 1 Generating ssh key... 2024-04-19T22:35:27.879 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:27 smithi113 bash[21528]: audit 2024-04-19T22:35:26.568107+0000 mon.a (mon.0) 60 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:27.879 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:27 smithi113 bash[21528]: audit 2024-04-19T22:35:26.570961+0000 mon.a (mon.0) 61 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:29.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:28 smithi113 bash[21528]: audit 2024-04-19T22:35:28.435866+0000 mgr.y (mgr.14120) 12 : audit 0 from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:29.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBZCRXIvy3M3jlZL7LY2jGrKN9UlPqBBFyU3KiSAuyvUo7QIhe0j/H5TzL/UhRPKjjqbuw3+PbiWHbQ8TWG8DpXdswx4rQ2ObZ4pKbsItHsy4sewYTF0v+/VhhbwOfNF2wQb9yvSAmGAa1SWHYnNpfyJZLn4v3XxwuEw+J7W0kxhr+4A3CIBS06jHJQUFf0Iz/mvtvf3fbL6CKrpOoy1E47Br6/pqIUgYJnSTZoIUGa5i8oChCNl9LDeheA7/3qScnNvl8FyCTcp1+7xncmWI7SJL8hOdHtVsPUW8qYq2++iz8WAOgmZX4WqziTO65HpqMgWuWYy3sIdM1o2jUcMKN9G2XSRN1TPv8JP0m3FpFtV/zH82KKC18Vq5SOcBa8EPKkOzGgAF5MBlcF8jDKbcGLV45iZkhKEM3NUMQ3oHTsVvcwZcc8swhWi2siOgOmhaBxJKmijH7YCS76Kc5+Po2VHlw60E8se35Swzof40N3xz6Q1BzTmOpilxzA19c5Uc= ceph-dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:35:29.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.059+0000 7f4bdb56b700 1 Processor -- start 2024-04-19T22:35:29.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.059+0000 7f4bdb56b700 1 -- start start 2024-04-19T22:35:29.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:29.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4106c10 con 0x7f4bd4106220 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34984/0 (socket says 172.21.15.113:34984) 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 -- 172.21.15.113:0/3012592168 learned_addr learned my addr 172.21.15.113:0/3012592168 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 -- 172.21.15.113:0/3012592168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4107420 con 0x7f4bd4106220 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- 172.21.15.113:0/3012592168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098a0 tx=0x7f4bc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae52503d02dd28a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc7fff700 1 -- 172.21.15.113:0/3012592168 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bc8004160 con 0x7f4bd4106220 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc7fff700 1 -- 172.21.15.113:0/3012592168 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f4bc8004300 con 0x7f4bd4106220 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc7fff700 1 -- 172.21.15.113:0/3012592168 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bc8011a60 con 0x7f4bd4106220 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- 172.21.15.113:0/3012592168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 msgr2=0x7f4bd4106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/3012592168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098a0 tx=0x7f4bc8009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- 172.21.15.113:0/3012592168 shutdown_connections 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/3012592168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd4106640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- 172.21.15.113:0/3012592168 >> 172.21.15.113:0/3012592168 conn(0x7f4bd41017e0 msgr2=0x7f4bd4103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:29.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- 172.21.15.113:0/3012592168 shutdown_connections 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- 172.21.15.113:0/3012592168 wait complete. 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 Processor -- start 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- start start 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bdb56b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd410a7d0 con 0x7f4bd4106220 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:35000/0 (socket says 172.21.15.113:35000) 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 -- 172.21.15.113:0/976324265 learned_addr learned my addr 172.21.15.113:0/976324265 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 -- 172.21.15.113:0/976324265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd419a690 con 0x7f4bd4106220 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bd9307700 1 --2- 172.21.15.113:0/976324265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8011700 tx=0x7f4bc8011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bc80039e0 con 0x7f4bd4106220 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7f4bc801a8c0 con 0x7f4bd4106220 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.063+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bc8024810 con 0x7f4bd4106220 2024-04-19T22:35:29.063 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd419a920 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd419d610 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f4bc8022020 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd4063890 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bc67fc700 1 --2- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 0x7f4bc003b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f4bc804cff0 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bd8b06700 1 --2- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 0x7f4bc003b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.067+0000 7f4bd8b06700 1 --2- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 0x7f4bc003b4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0006fd0 tx=0x7f4bd0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.071+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f4bc800b3e0 con 0x7f4bd4106220 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.431+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f4bd4102960 con 0x7f4bc0039010 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.431+0000 7f4bc67fc700 1 -- 172.21.15.113:0/976324265 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f4bd4102960 con 0x7f4bc0039010 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 msgr2=0x7f4bc003b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 0x7f4bc003b4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0006fd0 tx=0x7f4bd0006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 msgr2=0x7f4bd419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:29.064 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/976324265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8011700 tx=0x7f4bc8011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 shutdown_connections 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/976324265 >> v2:172.21.15.113:6800/2227053540 conn(0x7f4bc0039010 0x7f4bc003b4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 --2- 172.21.15.113:0/976324265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4bd4106220 0x7f4bd419a150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 >> 172.21.15.113:0/976324265 conn(0x7f4bd41017e0 msgr2=0x7f4bd4102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 shutdown_connections 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:28.435+0000 7f4bdb56b700 1 -- 172.21.15.113:0/976324265 wait complete. 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:Adding key to root@localhost authorized_keys... 2024-04-19T22:35:29.065 INFO:teuthology.orchestra.run.smithi113.stdout:Adding host smithi113... 2024-04-19T22:35:30.958 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:30 smithi113 bash[21528]: audit 2024-04-19T22:35:30.381457+0000 mgr.y (mgr.14120) 13 : audit 0 from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi113", "addr": "172.21.15.113", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:32.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:31 smithi113 bash[21528]: cephadm 2024-04-19T22:35:30.952789+0000 mgr.y (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi113 2024-04-19T22:35:36.598 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout Added host 'smithi113' with addr '172.21.15.113' 2024-04-19T22:35:36.598 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 Processor -- start 2024-04-19T22:35:36.598 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- start start 2024-04-19T22:35:36.598 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:36.598 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01070b0 con 0x7fdab01066c0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37386/0 (socket says 172.21.15.113:37386) 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaffff700 1 -- 172.21.15.113:0/2656974641 learned_addr learned my addr 172.21.15.113:0/2656974641 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaffff700 1 -- 172.21.15.113:0/2656974641 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab0105320 con 0x7fdab01066c0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaffff700 1 --2- 172.21.15.113:0/2656974641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00098a0 tx=0x7fdaa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7e106592d7c013 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaeffd700 1 -- 172.21.15.113:0/2656974641 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaa0004160 con 0x7fdab01066c0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaeffd700 1 -- 172.21.15.113:0/2656974641 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fdaa0004300 con 0x7fdab01066c0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdaaeffd700 1 -- 172.21.15.113:0/2656974641 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaa0011a60 con 0x7fdab01066c0 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- 172.21.15.113:0/2656974641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 msgr2=0x7fdab0106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 --2- 172.21.15.113:0/2656974641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00098a0 tx=0x7fdaa0009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- 172.21.15.113:0/2656974641 shutdown_connections 2024-04-19T22:35:36.599 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 --2- 172.21.15.113:0/2656974641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab0106ae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- 172.21.15.113:0/2656974641 >> 172.21.15.113:0/2656974641 conn(0x7fdab00ffe50 msgr2=0x7fdab0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- 172.21.15.113:0/2656974641 shutdown_connections 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:29.999+0000 7fdab662d700 1 -- 172.21.15.113:0/2656974641 wait complete. 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 Processor -- start 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 -- start start 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01096e0 con 0x7fdab01066c0 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37390/0 (socket says 172.21.15.113:37390) 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaffff700 1 -- 172.21.15.113:0/2541284530 learned_addr learned my addr 172.21.15.113:0/2541284530 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaffff700 1 -- 172.21.15.113:0/2541284530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab019a690 con 0x7fdab01066c0 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaffff700 1 --2- 172.21.15.113:0/2541284530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0011700 tx=0x7fdaa0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:36.600 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaa00039e0 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fdaa001a8c0 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab019a920 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaa0024810 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab019d610 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7fdaa0022020 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 --2- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 0x7fda9803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fdaa004cf40 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaf7fe700 1 --2- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 0x7fda9803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab0063890 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.003+0000 7fdaaf7fe700 1 --2- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 0x7fda9803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.011+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fdaa0024ac0 con 0x7fdab01066c0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:30.375+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi113", "addr": "172.21.15.113", "target": ["mon-mgr", ""]}) -- 0x7fdab002dc40 con 0x7fda98038fc0 2024-04-19T22:35:36.601 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.735+0000 7fdaad7fa700 1 -- 172.21.15.113:0/2541284530 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fdab002dc40 con 0x7fda98038fc0 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 msgr2=0x7fda9803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 --2- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 0x7fda9803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 msgr2=0x7fdab019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 --2- 172.21.15.113:0/2541284530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0011700 tx=0x7fdaa0011ae0 comp rx=0 tx=0).stop 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 shutdown_connections 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 --2- 172.21.15.113:0/2541284530 >> v2:172.21.15.113:6800/2227053540 conn(0x7fda98038fc0 0x7fda9803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 --2- 172.21.15.113:0/2541284530 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdab01066c0 0x7fdab019a150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 >> 172.21.15.113:0/2541284530 conn(0x7fdab00ffe50 msgr2=0x7fdab0100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 shutdown_connections 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:35.739+0000 7fdab662d700 1 -- 172.21.15.113:0/2541284530 wait complete. 2024-04-19T22:35:36.602 INFO:teuthology.orchestra.run.smithi113.stdout:Deploying unmanaged mon service... 2024-04-19T22:35:37.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:36 smithi113 bash[21528]: audit 2024-04-19T22:35:35.740119+0000 mon.a (mon.0) 62 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:37.039 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:36 smithi113 bash[21528]: cephadm 2024-04-19T22:35:35.740916+0000 mgr.y (mgr.14120) 15 : cephadm 1 Added host smithi113 2024-04-19T22:35:37.039 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:36 smithi113 bash[21528]: audit 2024-04-19T22:35:35.790207+0000 mon.a (mon.0) 63 : audit 0 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.071+0000 7fa90ed9a700 1 Processor -- start 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.071+0000 7fa90ed9a700 1 -- start start 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.071+0000 7fa90ed9a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.071+0000 7fa90ed9a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa908106c10 con 0x7fa908106220 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.071+0000 7fa90cb36700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:39.292 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37392/0 (socket says 172.21.15.113:37392) 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 -- 172.21.15.113:0/1382051289 learned_addr learned my addr 172.21.15.113:0/1382051289 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 -- 172.21.15.113:0/1382051289 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa908107420 con 0x7fa908106220 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 --2- 172.21.15.113:0/1382051289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e80 tx=0x7fa90000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6a738a2fe5a456 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa9077fe700 1 -- 172.21.15.113:0/1382051289 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa908106220 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa9077fe700 1 -- 172.21.15.113:0/1382051289 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fa90000b8c0 con 0x7fa908106220 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa9077fe700 1 -- 172.21.15.113:0/1382051289 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900004470 con 0x7fa908106220 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/1382051289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 msgr2=0x7fa908106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/1382051289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e80 tx=0x7fa90000b330 comp rx=0 tx=0).stop 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/1382051289 shutdown_connections 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/1382051289 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa908106640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/1382051289 >> 172.21.15.113:0/1382051289 conn(0x7fa9081017e0 msgr2=0x7fa908103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/1382051289 shutdown_connections 2024-04-19T22:35:39.293 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/1382051289 wait complete. 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 Processor -- start 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- start start 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa90810a7d0 con 0x7fa908106220 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37406/0 (socket says 172.21.15.113:37406) 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 -- 172.21.15.113:0/2680252906 learned_addr learned my addr 172.21.15.113:0/2680252906 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 -- 172.21.15.113:0/2680252906 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90807c1d0 con 0x7fa908106220 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90cb36700 1 --2- 172.21.15.113:0/2680252906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa900009fd0 tx=0x7fa90000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900021020 con 0x7fa908106220 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1062+0+0 (secure 0 0 0) 0x7fa900003d00 con 0x7fa908106220 2024-04-19T22:35:39.294 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90807a3c0 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900017040 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.075+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90807a900 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7fa900024020 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa905ffb700 1 --2- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 0x7fa8f003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa908063890 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fa90000f050 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa907fff700 1 --2- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 0x7fa8f003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.079+0000 7fa907fff700 1 --2- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 0x7fa8f003b4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.083+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fa90002b020 con 0x7fa908106220 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.471+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa90807b070 con 0x7fa8f0039000 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa905ffb700 1 -- 172.21.15.113:0/2680252906 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa90807b070 con 0x7fa8f0039000 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 msgr2=0x7fa8f003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:39.295 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 0x7fa8f003b4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 msgr2=0x7fa90807bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/2680252906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa900009fd0 tx=0x7fa90000be90 comp rx=0 tx=0).stop 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.479+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 shutdown_connections 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.483+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/2680252906 >> v2:172.21.15.113:6800/2227053540 conn(0x7fa8f0039000 0x7fa8f003b4c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.483+0000 7fa90ed9a700 1 --2- 172.21.15.113:0/2680252906 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa908106220 0x7fa90807bc90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.483+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 >> 172.21.15.113:0/2680252906 conn(0x7fa9081017e0 msgr2=0x7fa9081022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.483+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 shutdown_connections 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:38.483+0000 7fa90ed9a700 1 -- 172.21.15.113:0/2680252906 wait complete. 2024-04-19T22:35:39.296 INFO:teuthology.orchestra.run.smithi113.stdout:Deploying unmanaged mgr service... 2024-04-19T22:35:39.788 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:39 smithi113 bash[21528]: audit 2024-04-19T22:35:38.478247+0000 mgr.y (mgr.14120) 16 : audit 0 from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:39.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:39 smithi113 bash[21528]: cephadm 2024-04-19T22:35:38.479583+0000 mgr.y (mgr.14120) 17 : cephadm 1 Saving service mon spec with placement count:5 2024-04-19T22:35:39.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:39 smithi113 bash[21528]: audit 2024-04-19T22:35:38.483045+0000 mon.a (mon.0) 64 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:39.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:39 smithi113 bash[21528]: audit 2024-04-19T22:35:39.016898+0000 mon.a (mon.0) 65 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:40.788 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:40 smithi113 bash[21528]: audit 2024-04-19T22:35:39.556092+0000 mon.a (mon.0) 66 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:40.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:40 smithi113 bash[21528]: audit 2024-04-19T22:35:40.520102+0000 mon.a (mon.0) 67 : audit 1 from='mgr.14120 172.21.15.113:0/2518519650' entity='mgr.y' 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f65832a5700 1 Processor -- start 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f65832a5700 1 -- start start 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f65832a5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f65832a5700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f657c07a9f0 con 0x7f657c07bfc0 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f6581041700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:41.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f6581041700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37440/0 (socket says 172.21.15.113:37440) 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f6581041700 1 -- 172.21.15.113:0/1257489738 learned_addr learned my addr 172.21.15.113:0/1257489738 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f6581041700 1 -- 172.21.15.113:0/1257489738 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c07ab70 con 0x7f657c07bfc0 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.103+0000 7f6581041700 1 --2- 172.21.15.113:0/1257489738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f65780098a0 tx=0x7f6578009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212eda391136e4d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6573fff700 1 -- 172.21.15.113:0/1257489738 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578004160 con 0x7f657c07bfc0 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6573fff700 1 -- 172.21.15.113:0/1257489738 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6578004300 con 0x7f657c07bfc0 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6573fff700 1 -- 172.21.15.113:0/1257489738 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578011a00 con 0x7f657c07bfc0 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/1257489738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 msgr2=0x7f657c07a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 --2- 172.21.15.113:0/1257489738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f65780098a0 tx=0x7f6578009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/1257489738 shutdown_connections 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 --2- 172.21.15.113:0/1257489738 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c07a420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/1257489738 >> 172.21.15.113:0/1257489738 conn(0x7f657c1017e0 msgr2=0x7f657c103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:41.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/1257489738 shutdown_connections 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/1257489738 wait complete. 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 Processor -- start 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- start start 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f657c10c820 con 0x7f657c07bfc0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6581041700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6581041700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37454/0 (socket says 172.21.15.113:37454) 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6581041700 1 -- 172.21.15.113:0/3995202861 learned_addr learned my addr 172.21.15.113:0/3995202861 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6581041700 1 -- 172.21.15.113:0/3995202861 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c19c8b0 con 0x7f657c07bfc0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6581041700 1 --2- 172.21.15.113:0/3995202861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6578009fb0 tx=0x7f6578011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578003aa0 con 0x7f657c07bfc0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f657801a8e0 con 0x7f657c07bfc0 2024-04-19T22:35:41.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578024930 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c19cb40 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c19f830 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f6578022020 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657c063890 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 --2- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 0x7f656803b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f657804cfe0 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.107+0000 7f6580840700 1 --2- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 0x7f656803b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.111+0000 7f6580840700 1 --2- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 0x7f656803b4d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f656c006fd0 tx=0x7f656c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.115+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f657800f2e0 con 0x7f657c07bfc0 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.507+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 --> v2:172.21.15.113:6800/2227053540 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f657c1029e0 con 0x7f6568039010 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.515+0000 7f65727fc700 1 -- 172.21.15.113:0/3995202861 <== mgr.14120 v2:172.21.15.113:6800/2227053540 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f657c1029e0 con 0x7f6568039010 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 msgr2=0x7f656803b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:41.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 --2- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 0x7f656803b4d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f656c006fd0 tx=0x7f656c006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 msgr2=0x7f657c19c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 --2- 172.21.15.113:0/3995202861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6578009fb0 tx=0x7f6578011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 shutdown_connections 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 --2- 172.21.15.113:0/3995202861 >> v2:172.21.15.113:6800/2227053540 conn(0x7f6568039010 0x7f656803b4d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 --2- 172.21.15.113:0/3995202861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f657c07bfc0 0x7f657c19c370 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6578009fb0 tx=0x7f6578011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 >> 172.21.15.113:0/3995202861 conn(0x7f657c1017e0 msgr2=0x7f657c1022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 shutdown_connections 2024-04-19T22:35:41.096 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:40.519+0000 7f65832a5700 1 -- 172.21.15.113:0/3995202861 wait complete. 2024-04-19T22:35:42.038 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:41 smithi113 bash[21528]: cluster 2024-04-19T22:35:39.784453+0000 mgr.y (mgr.14120) 18 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:35:42.039 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:41 smithi113 bash[21528]: audit 2024-04-19T22:35:40.512927+0000 mgr.y (mgr.14120) 19 : audit 0 from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:42.039 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:41 smithi113 bash[21528]: cephadm 2024-04-19T22:35:40.515457+0000 mgr.y (mgr.14120) 20 : cephadm 1 Saving service mgr spec with placement count:2 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 Processor -- start 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- start start 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb784108e10 con 0x7fb784108420 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb789fa1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb789fa1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37466/0 (socket says 172.21.15.113:37466) 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb789fa1700 1 -- 172.21.15.113:0/3047091366 learned_addr learned my addr 172.21.15.113:0/3047091366 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb789fa1700 1 -- 172.21.15.113:0/3047091366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784109620 con 0x7fb784108420 2024-04-19T22:35:42.904 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb789fa1700 1 --2- 172.21.15.113:0/3047091366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098a0 tx=0x7fb774009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae496cc5f3ff281 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb788f9f700 1 -- 172.21.15.113:0/3047091366 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb774004160 con 0x7fb784108420 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb788f9f700 1 -- 172.21.15.113:0/3047091366 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb774004300 con 0x7fb784108420 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb788f9f700 1 -- 172.21.15.113:0/3047091366 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb774011a00 con 0x7fb784108420 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- 172.21.15.113:0/3047091366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 msgr2=0x7fb784108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 --2- 172.21.15.113:0/3047091366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098a0 tx=0x7fb774009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- 172.21.15.113:0/3047091366 shutdown_connections 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 --2- 172.21.15.113:0/3047091366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb784108840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- 172.21.15.113:0/3047091366 >> 172.21.15.113:0/3047091366 conn(0x7fb78407b7d0 msgr2=0x7fb78407bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- 172.21.15.113:0/3047091366 shutdown_connections 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.967+0000 7fb78c205700 1 -- 172.21.15.113:0/3047091366 wait complete. 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 Processor -- start 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 -- start start 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb78410c9d0 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb789fa1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb789fa1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37470/0 (socket says 172.21.15.113:37470) 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb789fa1700 1 -- 172.21.15.113:0/1831638790 learned_addr learned my addr 172.21.15.113:0/1831638790 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb789fa1700 1 -- 172.21.15.113:0/1831638790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78419c8d0 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb789fa1700 1 --2- 172.21.15.113:0/1831638790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb774009870 tx=0x7fb774011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740039e0 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78419cb60 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb77401a8e0 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb774024890 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78419f850 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7fb774022020 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb784063890 con 0x7fb784108420 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 --2- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 0x7fb76c03b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:42.906 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fb77404d290 con 0x7fb784108420 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb7897a0700 1 --2- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 0x7fb76c03b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.971+0000 7fb7897a0700 1 --2- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 0x7fb76c03b4d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ad30 tx=0x7fb7780093f0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:41.979+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb774019c70 con 0x7fb784108420 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.331+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb78419fc30 con 0x7fb784108420 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.331+0000 7fb782ffd700 1 -- 172.21.15.113:0/1831638790 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb77401ad70 con 0x7fb784108420 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 msgr2=0x7fb76c03b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 --2- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 0x7fb76c03b4d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ad30 tx=0x7fb7780093f0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 msgr2=0x7fb78419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 --2- 172.21.15.113:0/1831638790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb774009870 tx=0x7fb774011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 shutdown_connections 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 --2- 172.21.15.113:0/1831638790 >> v2:172.21.15.113:6800/2227053540 conn(0x7fb76c039010 0x7fb76c03b4d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 --2- 172.21.15.113:0/1831638790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb784108420 0x7fb78419c390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 >> 172.21.15.113:0/1831638790 conn(0x7fb78407b7d0 msgr2=0x7fb784105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:42.907 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 shutdown_connections 2024-04-19T22:35:42.908 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:42.335+0000 7fb78c205700 1 -- 172.21.15.113:0/1831638790 wait complete. 2024-04-19T22:35:43.577 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:43 smithi113 bash[21528]: cluster 2024-04-19T22:35:41.784890+0000 mgr.y (mgr.14120) 21 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:35:43.577 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:43 smithi113 bash[21528]: audit 2024-04-19T22:35:42.337761+0000 mon.a (mon.0) 68 : audit 1 from='client.? 172.21.15.113:0/1831638790' entity='client.admin' 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 Processor -- start 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- start start 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd964106c10 con 0x7fd964106220 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd968b85700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd968b85700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37476/0 (socket says 172.21.15.113:37476) 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd968b85700 1 -- 172.21.15.113:0/3312816929 learned_addr learned my addr 172.21.15.113:0/3312816929 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:44.818 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd968b85700 1 -- 172.21.15.113:0/3312816929 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd964107420 con 0x7fd964106220 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd968b85700 1 --2- 172.21.15.113:0/3312816929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0098a0 tx=0x7fd95c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f833a8fa302e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd9637fe700 1 -- 172.21.15.113:0/3312816929 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c004160 con 0x7fd964106220 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd9637fe700 1 -- 172.21.15.113:0/3312816929 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd95c004300 con 0x7fd964106220 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd9637fe700 1 -- 172.21.15.113:0/3312816929 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c011a00 con 0x7fd964106220 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- 172.21.15.113:0/3312816929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 msgr2=0x7fd964106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3312816929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0098a0 tx=0x7fd95c009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- 172.21.15.113:0/3312816929 shutdown_connections 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3312816929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd964106640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- 172.21.15.113:0/3312816929 >> 172.21.15.113:0/3312816929 conn(0x7fd9641017e0 msgr2=0x7fd964103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- 172.21.15.113:0/3312816929 shutdown_connections 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- 172.21.15.113:0/3312816929 wait complete. 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 Processor -- start 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- start start 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:44.819 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.763+0000 7fd96ade9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd96410a7d0 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd968b85700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd968b85700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37484/0 (socket says 172.21.15.113:37484) 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd968b85700 1 -- 172.21.15.113:0/3599452495 learned_addr learned my addr 172.21.15.113:0/3599452495 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd968b85700 1 -- 172.21.15.113:0/3599452495 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96407c1d0 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd968b85700 1 --2- 172.21.15.113:0/3599452495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009fb0 tx=0x7fd95c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c003aa0 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd95c01a8e0 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96407a3c0 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c024930 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96407a900 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7fd95c022020 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 --2- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 0x7fd95003b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd964063890 con 0x7fd964106220 2024-04-19T22:35:44.820 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7fd95c04d130 con 0x7fd964106220 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd963fff700 1 --2- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 0x7fd95003b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.767+0000 7fd963fff700 1 --2- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 0x7fd95003b4d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd94c006fd0 tx=0x7fd94c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:43.771+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd95c01ad70 con 0x7fd964106220 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.135+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd96407b060 con 0x7fd964106220 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.139+0000 7fd961ffb700 1 -- 172.21.15.113:0/3599452495 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd95c02cda0 con 0x7fd964106220 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.139+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 msgr2=0x7fd95003b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.139+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 0x7fd95003b4d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd94c006fd0 tx=0x7fd94c006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.139+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 msgr2=0x7fd96407bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.139+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3599452495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009fb0 tx=0x7fd95c011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 shutdown_connections 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3599452495 >> v2:172.21.15.113:6800/2227053540 conn(0x7fd950039010 0x7fd95003b4d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 --2- 172.21.15.113:0/3599452495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd964106220 0x7fd96407bc90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 >> 172.21.15.113:0/3599452495 conn(0x7fd9641017e0 msgr2=0x7fd9641022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 shutdown_connections 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:44.143+0000 7fd96ade9700 1 -- 172.21.15.113:0/3599452495 wait complete. 2024-04-19T22:35:44.821 INFO:teuthology.orchestra.run.smithi113.stdout:Enabling the dashboard module... 2024-04-19T22:35:45.457 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:45 smithi113 bash[21528]: cluster 2024-04-19T22:35:43.785168+0000 mgr.y (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:35:45.457 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:45 smithi113 bash[21528]: audit 2024-04-19T22:35:44.143304+0000 mon.a (mon.0) 69 : audit 1 from='client.? 172.21.15.113:0/3599452495' entity='client.admin' 2024-04-19T22:35:46.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:46 smithi113 bash[21528]: audit 2024-04-19T22:35:46.134470+0000 mon.a (mon.0) 70 : audit 1 from='client.? 172.21.15.113:0/1714833447' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-19T22:35:46.539 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:46 smithi113 bash[21785]: ignoring --setuser ceph since I am not root 2024-04-19T22:35:46.539 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:46 smithi113 bash[21785]: ignoring --setgroup ceph since I am not root 2024-04-19T22:35:46.539 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:46 smithi113 bash[21785]: debug 2024-04-19T22:35:46.339+0000 7f84aa97a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:35:46.857 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.647+0000 7f41f73bb700 1 Processor -- start 2024-04-19T22:35:46.857 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.647+0000 7f41f73bb700 1 -- start start 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.647+0000 7f41f73bb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.647+0000 7f41f73bb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f41f0079f70 con 0x7f41f0104af0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.647+0000 7f41f5157700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37486/0 (socket says 172.21.15.113:37486) 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 -- 172.21.15.113:0/2089549418 learned_addr learned my addr 172.21.15.113:0/2089549418 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 -- 172.21.15.113:0/2089549418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f0105450 con 0x7f41f0104af0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 --2- 172.21.15.113:0/2089549418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098a0 tx=0x7f41ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7308d91647a7023f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e7fff700 1 -- 172.21.15.113:0/2089549418 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec004160 con 0x7f41f0104af0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e7fff700 1 -- 172.21.15.113:0/2089549418 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f41ec004300 con 0x7f41f0104af0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e7fff700 1 -- 172.21.15.113:0/2089549418 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec011a00 con 0x7f41f0104af0 2024-04-19T22:35:46.858 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/2089549418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 msgr2=0x7f41f0104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 --2- 172.21.15.113:0/2089549418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098a0 tx=0x7f41ec009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/2089549418 shutdown_connections 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 --2- 172.21.15.113:0/2089549418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f0104f10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/2089549418 >> 172.21.15.113:0/2089549418 conn(0x7f41f01006f0 msgr2=0x7f41f0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/2089549418 shutdown_connections 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/2089549418 wait complete. 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 Processor -- start 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- start start 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f41f01064c0 con 0x7f41f0104af0 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37496/0 (socket says 172.21.15.113:37496) 2024-04-19T22:35:46.859 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 -- 172.21.15.113:0/1714833447 learned_addr learned my addr 172.21.15.113:0/1714833447 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 -- 172.21.15.113:0/1714833447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f019c880 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f5157700 1 --2- 172.21.15.113:0/1714833447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009870 tx=0x7f41ec011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec0039e0 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f41ec01a8e0 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec024850 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f019cb10 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.651+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f019f800 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f0063890 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 8) ==== 46252+0+0 (secure 0 0 0) 0x7f41ec022020 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41e67fc700 1 --2- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 0x7f41dc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f41ec04d460 con 0x7f41f0104af0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41f4956700 1 --2- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 0x7f41dc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.655+0000 7f41f4956700 1 --2- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 0x7f41dc03b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006fd0 tx=0x7f41e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:46.860 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:45.659+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f41ec02c3a0 con 0x7f41f0104af0 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.127+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f41f002dbd0 con 0x7f41f0104af0 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.143+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f41ec016260 con 0x7f41f0104af0 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.143+0000 7f41e67fc700 1 -- 172.21.15.113:0/1714833447 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mgrmap(e 9) ==== 46265+0+0 (secure 0 0 0) 0x7f41ec04c960 con 0x7f41f0104af0 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 msgr2=0x7f41dc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 --2- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 0x7f41dc03b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006fd0 tx=0x7f41e0006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 msgr2=0x7f41f019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 --2- 172.21.15.113:0/1714833447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009870 tx=0x7f41ec011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 shutdown_connections 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 --2- 172.21.15.113:0/1714833447 >> v2:172.21.15.113:6800/2227053540 conn(0x7f41dc039050 0x7f41dc03b510 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:46.861 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 --2- 172.21.15.113:0/1714833447 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41f0104af0 0x7f41f019c340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:46.862 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 >> 172.21.15.113:0/1714833447 conn(0x7f41f01006f0 msgr2=0x7f41f0192f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:46.862 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 shutdown_connections 2024-04-19T22:35:46.862 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:46.147+0000 7f41f73bb700 1 -- 172.21.15.113:0/1714833447 wait complete. 2024-04-19T22:35:47.502 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:47 smithi113 bash[21528]: audit 2024-04-19T22:35:46.148074+0000 mon.a (mon.0) 71 : audit 1 from='client.? 172.21.15.113:0/1714833447' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-19T22:35:47.502 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:47 smithi113 bash[21528]: cluster 2024-04-19T22:35:46.152945+0000 mon.a (mon.0) 72 : cluster 0 mgrmap e9: y(active, since 26s) 2024-04-19T22:35:48.209 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:47 smithi113 bash[21785]: debug 2024-04-19T22:35:47.927+0000 7f84aa97a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:35:48.210 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:48 smithi113 bash[21785]: debug 2024-04-19T22:35:48.023+0000 7f84aa97a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:35:48.538 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:48 smithi113 bash[21785]: debug 2024-04-19T22:35:48.275+0000 7f84aa97a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:35:48.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:48 smithi113 bash[21528]: audit 2024-04-19T22:35:48.204992+0000 mon.a (mon.0) 73 : audit 0 from='client.? 172.21.15.113:0/1503265354' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-19T22:35:48.830 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:48.830 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 Processor -- start 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- start start 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5480105b20 con 0x7f5480105130 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37530/0 (socket says 172.21.15.113:37530) 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 -- 172.21.15.113:0/2350928056 learned_addr learned my addr 172.21.15.113:0/2350928056 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 -- 172.21.15.113:0/2350928056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5480106330 con 0x7f5480105130 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 --2- 172.21.15.113:0/2350928056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098a0 tx=0x7f547c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02d20e1e4f8ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:48.831 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f548501e700 1 -- 172.21.15.113:0/2350928056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c004160 con 0x7f5480105130 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f548501e700 1 -- 172.21.15.113:0/2350928056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f547c004300 con 0x7f5480105130 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f548501e700 1 -- 172.21.15.113:0/2350928056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c011a00 con 0x7f5480105130 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- 172.21.15.113:0/2350928056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 msgr2=0x7f5480105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 --2- 172.21.15.113:0/2350928056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098a0 tx=0x7f547c009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- 172.21.15.113:0/2350928056 shutdown_connections 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 --2- 172.21.15.113:0/2350928056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f5480105550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- 172.21.15.113:0/2350928056 >> 172.21.15.113:0/2350928056 conn(0x7f54801006f0 msgr2=0x7f5480102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- 172.21.15.113:0/2350928056 shutdown_connections 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- 172.21.15.113:0/2350928056 wait complete. 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 Processor -- start 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- start start 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:48.832 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5488284700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f54800790f0 con 0x7f5480105130 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37538/0 (socket says 172.21.15.113:37538) 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 -- 172.21.15.113:0/1503265354 learned_addr learned my addr 172.21.15.113:0/1503265354 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.699+0000 7f5486020700 1 -- 172.21.15.113:0/1503265354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548019c920 con 0x7f5480105130 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f5486020700 1 --2- 172.21.15.113:0/1503265354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f547c009fb0 tx=0x7f547c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c003aa0 con 0x7f5480105130 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f547c01a8e0 con 0x7f5480105130 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c024930 con 0x7f5480105130 2024-04-19T22:35:48.833 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548019cbb0 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548019f8a0 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 9) ==== 46265+0+0 (secure 0 0 0) 0x7f547c022020 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 --2- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 0x7f546c03b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f547c04d430 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f548581f700 1 -- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 msgr2=0x7f546c03b4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f548581f700 1 --2- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 0x7f546c03b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.703+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5480063890 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.707+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f547c00f2e0 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.907+0000 7f548581f700 1 -- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 msgr2=0x7f546c03b4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:47.907+0000 7f548581f700 1 --2- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 0x7f546c03b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.199+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5480195940 con 0x7f5480105130 2024-04-19T22:35:48.834 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.199+0000 7f54777fe700 1 -- 172.21.15.113:0/1503265354 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f5480195940 con 0x7f5480105130 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 msgr2=0x7f546c03b4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 --2- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 0x7f546c03b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 msgr2=0x7f548019c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 --2- 172.21.15.113:0/1503265354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f547c009fb0 tx=0x7f547c011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 shutdown_connections 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 --2- 172.21.15.113:0/1503265354 >> v2:172.21.15.113:6800/2227053540 conn(0x7f546c039010 0x7f546c03b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 --2- 172.21.15.113:0/1503265354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5480105130 0x7f548019c3e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 >> 172.21.15.113:0/1503265354 conn(0x7f54801006f0 msgr2=0x7f5480192a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 shutdown_connections 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:48.203+0000 7f5488284700 1 -- 172.21.15.113:0/1503265354 wait complete. 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for the mgr to restart... 2024-04-19T22:35:48.835 INFO:teuthology.orchestra.run.smithi113.stdout:Waiting for mgr epoch 9... 2024-04-19T22:35:49.180 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.070+0000 7f84aa97a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:35:49.514 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.182+0000 7f84aa97a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:35:49.515 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.290+0000 7f84aa97a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:35:49.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.650+0000 7f84aa97a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:35:49.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.766+0000 7f84aa97a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:35:50.218 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:49 smithi113 bash[21785]: debug 2024-04-19T22:35:49.866+0000 7f84aa97a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:35:50.539 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:50 smithi113 bash[21785]: debug 2024-04-19T22:35:50.222+0000 7f84aa97a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:35:50.539 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:50 smithi113 bash[21785]: debug 2024-04-19T22:35:50.458+0000 7f84aa97a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:35:51.039 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:50 smithi113 bash[21785]: debug 2024-04-19T22:35:50.722+0000 7f84aa97a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:35:51.039 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:50 smithi113 bash[21785]: debug 2024-04-19T22:35:50.834+0000 7f84aa97a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:35:51.511 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:51 smithi113 bash[21785]: debug 2024-04-19T22:35:51.106+0000 7f84aa97a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:35:51.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:51 smithi113 bash[21785]: debug 2024-04-19T22:35:51.514+0000 7f84aa97a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:51.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:51 smithi113 bash[21785]: debug 2024-04-19T22:35:51.754+0000 7f84aa97a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:35:52.289 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:51 smithi113 bash[21785]: debug 2024-04-19T22:35:51.870+0000 7f84aa97a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:35:52.289 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:52 smithi113 bash[21785]: debug 2024-04-19T22:35:52.118+0000 7f84aa97a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:35:53.516 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:53 smithi113 bash[21785]: debug 2024-04-19T22:35:53.110+0000 7f84aa97a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:35:53.516 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:53 smithi113 bash[21785]: debug 2024-04-19T22:35:53.226+0000 7f84aa97a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:35:53.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:53 smithi113 bash[21785]: debug 2024-04-19T22:35:53.518+0000 7f84aa97a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:35:53.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:53 smithi113 bash[21785]: debug 2024-04-19T22:35:53.634+0000 7f84aa97a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21785]: debug 2024-04-19T22:35:54.082+0000 7f84aa97a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21785]: debug 2024-04-19T22:35:54.202+0000 7f84aa97a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: cluster 2024-04-19T22:35:54.228339+0000 mon.a (mon.0) 74 : cluster 1 Active manager daemon y restarted 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: cluster 2024-04-19T22:35:54.229147+0000 mon.a (mon.0) 75 : cluster 1 Activating manager daemon y 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: cluster 2024-04-19T22:35:54.236904+0000 mon.a (mon.0) 76 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: cluster 2024-04-19T22:35:54.237139+0000 mon.a (mon.0) 77 : cluster 0 mgrmap e10: y(active, starting, since 0.00836293s) 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: audit 2024-04-19T22:35:54.239861+0000 mon.a (mon.0) 78 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: audit 2024-04-19T22:35:54.241686+0000 mon.a (mon.0) 79 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:35:54.327 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: audit 2024-04-19T22:35:54.242766+0000 mon.a (mon.0) 80 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:35:54.328 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: audit 2024-04-19T22:35:54.243024+0000 mon.a (mon.0) 81 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:35:54.328 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: audit 2024-04-19T22:35:54.243190+0000 mon.a (mon.0) 82 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:35:54.328 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:54 smithi113 bash[21528]: cluster 2024-04-19T22:35:54.268558+0000 mon.a (mon.0) 83 : cluster 1 Manager daemon y is now available 2024-04-19T22:35:55.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: audit 2024-04-19T22:35:54.293268+0000 mon.a (mon.0) 84 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:35:55.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: audit 2024-04-19T22:35:54.311693+0000 mon.a (mon.0) 85 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:35:55.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: audit 2024-04-19T22:35:54.313980+0000 mon.a (mon.0) 86 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:35:55.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: cephadm 2024-04-19T22:35:54.919701+0000 mgr.y (mgr.14152) 1 : cephadm 1 [19/Apr/2024:22:35:54] ENGINE Bus STARTING 2024-04-19T22:35:55.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: cephadm 2024-04-19T22:35:55.036179+0000 mgr.y (mgr.14152) 2 : cephadm 1 [19/Apr/2024:22:35:55] ENGINE Serving on https://172.21.15.113:7150 2024-04-19T22:35:55.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: cephadm 2024-04-19T22:35:55.137448+0000 mgr.y (mgr.14152) 3 : cephadm 1 [19/Apr/2024:22:35:55] ENGINE Serving on http://172.21.15.113:8765 2024-04-19T22:35:55.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: cephadm 2024-04-19T22:35:55.137606+0000 mgr.y (mgr.14152) 4 : cephadm 1 [19/Apr/2024:22:35:55] ENGINE Bus STARTED 2024-04-19T22:35:55.540 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:55 smithi113 bash[21528]: cluster 2024-04-19T22:35:55.242445+0000 mon.a (mon.0) 87 : cluster 0 mgrmap e11: y(active, since 1.01364s) 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout { 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout } 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 Processor -- start 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- start start 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:56.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8310106c20 con 0x7f8310106230 2024-04-19T22:35:56.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8316086700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:56.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8316086700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58198/0 (socket says 172.21.15.113:58198) 2024-04-19T22:35:56.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8316086700 1 -- 172.21.15.113:0/4174489854 learned_addr learned my addr 172.21.15.113:0/4174489854 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:56.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8316086700 1 -- 172.21.15.113:0/4174489854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8310107430 con 0x7f8310106230 2024-04-19T22:35:56.056 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8316086700 1 --2- 172.21.15.113:0/4174489854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92de078092074ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8315084700 1 -- 172.21.15.113:0/4174489854 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300004160 con 0x7f8310106230 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8315084700 1 -- 172.21.15.113:0/4174489854 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f8300004300 con 0x7f8310106230 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f8315084700 1 -- 172.21.15.113:0/4174489854 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300011a00 con 0x7f8310106230 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- 172.21.15.113:0/4174489854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 msgr2=0x7f8310106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 --2- 172.21.15.113:0/4174489854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- 172.21.15.113:0/4174489854 shutdown_connections 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 --2- 172.21.15.113:0/4174489854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f8310106650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- 172.21.15.113:0/4174489854 >> 172.21.15.113:0/4174489854 conn(0x7f83101017b0 msgr2=0x7f8310103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- 172.21.15.113:0/4174489854 shutdown_connections 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.714+0000 7f83182ea700 1 -- 172.21.15.113:0/4174489854 wait complete. 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 Processor -- start 2024-04-19T22:35:56.057 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 -- start start 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f831010a7e0 con 0x7f8310106230 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8316086700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8316086700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58208/0 (socket says 172.21.15.113:58208) 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8316086700 1 -- 172.21.15.113:0/138090394 learned_addr learned my addr 172.21.15.113:0/138090394 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8316086700 1 -- 172.21.15.113:0/138090394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831007c1d0 con 0x7f8310106230 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8316086700 1 --2- 172.21.15.113:0/138090394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8300009870 tx=0x7f8300011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83000039e0 con 0x7f8310106230 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f830001a8e0 con 0x7f8310106230 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831007a3c0 con 0x7f8310106230 2024-04-19T22:35:56.058 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831007a900 con 0x7f8310106230 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300024890 con 0x7f8310106230 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 9) ==== 46265+0+0 (secure 0 0 0) 0x7f8300022020 con 0x7f8310106230 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 --> v2:172.21.15.113:6800/2227053540 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8310063890 con 0x7f82fc0390b0 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 897+0+0 (secure 0 0 0) 0x7f830004d2b0 con 0x7f8310106230 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8315885700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.718+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.922+0000 7f8315885700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:49.922+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:50.326+0000 7f8315885700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:50.326+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:51.130+0000 7f8315885700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:56.059 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:51.130+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:52.734+0000 7f8315885700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/2227053540 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:52.734+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:54.226+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f830002d910 con 0x7f8310106230 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:54.230+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 msgr2=0x7f82fc03b570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:54.230+0000 7f83077fe700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.230+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mgrmap(e 11) ==== 46159+0+0 (secure 0 0 0) 0x7f830004ef50 con 0x7f8310106230 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.230+0000 7f83077fe700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 0x7f82fc03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.230+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 --> v2:172.21.15.113:6800/467518466 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8310063890 con 0x7f82fc03c8f0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.234+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 0x7f82fc03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.234+0000 7f8315885700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 0x7f82fc03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f830c003a10 tx=0x7f830c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.238+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f8310063890 con 0x7f82fc03c8f0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 --> v2:172.21.15.113:6800/467518466 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f83101029f0 con 0x7f82fc03c8f0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83077fe700 1 -- 172.21.15.113:0/138090394 <== mgr.14152 v2:172.21.15.113:6800/467518466 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f83101029f0 con 0x7f82fc03c8f0 2024-04-19T22:35:56.060 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 msgr2=0x7f82fc03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 0x7f82fc03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f830c003a10 tx=0x7f830c009270 comp rx=0 tx=0).stop 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 msgr2=0x7f831007bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 --2- 172.21.15.113:0/138090394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8300009870 tx=0x7f8300011ac0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 shutdown_connections 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 --2- 172.21.15.113:0/138090394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8310106230 0x7f831007bc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/467518466 conn(0x7f82fc03c8f0 0x7f82fc03ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 --2- 172.21.15.113:0/138090394 >> v2:172.21.15.113:6800/2227053540 conn(0x7f82fc0390b0 0x7f82fc03b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 >> 172.21.15.113:0/138090394 conn(0x7f83101017b0 msgr2=0x7f83101022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:56.061 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 shutdown_connections 2024-04-19T22:35:56.062 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:55.250+0000 7f83182ea700 1 -- 172.21.15.113:0/138090394 wait complete. 2024-04-19T22:35:56.062 INFO:teuthology.orchestra.run.smithi113.stdout:mgr epoch 9 is available 2024-04-19T22:35:56.062 INFO:teuthology.orchestra.run.smithi113.stdout:Generating a dashboard self-signed certificate... 2024-04-19T22:35:56.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:56 smithi113 bash[21528]: audit 2024-04-19T22:35:55.241294+0000 mgr.y (mgr.14152) 5 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-19T22:35:56.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:56 smithi113 bash[21528]: audit 2024-04-19T22:35:55.256241+0000 mgr.y (mgr.14152) 6 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-19T22:35:57.539 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:57 smithi113 bash[21528]: cluster 2024-04-19T22:35:56.291494+0000 mon.a (mon.0) 88 : cluster 0 mgrmap e12: y(active, since 2s) 2024-04-19T22:35:58.091 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 Processor -- start 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- start start 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4079f50 con 0x7f29f4104b10 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58296/0 (socket says 172.21.15.113:58296) 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 -- 172.21.15.113:0/647235236 learned_addr learned my addr 172.21.15.113:0/647235236 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 -- 172.21.15.113:0/647235236 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4105470 con 0x7f29f4104b10 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- 172.21.15.113:0/647235236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098a0 tx=0x7f29e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5ea20034417673 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29ebfff700 1 -- 172.21.15.113:0/647235236 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4004160 con 0x7f29f4104b10 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29ebfff700 1 -- 172.21.15.113:0/647235236 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f29e4004300 con 0x7f29f4104b10 2024-04-19T22:35:58.092 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29ebfff700 1 -- 172.21.15.113:0/647235236 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4011a00 con 0x7f29f4104b10 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- 172.21.15.113:0/647235236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 msgr2=0x7f29f4104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/647235236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098a0 tx=0x7f29e4009bb0 comp rx=0 tx=0).stop 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- 172.21.15.113:0/647235236 shutdown_connections 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/647235236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f4104f30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- 172.21.15.113:0/647235236 >> 172.21.15.113:0/647235236 conn(0x7f29f41006f0 msgr2=0x7f29f4102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- 172.21.15.113:0/647235236 shutdown_connections 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- 172.21.15.113:0/647235236 wait complete. 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 Processor -- start 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- start start 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29fb9bb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f29f41064e0 con 0x7f29f4104b10 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58304/0 (socket says 172.21.15.113:58304) 2024-04-19T22:35:58.093 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 -- 172.21.15.113:0/1074013347 learned_addr learned my addr 172.21.15.113:0/1074013347 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 -- 172.21.15.113:0/1074013347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f419c870 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.918+0000 7f29f9757700 1 --2- 172.21.15.113:0/1074013347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29e4011a10 tx=0x7f29e4011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4003aa0 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f419cb00 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f29e401a8e0 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4024900 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f419f7f0 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 12) ==== 46265+0+0 (secure 0 0 0) 0x7f29e4022020 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f4063890 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 --2- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 0x7f29e003b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f29e404d930 con 0x7f29f4104b10 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29f8f56700 1 --2- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 0x7f29e003b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:35:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.922+0000 7f29f8f56700 1 --2- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 0x7f29e003b4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006fd0 tx=0x7f29f0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:56.926+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f29e40212c0 con 0x7f29f4104b10 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.294+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f29f402dc40 con 0x7f29e0039010 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29ea7fc700 1 -- 172.21.15.113:0/1074013347 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f29f402dc40 con 0x7f29e0039010 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 msgr2=0x7f29e003b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 0x7f29e003b4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006fd0 tx=0x7f29f0006e40 comp rx=0 tx=0).stop 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 msgr2=0x7f29f419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/1074013347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29e4011a10 tx=0x7f29e4011af0 comp rx=0 tx=0).stop 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 shutdown_connections 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/1074013347 >> v2:172.21.15.113:6800/467518466 conn(0x7f29e0039010 0x7f29e003b4d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 --2- 172.21.15.113:0/1074013347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f29f4104b10 0x7f29f419c330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 >> 172.21.15.113:0/1074013347 conn(0x7f29f41006f0 msgr2=0x7f29f4192f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 shutdown_connections 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:57.418+0000 7f29fb9bb700 1 -- 172.21.15.113:0/1074013347 wait complete. 2024-04-19T22:35:58.095 INFO:teuthology.orchestra.run.smithi113.stdout:Creating initial admin user... 2024-04-19T22:35:58.747 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:58 smithi113 bash[21528]: audit 2024-04-19T22:35:57.300289+0000 mgr.y (mgr.14152) 7 : audit 0 from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:35:58.747 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:58 smithi113 bash[21528]: audit 2024-04-19T22:35:57.416647+0000 mon.a (mon.0) 89 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:35:58.747 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:35:58 smithi113 bash[21528]: audit 2024-04-19T22:35:57.422225+0000 mon.a (mon.0) 90 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:00.260 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aEy0/9KtM96/mnZs4mFoqOgT4UWTy3VNLOplSMFD6gvPG8LzO9Sxq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713566159, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-19T22:36:00.260 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63cbfc700 1 Processor -- start 2024-04-19T22:36:00.261 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63cbfc700 1 -- start start 2024-04-19T22:36:00.261 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63cbfc700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:00.261 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63cbfc700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff638108e40 con 0x7ff638108450 2024-04-19T22:36:00.261 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63659c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:00.263 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63659c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33366/0 (socket says 172.21.15.113:33366) 2024-04-19T22:36:00.263 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63659c700 1 -- 172.21.15.113:0/2722315349 learned_addr learned my addr 172.21.15.113:0/2722315349 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:00.263 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.934+0000 7ff63659c700 1 -- 172.21.15.113:0/2722315349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff638109650 con 0x7ff638108450 2024-04-19T22:36:00.263 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 --2- 172.21.15.113:0/2722315349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6280098a0 tx=0x7ff628009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c51d0218d29ba12 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:00.263 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff635d9b700 1 -- 172.21.15.113:0/2722315349 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff628004160 con 0x7ff638108450 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff635d9b700 1 -- 172.21.15.113:0/2722315349 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff628004300 con 0x7ff638108450 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff635d9b700 1 -- 172.21.15.113:0/2722315349 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff628011a00 con 0x7ff638108450 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/2722315349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 msgr2=0x7ff638108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/2722315349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6280098a0 tx=0x7ff628009bb0 comp rx=0 tx=0).stop 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/2722315349 shutdown_connections 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/2722315349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff638108870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/2722315349 >> 172.21.15.113:0/2722315349 conn(0x7ff638103d50 msgr2=0x7ff638106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/2722315349 shutdown_connections 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/2722315349 wait complete. 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 Processor -- start 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- start start 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff63810ca00 con 0x7ff638108450 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:00.264 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33372/0 (socket says 172.21.15.113:33372) 2024-04-19T22:36:00.267 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 -- 172.21.15.113:0/1759121584 learned_addr learned my addr 172.21.15.113:0/1759121584 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 -- 172.21.15.113:0/1759121584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63819c8c0 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63659c700 1 --2- 172.21.15.113:0/1759121584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff628009fb0 tx=0x7ff628011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff628003aa0 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63819cb50 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff62801a8e0 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff628024930 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63819f840 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 12) ==== 46265+0+0 (secure 0 0 0) 0x7ff628022020 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff638063890 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.938+0000 7ff62f7fe700 1 --2- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 0x7ff62403b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.942+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7ff62804da40 con 0x7ff638108450 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.942+0000 7ff62ffff700 1 --2- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 0x7ff62403b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:00.268 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.942+0000 7ff62ffff700 1 --2- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 0x7ff62403b4d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff620006fd0 tx=0x7ff620006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:58.946+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff62800b3e0 con 0x7ff638108450 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.330+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff638105f00 con 0x7ff624039010 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.618+0000 7ff62f7fe700 1 -- 172.21.15.113:0/1759121584 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff638105f00 con 0x7ff624039010 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 msgr2=0x7ff62403b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 0x7ff62403b4d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff620006fd0 tx=0x7ff620006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 msgr2=0x7ff63819c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/1759121584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff628009fb0 tx=0x7ff628011ac0 comp rx=0 tx=0).stop 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 shutdown_connections 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/1759121584 >> v2:172.21.15.113:6800/467518466 conn(0x7ff624039010 0x7ff62403b4d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 --2- 172.21.15.113:0/1759121584 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff638108450 0x7ff63819c380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 >> 172.21.15.113:0/1759121584 conn(0x7ff638103d50 msgr2=0x7ff6381057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 shutdown_connections 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:35:59.622+0000 7ff63cbfc700 1 -- 172.21.15.113:0/1759121584 wait complete. 2024-04-19T22:36:00.269 INFO:teuthology.orchestra.run.smithi113.stdout:Fetching dashboard port number... 2024-04-19T22:36:00.914 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:00 smithi113 bash[21528]: audit 2024-04-19T22:35:59.338939+0000 mgr.y (mgr.14152) 8 : audit 0 from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:36:00.914 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:00 smithi113 bash[21528]: audit 2024-04-19T22:35:59.618183+0000 mon.a (mon.0) 91 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:01.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:01 smithi113 bash[21528]: cluster 2024-04-19T22:36:00.624664+0000 mon.a (mon.0) 92 : cluster 0 mgrmap e13: y(active, since 6s) 2024-04-19T22:36:01.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:01 smithi113 bash[21528]: audit 2024-04-19T22:36:01.352150+0000 mon.a (mon.0) 93 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:01.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:01 smithi113 bash[21528]: audit 2024-04-19T22:36:01.502197+0000 mon.a (mon.0) 94 : audit 0 from='client.? 172.21.15.113:0/921746785' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-19T22:36:02.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stdout 8443 2024-04-19T22:36:02.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.106+0000 7f509a93a700 1 Processor -- start 2024-04-19T22:36:02.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- start start 2024-04-19T22:36:02.206 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5094106ce0 con 0x7f50941062f0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33384/0 (socket says 172.21.15.113:33384) 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 -- 172.21.15.113:0/961645941 learned_addr learned my addr 172.21.15.113:0/961645941 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 -- 172.21.15.113:0/961645941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50941074f0 con 0x7f50941062f0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 --2- 172.21.15.113:0/961645941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50840098a0 tx=0x7f5084009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865c5133943f28c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5092ffd700 1 -- 172.21.15.113:0/961645941 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084004160 con 0x7f50941062f0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5092ffd700 1 -- 172.21.15.113:0/961645941 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5084004300 con 0x7f50941062f0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5092ffd700 1 -- 172.21.15.113:0/961645941 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084011a00 con 0x7f50941062f0 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- 172.21.15.113:0/961645941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 msgr2=0x7f5094106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 --2- 172.21.15.113:0/961645941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50840098a0 tx=0x7f5084009bb0 comp rx=0 tx=0).stop 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- 172.21.15.113:0/961645941 shutdown_connections 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 --2- 172.21.15.113:0/961645941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f5094106710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:02.207 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- 172.21.15.113:0/961645941 >> 172.21.15.113:0/961645941 conn(0x7f50941018b0 msgr2=0x7f5094103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- 172.21.15.113:0/961645941 shutdown_connections 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- 172.21.15.113:0/961645941 wait complete. 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 Processor -- start 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- start start 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f509a93a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f509410a8a0 con 0x7f50941062f0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33394/0 (socket says 172.21.15.113:33394) 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 -- 172.21.15.113:0/921746785 learned_addr learned my addr 172.21.15.113:0/921746785 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.110+0000 7f5093fff700 1 -- 172.21.15.113:0/921746785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509407c1d0 con 0x7f50941062f0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f5093fff700 1 --2- 172.21.15.113:0/921746785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5084009870 tx=0x7f5084011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50840039e0 con 0x7f50941062f0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f508401a8e0 con 0x7f50941062f0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509407a3c0 con 0x7f50941062f0 2024-04-19T22:36:02.208 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5084024890 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509407a900 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f5084022020 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509410aa20 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 --2- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 0x7f507c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f508404d830 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50937fe700 1 --2- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 0x7f507c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.114+0000 7f50937fe700 1 --2- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 0x7f507c03b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.118+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5084004300 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.494+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f509407ae00 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f50917fa700 1 -- 172.21.15.113:0/921746785 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f508401ad70 con 0x7f50941062f0 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 msgr2=0x7f507c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 --2- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 0x7f507c03b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 msgr2=0x7f509407bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:02.209 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 --2- 172.21.15.113:0/921746785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5084009870 tx=0x7f5084011ac0 comp rx=0 tx=0).stop 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 shutdown_connections 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 --2- 172.21.15.113:0/921746785 >> v2:172.21.15.113:6800/467518466 conn(0x7f507c039150 0x7f507c03b610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 --2- 172.21.15.113:0/921746785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50941062f0 0x7f509407bc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 >> 172.21.15.113:0/921746785 conn(0x7f50941018b0 msgr2=0x7f5094102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 shutdown_connections 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:01.498+0000 7f509a93a700 1 -- 172.21.15.113:0/921746785 wait complete. 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:firewalld does not appear to be present 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout:Ceph Dashboard is now available at: 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout: URL: https://smithi113.front.sepia.ceph.com:8443/ 2024-04-19T22:36:02.210 INFO:teuthology.orchestra.run.smithi113.stdout: User: admin 2024-04-19T22:36:02.211 INFO:teuthology.orchestra.run.smithi113.stdout: Password: h3r06hjcdu 2024-04-19T22:36:02.211 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:02.211 INFO:teuthology.orchestra.run.smithi113.stdout:Saving cluster configuration to /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config directory 2024-04-19T22:36:02.211 INFO:teuthology.orchestra.run.smithi113.stdout:Enabling autotune for osd_memory_target 2024-04-19T22:36:03.642 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:03 smithi113 bash[21528]: audit 2024-04-19T22:36:02.337634+0000 mon.a (mon.0) 95 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:04.046 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 Processor -- start 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- start start 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c108e20 con 0x7ff53c108430 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff54170f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff54170f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33402/0 (socket says 172.21.15.113:33402) 2024-04-19T22:36:04.047 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff54170f700 1 -- 172.21.15.113:0/3979892443 learned_addr learned my addr 172.21.15.113:0/3979892443 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff54170f700 1 -- 172.21.15.113:0/3979892443 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c109630 con 0x7ff53c108430 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff54170f700 1 --2- 172.21.15.113:0/3979892443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff5380098a0 tx=0x7ff538009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc51f69c60e733b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff533fff700 1 -- 172.21.15.113:0/3979892443 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff538004160 con 0x7ff53c108430 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff533fff700 1 -- 172.21.15.113:0/3979892443 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff538004300 con 0x7ff53c108430 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff533fff700 1 -- 172.21.15.113:0/3979892443 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff538011a00 con 0x7ff53c108430 2024-04-19T22:36:04.048 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- 172.21.15.113:0/3979892443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 msgr2=0x7ff53c108850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:04.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 --2- 172.21.15.113:0/3979892443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff5380098a0 tx=0x7ff538009bb0 comp rx=0 tx=0).stop 2024-04-19T22:36:04.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- 172.21.15.113:0/3979892443 shutdown_connections 2024-04-19T22:36:04.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 --2- 172.21.15.113:0/3979892443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c108850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:04.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- 172.21.15.113:0/3979892443 >> 172.21.15.113:0/3979892443 conn(0x7ff53c07b8d0 msgr2=0x7ff53c1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:04.049 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- 172.21.15.113:0/3979892443 shutdown_connections 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.054+0000 7ff543973700 1 -- 172.21.15.113:0/3979892443 wait complete. 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 Processor -- start 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 -- start start 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c10c9e0 con 0x7ff53c108430 2024-04-19T22:36:04.050 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff54170f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:04.051 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff54170f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33412/0 (socket says 172.21.15.113:33412) 2024-04-19T22:36:04.051 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff54170f700 1 -- 172.21.15.113:0/3446513177 learned_addr learned my addr 172.21.15.113:0/3446513177 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:04.051 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff54170f700 1 -- 172.21.15.113:0/3446513177 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c19c8c0 con 0x7ff53c108430 2024-04-19T22:36:04.051 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff54170f700 1 --2- 172.21.15.113:0/3446513177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff538009fb0 tx=0x7ff538011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:04.051 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff538003aa0 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff53801a8e0 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff538024930 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c19cb50 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c19f840 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7ff538022020 con 0x7ff53c108430 2024-04-19T22:36:04.052 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c063890 con 0x7ff53c108430 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 --2- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 0x7ff52803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7ff53804d4e0 con 0x7ff53c108430 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff540f0e700 1 --2- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 0x7ff52803b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.058+0000 7ff540f0e700 1 --2- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 0x7ff52803b5c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006fd0 tx=0x7ff52c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.062+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff5380212c0 con 0x7ff53c108430 2024-04-19T22:36:04.053 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.426+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff53c19fc90 con 0x7ff53c108430 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.426+0000 7ff5327fc700 1 -- 172.21.15.113:0/3446513177 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff53802d3f0 con 0x7ff53c108430 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 msgr2=0x7ff52803b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 --2- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 0x7ff52803b5c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006fd0 tx=0x7ff52c006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 msgr2=0x7ff53c19c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 --2- 172.21.15.113:0/3446513177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff538009fb0 tx=0x7ff538011ac0 comp rx=0 tx=0).stop 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 shutdown_connections 2024-04-19T22:36:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 --2- 172.21.15.113:0/3446513177 >> v2:172.21.15.113:6800/467518466 conn(0x7ff528039100 0x7ff52803b5c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:04.055 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 --2- 172.21.15.113:0/3446513177 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53c108430 0x7ff53c19c380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:04.055 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 >> 172.21.15.113:0/3446513177 conn(0x7ff53c07b8d0 msgr2=0x7ff53c105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:04.055 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 shutdown_connections 2024-04-19T22:36:04.055 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:03.430+0000 7ff543973700 1 -- 172.21.15.113:0/3446513177 wait complete. 2024-04-19T22:36:06.065 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 Processor -- start 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- start start 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f32c8108e10 con 0x7f32c8108420 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33416/0 (socket says 172.21.15.113:33416) 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 -- 172.21.15.113:0/3242840309 learned_addr learned my addr 172.21.15.113:0/3242840309 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 -- 172.21.15.113:0/3242840309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c8109620 con 0x7f32c8108420 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- 172.21.15.113:0/3242840309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098a0 tx=0x7f32c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ce204f2854275 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32bffff700 1 -- 172.21.15.113:0/3242840309 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c4004160 con 0x7f32c8108420 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32bffff700 1 -- 172.21.15.113:0/3242840309 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f32c4004300 con 0x7f32c8108420 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32bffff700 1 -- 172.21.15.113:0/3242840309 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c4011a00 con 0x7f32c8108420 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/3242840309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 msgr2=0x7f32c8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:06.066 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 --2- 172.21.15.113:0/3242840309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098a0 tx=0x7f32c4009bb0 comp rx=0 tx=0).stop 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/3242840309 shutdown_connections 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 --2- 172.21.15.113:0/3242840309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c8108840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/3242840309 >> 172.21.15.113:0/3242840309 conn(0x7f32c807b7d0 msgr2=0x7f32c807bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/3242840309 shutdown_connections 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/3242840309 wait complete. 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 Processor -- start 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- start start 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f32c810c9d0 con 0x7f32c8108420 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33424/0 (socket says 172.21.15.113:33424) 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 -- 172.21.15.113:0/140412223 learned_addr learned my addr 172.21.15.113:0/140412223 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 -- 172.21.15.113:0/140412223 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c819c8b0 con 0x7f32c8108420 2024-04-19T22:36:06.067 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cd71c700 1 --2- 172.21.15.113:0/140412223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009fb0 tx=0x7f32c4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c4003aa0 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f32c401a8e0 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c4024930 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/140412223 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c819cb40 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32cf980700 1 -- 172.21.15.113:0/140412223 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c819f830 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.906+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f32c4022020 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.910+0000 7f32be7fc700 1 --2- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 0x7f32b403b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.910+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f32c404dd60 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.910+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a8005120 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.910+0000 7f32ccf1b700 1 --2- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 0x7f32b403b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.910+0000 7f32ccf1b700 1 --2- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 0x7f32b403b570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:04.914+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f32c40212c0 con 0x7f32c8108420 2024-04-19T22:36:06.068 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.486+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f32a8005410 con 0x7f32c8108420 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.486+0000 7f32be7fc700 1 -- 172.21.15.113:0/140412223 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f32c4031020 con 0x7f32c8108420 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 msgr2=0x7f32b403b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 --2- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 0x7f32b403b570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 msgr2=0x7f32c819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 --2- 172.21.15.113:0/140412223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009fb0 tx=0x7f32c4011ac0 comp rx=0 tx=0).stop 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 shutdown_connections 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 --2- 172.21.15.113:0/140412223 >> v2:172.21.15.113:6800/467518466 conn(0x7f32b40390b0 0x7f32b403b570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 --2- 172.21.15.113:0/140412223 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f32c8108420 0x7f32c819c370 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 >> 172.21.15.113:0/140412223 conn(0x7f32c807b7d0 msgr2=0x7f32c8105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 shutdown_connections 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr 2024-04-19T22:36:05.490+0000 7f32b3fff700 1 -- 172.21.15.113:0/140412223 wait complete. 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-19T22:36:06.069 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: sudo /usr/sbin/cephadm shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout:Or, if you are only running a single cluster on this host: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: sudo /usr/sbin/cephadm shell 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: ceph telemetry on 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout:For more information see: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:06.070 INFO:teuthology.orchestra.run.smithi113.stdout:Bootstrap complete. 2024-04-19T22:36:06.106 INFO:tasks.cephadm:Fetching config... 2024-04-19T22:36:06.106 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:36:06.107 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-19T22:36:06.153 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-19T22:36:06.153 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:36:06.154 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-19T22:36:06.204 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-19T22:36:06.205 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:36:06.205 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-19T22:36:06.260 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-19T22:36:06.260 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:36:06.261 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-19T22:36:06.309 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-19T22:36:06.309 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBZCRXIvy3M3jlZL7LY2jGrKN9UlPqBBFyU3KiSAuyvUo7QIhe0j/H5TzL/UhRPKjjqbuw3+PbiWHbQ8TWG8DpXdswx4rQ2ObZ4pKbsItHsy4sewYTF0v+/VhhbwOfNF2wQb9yvSAmGAa1SWHYnNpfyJZLn4v3XxwuEw+J7W0kxhr+4A3CIBS06jHJQUFf0Iz/mvtvf3fbL6CKrpOoy1E47Br6/pqIUgYJnSTZoIUGa5i8oChCNl9LDeheA7/3qScnNvl8FyCTcp1+7xncmWI7SJL8hOdHtVsPUW8qYq2++iz8WAOgmZX4WqziTO65HpqMgWuWYy3sIdM1o2jUcMKN9G2XSRN1TPv8JP0m3FpFtV/zH82KKC18Vq5SOcBa8EPKkOzGgAF5MBlcF8jDKbcGLV45iZkhKEM3NUMQ3oHTsVvcwZcc8swhWi2siOgOmhaBxJKmijH7YCS76Kc5+Po2VHlw60E8se35Swzof40N3xz6Q1BzTmOpilxzA19c5Uc= ceph-dd3df874-fe9c-11ee-bc92-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-19T22:36:06.377 INFO:teuthology.orchestra.run.smithi113.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBZCRXIvy3M3jlZL7LY2jGrKN9UlPqBBFyU3KiSAuyvUo7QIhe0j/H5TzL/UhRPKjjqbuw3+PbiWHbQ8TWG8DpXdswx4rQ2ObZ4pKbsItHsy4sewYTF0v+/VhhbwOfNF2wQb9yvSAmGAa1SWHYnNpfyJZLn4v3XxwuEw+J7W0kxhr+4A3CIBS06jHJQUFf0Iz/mvtvf3fbL6CKrpOoy1E47Br6/pqIUgYJnSTZoIUGa5i8oChCNl9LDeheA7/3qScnNvl8FyCTcp1+7xncmWI7SJL8hOdHtVsPUW8qYq2++iz8WAOgmZX4WqziTO65HpqMgWuWYy3sIdM1o2jUcMKN9G2XSRN1TPv8JP0m3FpFtV/zH82KKC18Vq5SOcBa8EPKkOzGgAF5MBlcF8jDKbcGLV45iZkhKEM3NUMQ3oHTsVvcwZcc8swhWi2siOgOmhaBxJKmijH7YCS76Kc5+Po2VHlw60E8se35Swzof40N3xz6Q1BzTmOpilxzA19c5Uc= ceph-dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:36:06.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBZCRXIvy3M3jlZL7LY2jGrKN9UlPqBBFyU3KiSAuyvUo7QIhe0j/H5TzL/UhRPKjjqbuw3+PbiWHbQ8TWG8DpXdswx4rQ2ObZ4pKbsItHsy4sewYTF0v+/VhhbwOfNF2wQb9yvSAmGAa1SWHYnNpfyJZLn4v3XxwuEw+J7W0kxhr+4A3CIBS06jHJQUFf0Iz/mvtvf3fbL6CKrpOoy1E47Br6/pqIUgYJnSTZoIUGa5i8oChCNl9LDeheA7/3qScnNvl8FyCTcp1+7xncmWI7SJL8hOdHtVsPUW8qYq2++iz8WAOgmZX4WqziTO65HpqMgWuWYy3sIdM1o2jUcMKN9G2XSRN1TPv8JP0m3FpFtV/zH82KKC18Vq5SOcBa8EPKkOzGgAF5MBlcF8jDKbcGLV45iZkhKEM3NUMQ3oHTsVvcwZcc8swhWi2siOgOmhaBxJKmijH7YCS76Kc5+Po2VHlw60E8se35Swzof40N3xz6Q1BzTmOpilxzA19c5Uc= ceph-dd3df874-fe9c-11ee-bc92-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-19T22:36:06.411 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBZCRXIvy3M3jlZL7LY2jGrKN9UlPqBBFyU3KiSAuyvUo7QIhe0j/H5TzL/UhRPKjjqbuw3+PbiWHbQ8TWG8DpXdswx4rQ2ObZ4pKbsItHsy4sewYTF0v+/VhhbwOfNF2wQb9yvSAmGAa1SWHYnNpfyJZLn4v3XxwuEw+J7W0kxhr+4A3CIBS06jHJQUFf0Iz/mvtvf3fbL6CKrpOoy1E47Br6/pqIUgYJnSTZoIUGa5i8oChCNl9LDeheA7/3qScnNvl8FyCTcp1+7xncmWI7SJL8hOdHtVsPUW8qYq2++iz8WAOgmZX4WqziTO65HpqMgWuWYy3sIdM1o2jUcMKN9G2XSRN1TPv8JP0m3FpFtV/zH82KKC18Vq5SOcBa8EPKkOzGgAF5MBlcF8jDKbcGLV45iZkhKEM3NUMQ3oHTsVvcwZcc8swhWi2siOgOmhaBxJKmijH7YCS76Kc5+Po2VHlw60E8se35Swzof40N3xz6Q1BzTmOpilxzA19c5Uc= ceph-dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:36:06.421 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-19T22:36:06.789 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:06 smithi113 bash[21528]: audit 2024-04-19T22:36:05.489997+0000 mon.a (mon.0) 96 : audit 1 from='client.? 172.21.15.113:0/140412223' entity='client.admin' 2024-04-19T22:36:11.062 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:36:14.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- 172.21.15.113:0/2510985330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 msgr2=0x7fcce80746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:14.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 --2- 172.21.15.113:0/2510985330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce80746c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcce000b0a0 tx=0x7fcce000b3b0 comp rx=0 tx=0).stop 2024-04-19T22:36:14.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- 172.21.15.113:0/2510985330 shutdown_connections 2024-04-19T22:36:14.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 --2- 172.21.15.113:0/2510985330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce80746c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- 172.21.15.113:0/2510985330 >> 172.21.15.113:0/2510985330 conn(0x7fcce80fd250 msgr2=0x7fcce80ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- 172.21.15.113:0/2510985330 shutdown_connections 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- 172.21.15.113:0/2510985330 wait complete. 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 Processor -- start 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- start start 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcced1fc700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81095d0 con 0x7fcce8076260 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcce6d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcce6d9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59648/0 (socket says 172.21.15.113:59648) 2024-04-19T22:36:14.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.178+0000 7fcce6d9d700 1 -- 172.21.15.113:0/26660107 learned_addr learned my addr 172.21.15.113:0/26660107 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcce6d9d700 1 -- 172.21.15.113:0/26660107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce81991f0 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcce6d9d700 1 --2- 172.21.15.113:0/26660107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcce0015040 tx=0x7fcce000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce0017040 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcce0022070 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce001d440 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcced1fc700 1 -- 172.21.15.113:0/26660107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce8199480 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcced1fc700 1 -- 172.21.15.113:0/26660107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce819c170 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7fcce0004040 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc005120 con 0x7fcce8076260 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 --2- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 0x7fccd403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:14.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fcce000f050 con 0x7fcce8076260 2024-04-19T22:36:14.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcce659c700 1 --2- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 0x7fccd403b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:14.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.182+0000 7fcce659c700 1 --2- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 0x7fccd403b5c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:14.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.186+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fcce001b3f0 con 0x7fcce8076260 2024-04-19T22:36:14.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.398+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fcccc005410 con 0x7fcce8076260 2024-04-19T22:36:14.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.402+0000 7fccdffff700 1 -- 172.21.15.113:0/26660107 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fcce001ce80 con 0x7fcce8076260 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 msgr2=0x7fccd403b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 --2- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 0x7fccd403b5c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 msgr2=0x7fcce8198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 --2- 172.21.15.113:0/26660107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcce0015040 tx=0x7fcce000bd40 comp rx=0 tx=0).stop 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 shutdown_connections 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 --2- 172.21.15.113:0/26660107 >> v2:172.21.15.113:6800/467518466 conn(0x7fccd4039100 0x7fccd403b5c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 --2- 172.21.15.113:0/26660107 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcce8076260 0x7fcce8198cb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 >> 172.21.15.113:0/26660107 conn(0x7fcce80fd250 msgr2=0x7fcce80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 shutdown_connections 2024-04-19T22:36:14.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:14.406+0000 7fccddffb700 1 -- 172.21.15.113:0/26660107 wait complete. 2024-04-19T22:36:15.106 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-19T22:36:15.106 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-19T22:36:15.289 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:13.984276+0000 mon.a (mon.0) 97 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:13.989244+0000 mon.a (mon.0) 98 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:13.990643+0000 mon.a (mon.0) 99 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi113", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:13.995703+0000 mon.a (mon.0) 100 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:14.030198+0000 mon.a (mon.0) 101 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:14.035313+0000 mon.a (mon.0) 102 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:14.404307+0000 mon.a (mon.0) 103 : audit 1 from='client.? 172.21.15.113:0/26660107' entity='client.admin' 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:14.432988+0000 mon.a (mon.0) 104 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:36:15.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:14 smithi113 bash[21528]: audit 2024-04-19T22:36:14.437561+0000 mon.a (mon.0) 105 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:16.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:16 smithi113 bash[21528]: cluster 2024-04-19T22:36:14.244330+0000 mgr.y (mgr.14152) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:18.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:18 smithi113 bash[21528]: cluster 2024-04-19T22:36:16.244803+0000 mgr.y (mgr.14152) 10 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:19.816 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:36:20.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:20 smithi113 bash[21528]: cluster 2024-04-19T22:36:18.245231+0000 mgr.y (mgr.14152) 11 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:22.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:22 smithi113 bash[21528]: cluster 2024-04-19T22:36:20.245579+0000 mgr.y (mgr.14152) 12 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:22.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- 172.21.15.113:0/2333225866 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 msgr2=0x7f9864104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:22.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 --2- 172.21.15.113:0/2333225866 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864104b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9854009910 tx=0x7f9854009c20 comp rx=0 tx=0).stop 2024-04-19T22:36:22.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- 172.21.15.113:0/2333225866 shutdown_connections 2024-04-19T22:36:22.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 --2- 172.21.15.113:0/2333225866 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864104b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:22.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- 172.21.15.113:0/2333225866 >> 172.21.15.113:0/2333225866 conn(0x7f98640fc1a0 msgr2=0x7f98640fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- 172.21.15.113:0/2333225866 shutdown_connections 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- 172.21.15.113:0/2333225866 wait complete. 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 Processor -- start 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- start start 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f986bdd4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9864107370 con 0x7f9864102790 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f9869b70700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f9869b70700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:50156/0 (socket says 172.21.15.113:50156) 2024-04-19T22:36:22.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f9869b70700 1 -- 172.21.15.113:0/3552455308 learned_addr learned my addr 172.21.15.113:0/3552455308 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.333+0000 7f9869b70700 1 -- 172.21.15.113:0/3552455308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9864196f60 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f9869b70700 1 --2- 172.21.15.113:0/3552455308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9854005950 tx=0x7f9854009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9854027070 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f9854022470 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9864197250 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985400f5f0 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9864199ee0 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f985402a070 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9864107af0 con 0x7f9864102790 2024-04-19T22:36:22.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 --2- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 0x7f985003b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f985401e030 con 0x7f9864102790 2024-04-19T22:36:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f986936f700 1 --2- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 0x7f985003b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:22.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.337+0000 7f986936f700 1 --2- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 0x7f985003b570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:22.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.341+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f9854013070 con 0x7f9864102790 2024-04-19T22:36:22.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.553+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f9864062670 con 0x7f98500390b0 2024-04-19T22:36:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f985affd700 1 -- 172.21.15.113:0/3552455308 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9864062670 con 0x7f98500390b0 2024-04-19T22:36:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 msgr2=0x7f985003b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 --2- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 0x7f985003b570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 msgr2=0x7f9864196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 --2- 172.21.15.113:0/3552455308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9854005950 tx=0x7f9854009e80 comp rx=0 tx=0).stop 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 shutdown_connections 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 --2- 172.21.15.113:0/3552455308 >> v2:172.21.15.113:6800/467518466 conn(0x7f98500390b0 0x7f985003b570 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 --2- 172.21.15.113:0/3552455308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9864102790 0x7f9864196a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 >> 172.21.15.113:0/3552455308 conn(0x7f98640fc1a0 msgr2=0x7f98640fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 shutdown_connections 2024-04-19T22:36:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:22.557+0000 7f986bdd4700 1 -- 172.21.15.113:0/3552455308 wait complete. 2024-04-19T22:36:23.287 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2024-04-19T22:36:23.287 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:36:23.287 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2024-04-19T22:36:23.293 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:36:23.294 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:36:23.339 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2024-04-19T22:36:23.339 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch host add smithi178 2024-04-19T22:36:24.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: cluster 2024-04-19T22:36:22.245894+0000 mgr.y (mgr.14152) 13 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:22.556088+0000 mgr.y (mgr.14152) 14 : audit 0 from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:22.558920+0000 mon.a (mon.0) 106 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:22.588205+0000 mon.a (mon.0) 107 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:22.589549+0000 mon.a (mon.0) 108 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:22.590155+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: cephadm 2024-04-19T22:36:22.591118+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: cephadm 2024-04-19T22:36:22.705216+0000 mgr.y (mgr.14152) 16 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: cephadm 2024-04-19T22:36:22.819598+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi113:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: cephadm 2024-04-19T22:36:22.934002+0000 mgr.y (mgr.14152) 18 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:23.102518+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:23.106127+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:24.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:23 smithi113 bash[21528]: audit 2024-04-19T22:36:23.109978+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:26.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:25 smithi113 bash[21528]: cluster 2024-04-19T22:36:24.246253+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:28.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:27 smithi113 bash[21528]: cluster 2024-04-19T22:36:26.246719+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:28.050 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:36:30.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:29 smithi113 bash[21528]: cluster 2024-04-19T22:36:28.247151+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- 172.21.15.113:0/3128592364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 msgr2=0x7fc420104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 --2- 172.21.15.113:0/3128592364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc420104460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009910 tx=0x7fc41c009c20 comp rx=0 tx=0).stop 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- 172.21.15.113:0/3128592364 shutdown_connections 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 --2- 172.21.15.113:0/3128592364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc420104460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- 172.21.15.113:0/3128592364 >> 172.21.15.113:0/3128592364 conn(0x7fc4200ff950 msgr2=0x7fc420101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- 172.21.15.113:0/3128592364 shutdown_connections 2024-04-19T22:36:30.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- 172.21.15.113:0/3128592364 wait complete. 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 Processor -- start 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- start start 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc427bed700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc42010db00 con 0x7fc420104080 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc425989700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc425989700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52532/0 (socket says 172.21.15.113:52532) 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.445+0000 7fc425989700 1 -- 172.21.15.113:0/1515973203 learned_addr learned my addr 172.21.15.113:0/1515973203 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc425989700 1 -- 172.21.15.113:0/1515973203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc420199610 con 0x7fc420104080 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc425989700 1 --2- 172.21.15.113:0/1515973203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc41c006010 tx=0x7fc41c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:30.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc41c026070 con 0x7fc420104080 2024-04-19T22:36:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc41c00bba0 con 0x7fc420104080 2024-04-19T22:36:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc41c0037d0 con 0x7fc420104080 2024-04-19T22:36:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc420199900 con 0x7fc420104080 2024-04-19T22:36:30.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42019d950 con 0x7fc420104080 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7fc41c00b740 con 0x7fc420104080 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc420105560 con 0x7fc420104080 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 --2- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 0x7fc40c03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7fc41c01e070 con 0x7fc420104080 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc425188700 1 --2- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 0x7fc40c03b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:30.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.449+0000 7fc425188700 1 --2- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 0x7fc40c03b5c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc410006fd0 tx=0x7fc410006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:30.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.453+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc41c013070 con 0x7fc420104080 2024-04-19T22:36:30.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:30.665+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}) -- 0x7fc42019a3e0 con 0x7fc40c039100 2024-04-19T22:36:32.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:31 smithi113 bash[21528]: cluster 2024-04-19T22:36:30.247592+0000 mgr.y (mgr.14152) 22 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:32.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:31 smithi113 bash[21528]: audit 2024-04-19T22:36:30.667979+0000 mgr.y (mgr.14152) 23 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:36:33.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:32 smithi113 bash[21528]: cephadm 2024-04-19T22:36:31.376206+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi178 2024-04-19T22:36:34.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:33 smithi113 bash[21528]: cluster 2024-04-19T22:36:32.248043+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:36.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:35 smithi113 bash[21528]: cluster 2024-04-19T22:36:34.248437+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:36.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.537+0000 7fc416ffd700 1 -- 172.21.15.113:0/1515973203 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc42019a3e0 con 0x7fc40c039100 2024-04-19T22:36:36.532 INFO:teuthology.orchestra.run.smithi113.stdout:Added host 'smithi178' with addr '172.21.15.178' 2024-04-19T22:36:36.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 msgr2=0x7fc40c03b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:36.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 --2- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 0x7fc40c03b5c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc410006fd0 tx=0x7fc410006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 msgr2=0x7fc4201990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 --2- 172.21.15.113:0/1515973203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc41c006010 tx=0x7fc41c005030 comp rx=0 tx=0).stop 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 shutdown_connections 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 --2- 172.21.15.113:0/1515973203 >> v2:172.21.15.113:6800/467518466 conn(0x7fc40c039100 0x7fc40c03b5c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 --2- 172.21.15.113:0/1515973203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc420104080 0x7fc4201990d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 >> 172.21.15.113:0/1515973203 conn(0x7fc4200ff950 msgr2=0x7fc42010bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 shutdown_connections 2024-04-19T22:36:36.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:36.541+0000 7fc427bed700 1 -- 172.21.15.113:0/1515973203 wait complete. 2024-04-19T22:36:37.244 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch host ls --format=json 2024-04-19T22:36:37.790 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:37 smithi113 bash[21528]: cluster 2024-04-19T22:36:36.248841+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:37.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:37 smithi113 bash[21528]: audit 2024-04-19T22:36:36.539557+0000 mon.a (mon.0) 113 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:37.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:37 smithi113 bash[21528]: cephadm 2024-04-19T22:36:36.540528+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi178 2024-04-19T22:36:37.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:37 smithi113 bash[21528]: audit 2024-04-19T22:36:36.585280+0000 mon.a (mon.0) 114 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:36:37.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:37 smithi113 bash[21528]: audit 2024-04-19T22:36:37.060148+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:39.790 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:39 smithi113 bash[21528]: cluster 2024-04-19T22:36:38.249271+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:39.790 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:39 smithi113 bash[21528]: audit 2024-04-19T22:36:38.534536+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:41.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:40 smithi113 bash[21528]: audit 2024-04-19T22:36:39.786826+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:41.953 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:36:42.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:41 smithi113 bash[21528]: cluster 2024-04-19T22:36:40.249659+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:44.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:43 smithi113 bash[21528]: cluster 2024-04-19T22:36:42.250141+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:44.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 -- 172.21.15.113:0/4265730284 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 msgr2=0x7f20f4104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:44.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 --2- 172.21.15.113:0/4265730284 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f4104460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009910 tx=0x7f20f0009c20 comp rx=0 tx=0).stop 2024-04-19T22:36:44.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 -- 172.21.15.113:0/4265730284 shutdown_connections 2024-04-19T22:36:44.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 --2- 172.21.15.113:0/4265730284 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f4104460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:44.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 -- 172.21.15.113:0/4265730284 >> 172.21.15.113:0/4265730284 conn(0x7f20f40ff950 msgr2=0x7f20f4101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:44.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 -- 172.21.15.113:0/4265730284 shutdown_connections 2024-04-19T22:36:44.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.381+0000 7f20fb648700 1 -- 172.21.15.113:0/4265730284 wait complete. 2024-04-19T22:36:44.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 Processor -- start 2024-04-19T22:36:44.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 -- start start 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f20f410db00 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f93e4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f93e4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47264/0 (socket says 172.21.15.113:47264) 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f93e4700 1 -- 172.21.15.113:0/1179495595 learned_addr learned my addr 172.21.15.113:0/1179495595 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f93e4700 1 -- 172.21.15.113:0/1179495595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f4199610 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f93e4700 1 --2- 172.21.15.113:0/1179495595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f0004f80 tx=0x7f20f0005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0026070 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f20f000bba0 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f4199900 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0003930 con 0x7f20f4104080 2024-04-19T22:36:44.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f419d950 con 0x7f20f4104080 2024-04-19T22:36:44.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f20f0029070 con 0x7f20f4104080 2024-04-19T22:36:44.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f4105560 con 0x7f20f4104080 2024-04-19T22:36:44.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 --2- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 0x7f20e003b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:44.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f20f001e070 con 0x7f20f4104080 2024-04-19T22:36:44.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f8be3700 1 --2- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 0x7f20e003b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:44.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.385+0000 7f20f8be3700 1 --2- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 0x7f20e003b570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006fd0 tx=0x7f20e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:44.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.393+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f20f0013070 con 0x7f20f4104080 2024-04-19T22:36:44.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.597+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20f419a3e0 con 0x7f20e00390b0 2024-04-19T22:36:44.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20e67fc700 1 -- 172.21.15.113:0/1179495595 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f20f419a3e0 con 0x7f20e00390b0 2024-04-19T22:36:44.594 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:36:44.594 INFO:teuthology.orchestra.run.smithi113.stdout:[{"addr": "172.21.15.113", "hostname": "smithi113", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 msgr2=0x7f20e003b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 --2- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 0x7f20e003b570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006fd0 tx=0x7f20e8006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 msgr2=0x7f20f41990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 --2- 172.21.15.113:0/1179495595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f0004f80 tx=0x7f20f0005060 comp rx=0 tx=0).stop 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 shutdown_connections 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 --2- 172.21.15.113:0/1179495595 >> v2:172.21.15.113:6800/467518466 conn(0x7f20e00390b0 0x7f20e003b570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 --2- 172.21.15.113:0/1179495595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f20f4104080 0x7f20f41990d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 >> 172.21.15.113:0/1179495595 conn(0x7f20f40ff950 msgr2=0x7f20f410bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 shutdown_connections 2024-04-19T22:36:44.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:44.601+0000 7f20fb648700 1 -- 172.21.15.113:0/1179495595 wait complete. 2024-04-19T22:36:45.242 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-19T22:36:45.243 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd crush tunables default 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: cluster 2024-04-19T22:36:44.250443+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.602595+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.974337+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.980167+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.986726+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.992284+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.993853+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.995862+0000 mon.a (mon.0) 123 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:36:46.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:44.997573+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:36:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: cephadm 2024-04-19T22:36:45.000232+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:36:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: cephadm 2024-04-19T22:36:45.216202+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:36:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:45.615372+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:45.620433+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:45 smithi113 bash[21528]: audit 2024-04-19T22:36:45.625759+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:47.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:46 smithi113 bash[21528]: cephadm 2024-04-19T22:36:45.381360+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:36:47.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:46 smithi113 bash[21528]: cephadm 2024-04-19T22:36:45.496192+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:36:48.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:47 smithi113 bash[21528]: cluster 2024-04-19T22:36:46.250758+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:49.952 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:36:50.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:49 smithi113 bash[21528]: cluster 2024-04-19T22:36:48.251187+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:52.263 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:51 smithi113 bash[21528]: cluster 2024-04-19T22:36:50.251622+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:52.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/3228556669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 msgr2=0x7f26d4104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 --2- 172.21.15.113:0/3228556669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d4104460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009910 tx=0x7f26d0009c20 comp rx=0 tx=0).stop 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/3228556669 shutdown_connections 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 --2- 172.21.15.113:0/3228556669 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d4104460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/3228556669 >> 172.21.15.113:0/3228556669 conn(0x7f26d40ff950 msgr2=0x7f26d4101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/3228556669 shutdown_connections 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/3228556669 wait complete. 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 Processor -- start 2024-04-19T22:36:52.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- start start 2024-04-19T22:36:52.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:52.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f26d410db00 con 0x7f26d4104080 2024-04-19T22:36:52.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d95e0700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:52.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d95e0700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44982/0 (socket says 172.21.15.113:44982) 2024-04-19T22:36:52.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d95e0700 1 -- 172.21.15.113:0/1098063437 learned_addr learned my addr 172.21.15.113:0/1098063437 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d95e0700 1 -- 172.21.15.113:0/1098063437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d4199610 con 0x7f26d4104080 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d95e0700 1 --2- 172.21.15.113:0/1098063437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26d0006010 tx=0x7f26d0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d0026070 con 0x7f26d4104080 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f26d000bba0 con 0x7f26d4104080 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d4199900 con 0x7f26d4104080 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d00037d0 con 0x7f26d4104080 2024-04-19T22:36:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d419d950 con 0x7f26d4104080 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f26d0029070 con 0x7f26d4104080 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 --2- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 0x7f26c003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1069+0+0 (secure 0 0 0) 0x7f26d001e070 con 0x7f26d4104080 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.453+0000 7f26d8ddf700 1 --2- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 0x7f26c003b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.457+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d4105560 con 0x7f26d4104080 2024-04-19T22:36:52.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.457+0000 7f26d8ddf700 1 --2- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 0x7f26c003b5c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26c4006fd0 tx=0x7f26c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:52.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.461+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f26d0030020 con 0x7f26d4104080 2024-04-19T22:36:52.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.669+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f26d4063890 con 0x7f26d4104080 2024-04-19T22:36:52.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.989+0000 7f26ca7fc700 1 -- 172.21.15.113:0/1098063437 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f26d0013070 con 0x7f26d4104080 2024-04-19T22:36:52.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 msgr2=0x7f26c003b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:52.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 --2- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 0x7f26c003b5c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26c4006fd0 tx=0x7f26c4006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:52.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 msgr2=0x7f26d41990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 --2- 172.21.15.113:0/1098063437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26d0006010 tx=0x7f26d0005030 comp rx=0 tx=0).stop 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 shutdown_connections 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 --2- 172.21.15.113:0/1098063437 >> v2:172.21.15.113:6800/467518466 conn(0x7f26c0039100 0x7f26c003b5c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 --2- 172.21.15.113:0/1098063437 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26d4104080 0x7f26d41990d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 >> 172.21.15.113:0/1098063437 conn(0x7f26d40ff950 msgr2=0x7f26d410bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 shutdown_connections 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:36:52.993+0000 7f26db844700 1 -- 172.21.15.113:0/1098063437 wait complete. 2024-04-19T22:36:52.989 INFO:teuthology.orchestra.run.smithi113.stderr:adjusted tunables profile to default 2024-04-19T22:36:53.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:52 smithi113 bash[21528]: audit 2024-04-19T22:36:52.674691+0000 mon.a (mon.0) 128 : audit 1 from='client.? 172.21.15.113:0/1098063437' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-19T22:36:53.665 INFO:tasks.cephadm:Adding mon.a on smithi113 2024-04-19T22:36:53.665 INFO:tasks.cephadm:Adding mon.c on smithi113 2024-04-19T22:36:53.665 INFO:tasks.cephadm:Adding mon.b on smithi178 2024-04-19T22:36:53.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply mon '3;smithi113:172.21.15.113=a;smithi113:[v2:172.21.15.113:3301,v1:172.21.15.113:6790]=c;smithi178:172.21.15.178=b' 2024-04-19T22:36:54.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:53 smithi113 bash[21528]: cluster 2024-04-19T22:36:52.252125+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:54.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:53 smithi113 bash[21528]: audit 2024-04-19T22:36:52.993569+0000 mon.a (mon.0) 129 : audit 1 from='client.? 172.21.15.113:0/1098063437' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-19T22:36:54.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:53 smithi113 bash[21528]: cluster 2024-04-19T22:36:52.999603+0000 mon.a (mon.0) 130 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:36:54.878 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:36:56.290 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:55 smithi113 bash[21528]: cluster 2024-04-19T22:36:54.252580+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- 172.21.15.178:0/2952530385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 msgr2=0x7f2d0c074a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 --2- 172.21.15.178:0/2952530385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c074a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009910 tx=0x7f2d00009c20 comp rx=0 tx=0).stop 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- 172.21.15.178:0/2952530385 shutdown_connections 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 --2- 172.21.15.178:0/2952530385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c074a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- 172.21.15.178:0/2952530385 >> 172.21.15.178:0/2952530385 conn(0x7f2d0c0fd750 msgr2=0x7f2d0c0ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- 172.21.15.178:0/2952530385 shutdown_connections 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- 172.21.15.178:0/2952530385 wait complete. 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 Processor -- start 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 -- start start 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.909+0000 7f2d1418a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:56.908 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d1418a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c10db80 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11f26700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11f26700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.178:50960/0 (socket says 172.21.15.178:50960) 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11f26700 1 -- 172.21.15.178:0/3348599695 learned_addr learned my addr 172.21.15.178:0/3348599695 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11f26700 1 -- 172.21.15.178:0/3348599695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c199610 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11f26700 1 --2- 172.21.15.178:0/3348599695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d00006010 tx=0x7f2d00005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d00026070 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c1998a0 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c199d00 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f2d0000bc00 con 0x7f2d0c074660 2024-04-19T22:36:56.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d00030060 con 0x7f2d0c074660 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf0005120 con 0x7f2d0c074660 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f2d00029070 con 0x7f2d0c074660 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 --2- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 0x7f2cf803b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f2d0001e070 con 0x7f2d0c074660 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.913+0000 7f2d11725700 1 --2- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 0x7f2cf803b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:36:56.912 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.917+0000 7f2d11725700 1 --2- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 0x7f2cf803b570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:36:56.925 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:56.929+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2d00013070 con 0x7f2d0c074660 2024-04-19T22:36:57.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.141+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi113:172.21.15.113=a;smithi113:[v2:172.21.15.113:3301,v1:172.21.15.113:6790]=c;smithi178:172.21.15.178=b", "target": ["mon-mgr", ""]}) -- 0x7f2cf0000ca0 con 0x7f2cf80390b0 2024-04-19T22:36:57.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2cfeffd700 1 -- 172.21.15.178:0/3348599695 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2cf0000ca0 con 0x7f2cf80390b0 2024-04-19T22:36:57.154 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mon update... 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 msgr2=0x7f2cf803b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 --2- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 0x7f2cf803b570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08006e40 comp rx=0 tx=0).stop 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 msgr2=0x7f2d0c1990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 --2- 172.21.15.178:0/3348599695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d00006010 tx=0x7f2d00005030 comp rx=0 tx=0).stop 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 shutdown_connections 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 --2- 172.21.15.178:0/3348599695 >> v2:172.21.15.113:6800/467518466 conn(0x7f2cf80390b0 0x7f2cf803b570 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 --2- 172.21.15.178:0/3348599695 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d0c074660 0x7f2d0c1990d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:36:57.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.157+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 >> 172.21.15.178:0/3348599695 conn(0x7f2d0c0fd750 msgr2=0x7f2d0c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:36:57.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.161+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 shutdown_connections 2024-04-19T22:36:57.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:36:57.161+0000 7f2d1418a700 1 -- 172.21.15.178:0/3348599695 wait complete. 2024-04-19T22:36:57.700 DEBUG:teuthology.orchestra.run.smithi113:mon.c> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.c.service 2024-04-19T22:36:57.703 DEBUG:teuthology.orchestra.run.smithi178:mon.b> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.b.service 2024-04-19T22:36:57.705 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-19T22:36:57.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph mon dump -f json 2024-04-19T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: cluster 2024-04-19T22:36:56.253010+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.147398+0000 mgr.y (mgr.14152) 44 : audit 0 from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi113:172.21.15.113=a;smithi113:[v2:172.21.15.113:3301,v1:172.21.15.113:6790]=c;smithi178:172.21.15.178=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: cephadm 2024-04-19T22:36:57.153393+0000 mgr.y (mgr.14152) 45 : cephadm 1 Saving service mon spec with placement smithi113:172.21.15.113=a;smithi113:[v2:172.21.15.113:3301,v1:172.21.15.113:6790]=c;smithi178:172.21.15.178=b;count:3 2024-04-19T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.161010+0000 mon.a (mon.0) 131 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.185606+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.189282+0000 mon.a (mon.0) 133 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.191208+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.201203+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.205205+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: audit 2024-04-19T22:36:57.207023+0000 mon.a (mon.0) 137 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:36:58.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:36:58 smithi113 bash[21528]: cephadm 2024-04-19T22:36:57.209158+0000 mgr.y (mgr.14152) 46 : cephadm 1 Deploying daemon mon.b on smithi178 2024-04-19T22:36:58.940 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:00.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:00 smithi113 bash[21528]: cluster 2024-04-19T22:36:58.253420+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:01.759 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5c936700 1 -- 172.21.15.178:0/1652507227 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad48005490 con 0x7fad58100da0 2024-04-19T22:37:01.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 -- 172.21.15.178:0/1652507227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 msgr2=0x7fad58101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:01.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/1652507227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58101180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fad48009910 tx=0x7fad48009c20 comp rx=0 tx=0).stop 2024-04-19T22:37:01.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 -- 172.21.15.178:0/1652507227 shutdown_connections 2024-04-19T22:37:01.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/1652507227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58101180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:01.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 -- 172.21.15.178:0/1652507227 >> 172.21.15.178:0/1652507227 conn(0x7fad580fc670 msgr2=0x7fad580fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:01.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 -- 172.21.15.178:0/1652507227 shutdown_connections 2024-04-19T22:37:01.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.761+0000 7fad5fb9c700 1 -- 172.21.15.178:0/1652507227 wait complete. 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 Processor -- start 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 -- start start 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fad5810a820 con 0x7fad58100da0 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5d938700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5d938700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.178:50976/0 (socket says 172.21.15.178:50976) 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5d938700 1 -- 172.21.15.178:0/724838615 learned_addr learned my addr 172.21.15.178:0/724838615 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:37:01.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5d938700 1 -- 172.21.15.178:0/724838615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5806af30 con 0x7fad58100da0 2024-04-19T22:37:01.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5d938700 1 --2- 172.21.15.178:0/724838615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad48004f80 tx=0x7fad48005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad48026070 con 0x7fad58100da0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad581982c0 con 0x7fad58100da0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad58198780 con 0x7fad58100da0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fad4800bba0 con 0x7fad58100da0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad480038f0 con 0x7fad58100da0 2024-04-19T22:37:01.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad58102280 con 0x7fad58100da0 2024-04-19T22:37:01.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7fad48029070 con 0x7fad58100da0 2024-04-19T22:37:01.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.765+0000 7fad4effd700 1 --2- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 0x7fad4403b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:01.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.769+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fad4801e070 con 0x7fad58100da0 2024-04-19T22:37:01.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.769+0000 7fad5d137700 1 --2- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 0x7fad4403b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:01.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.769+0000 7fad5d137700 1 --2- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 0x7fad4403b570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad54006fd0 tx=0x7fad54006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:01.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:01.781+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fad48013070 con 0x7fad58100da0 2024-04-19T22:37:02.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.089+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fad58063890 con 0x7fad58100da0 2024-04-19T22:37:02.088 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad4effd700 1 -- 172.21.15.178:0/724838615 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fad48034090 con 0x7fad58100da0 2024-04-19T22:37:02.089 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-19T22:37:02.089 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":1,"fsid":"dd3df874-fe9c-11ee-bc92-c7b262605968","modified":"2024-04-19T22:34:42.772794Z","created":"2024-04-19T22:34:42.772794Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:3300","nonce":0},{"type":"v1","addr":"172.21.15.113:6789","nonce":0}]},"addr":"172.21.15.113:6789/0","public_addr":"172.21.15.113:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-19T22:37:02.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 msgr2=0x7fad4403b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:02.091 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 0x7fad4403b570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fad54006fd0 tx=0x7fad54006e40 comp rx=0 tx=0).stop 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 msgr2=0x7fad58197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/724838615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad48004f80 tx=0x7fad48005060 comp rx=0 tx=0).stop 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 shutdown_connections 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/724838615 >> v2:172.21.15.113:6800/467518466 conn(0x7fad440390b0 0x7fad4403b570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 --2- 172.21.15.178:0/724838615 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fad58100da0 0x7fad58197d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:02.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 >> 172.21.15.178:0/724838615 conn(0x7fad580fc670 msgr2=0x7fad58108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:02.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 shutdown_connections 2024-04-19T22:37:02.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:02.093+0000 7fad5fb9c700 1 -- 172.21.15.178:0/724838615 wait complete. 2024-04-19T22:37:02.093 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 1 2024-04-19T22:37:02.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:02 smithi113 bash[21528]: cluster 2024-04-19T22:37:00.253772+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:02.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:02 smithi113 bash[21528]: audit 2024-04-19T22:37:02.096527+0000 mon.a (mon.0) 138 : audit 0 from='client.? 172.21.15.178:0/724838615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-19T22:37:02.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:02 smithi113 bash[21528]: audit 2024-04-19T22:37:02.151218+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:02.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:02 smithi113 bash[21528]: audit 2024-04-19T22:37:02.157685+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:03.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:03 smithi113 bash[21528]: audit 2024-04-19T22:37:02.193213+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:03.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:03 smithi113 bash[21528]: audit 2024-04-19T22:37:02.194624+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:03.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:03 smithi113 bash[21528]: audit 2024-04-19T22:37:02.196353+0000 mon.a (mon.0) 143 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:03.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:03 smithi113 bash[21528]: cephadm 2024-04-19T22:37:02.198394+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi113 2024-04-19T22:37:03.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:03 smithi178 bash[23441]: debug 2024-04-19T22:37:03.373+0000 7f64de1e9700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-19T22:37:04.140 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-19T22:37:04.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph mon dump -f json 2024-04-19T22:37:06.041 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:37:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:06.041 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:06.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:06.541 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:37:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:07.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:07 smithi113 bash[28910]: debug 2024-04-19T22:37:07.169+0000 7f7d336f0700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-19T22:37:07.832 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:37:08.735 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:03.388498+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:03.388921+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:03.391543+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:04.254651+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:04.382627+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:05.383198+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:05.384405+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:06.254975+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:06.382902+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:07.178025+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:08.736 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:07.383304+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:08.178614+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:08.383492+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.411903+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417678+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417713+0000 mon.a (mon.0) 157 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417778+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-04-19T22:37:03.382384+0000 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417821+0000 mon.a (mon.0) 159 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417854+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417891+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417921+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.417957+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:08.737 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.435292+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.435415+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.435730+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 74s) 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.435993+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:08.442920+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:08.450293+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:08.738 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:08 smithi178 bash[23441]: audit 2024-04-19T22:37:08.482970+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:03.388498+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:03.388921+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:03.391543+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:04.254651+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:04.382627+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:05.383198+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:05.384405+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:06.254975+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:06.382902+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:07.178025+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:07.383304+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:08.178614+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:08.383492+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:08.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.411903+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417678+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417713+0000 mon.a (mon.0) 157 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417778+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-04-19T22:37:03.382384+0000 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417821+0000 mon.a (mon.0) 159 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417854+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417891+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417921+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.417957+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.435292+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.435415+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.435730+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 74s) 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.435993+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:08.442920+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:08.450293+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:08 smithi113 bash[21528]: audit 2024-04-19T22:37:08.482970+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:09.791 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:37:09 smithi113 bash[21785]: debug 2024-04-19T22:37:09.381+0000 7f84690e2700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T22:37:14.283 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:08.255333+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:09.185988+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:09.186188+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:09.186667+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:09.207914+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:09.208210+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:10.179213+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:10.255727+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:11.179288+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:12.179584+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:12.256118+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:13.179566+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.179758+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.207978+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213650+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213686+0000 mon.a (mon.0) 185 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213714+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213741+0000 mon.a (mon.0) 187 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213766+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213789+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213815+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213846+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.213870+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.231394+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.231484+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:14.285 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.231766+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 80s) 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.232084+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.238856+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.238894+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.238916+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] is down (out of quorum) 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.243396+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.248776+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.254481+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.260914+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:14 smithi178 bash[23441]: audit 2024-04-19T22:37:14.267167+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- 172.21.15.178:0/1537536833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50680035c0 msgr2=0x7f5068005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 --2- 172.21.15.178:0/1537536833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50680035c0 0x7f5068005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f507c06a520 tx=0x7f506c00fe60 comp rx=0 tx=0).stop 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- 172.21.15.178:0/1537536833 shutdown_connections 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 --2- 172.21.15.178:0/1537536833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50680035c0 0x7f5068005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- 172.21.15.178:0/1537536833 >> 172.21.15.178:0/1537536833 conn(0x7f507c0fc770 msgr2=0x7f507c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- 172.21.15.178:0/1537536833 shutdown_connections 2024-04-19T22:37:14.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- 172.21.15.178:0/1537536833 wait complete. 2024-04-19T22:37:14.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 Processor -- start 2024-04-19T22:37:14.471 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- start start 2024-04-19T22:37:14.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:14.472 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 0x7f507c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1094b0 con 0x7f507c19bf30 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f507c109330 con 0x7f507c197660 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f5083b27700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f507c109630 con 0x7f50680035c0 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f50810c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f50810c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46096/0 (socket says 172.21.15.178:46096) 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f50810c2700 1 -- 172.21.15.178:0/1662232785 learned_addr learned my addr 172.21.15.178:0/1662232785 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f50810c2700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 msgr2=0x7f507c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50810c2700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 msgr2=0x7f507c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50810c2700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-19T22:37:14.473 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.473+0000 7f50820c4700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 0x7f507c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50818c3700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50810c2700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50818c3700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 msgr2=0x7f507c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50818c3700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 msgr2=0x7f507c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50818c3700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-19T22:37:14.474 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50818c3700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 msgr2=0x7f507c197120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 msgr2=0x7f507c19b9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 -- 172.21.15.178:0/1662232785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507c1a3ca0 con 0x7f507c19bf30 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f50820c4700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 0x7f507c19c3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f507400bd50 tx=0x7f507400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074019070 con 0x7f507c19bf30 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f507400cd10 con 0x7f507c19bf30 2024-04-19T22:37:14.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074012680 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507c1a3ed0 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507c1a4360 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507c063890 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f507401c070 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 --2- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 0x7f506003ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.477+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f507404ba50 con 0x7f507c19bf30 2024-04-19T22:37:14.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.481+0000 7f50818c3700 1 --2- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 0x7f506003ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:14.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.481+0000 7f50818c3700 1 --2- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 0x7f506003ba00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f506c00fa10 tx=0x7f506c005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:14.490 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.493+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5074018170 con 0x7f507c19bf30 2024-04-19T22:37:14.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:08.255333+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:09.185988+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:09.186188+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:09.186667+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:09.207914+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:09.208210+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:10.179213+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:10.255727+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:11.179288+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:12.179584+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:12.256118+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:13.179566+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.179758+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.207978+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213650+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213686+0000 mon.a (mon.0) 185 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213714+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213741+0000 mon.a (mon.0) 187 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213766+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213789+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213815+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213846+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.213870+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.231394+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.231484+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.231766+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 80s) 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.232084+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.238856+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.238894+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.238916+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] is down (out of quorum) 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.243396+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.248776+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.254481+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.260914+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:14 smithi113 bash[21528]: audit 2024-04-19T22:37:14.267167+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:14.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.773+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f507c02db30 con 0x7f507c19bf30 2024-04-19T22:37:14.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.773+0000 7f5072ffd700 1 -- 172.21.15.178:0/1662232785 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f5074014440 con 0x7f507c19bf30 2024-04-19T22:37:14.770 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-19T22:37:14.770 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"dd3df874-fe9c-11ee-bc92-c7b262605968","modified":"2024-04-19T22:37:09.179726Z","created":"2024-04-19T22:34:42.772794Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:3300","nonce":0},{"type":"v1","addr":"172.21.15.113:6789","nonce":0}]},"addr":"172.21.15.113:6789/0","public_addr":"172.21.15.113:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:3301","nonce":0},{"type":"v1","addr":"172.21.15.113:6790","nonce":0}]},"addr":"172.21.15.113:6790/0","public_addr":"172.21.15.113:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 msgr2=0x7f506003ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 0x7f506003ba00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f506c00fa10 tx=0x7f506c005de0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 msgr2=0x7f507c19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 0x7f507c19c3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f507400bd50 tx=0x7f507400be30 comp rx=0 tx=0).stop 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 shutdown_connections 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> v2:172.21.15.113:6800/467518466 conn(0x7f5060039540 0x7f506003ba00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f507c19bf30 0x7f507c19c3e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f50680035c0 0x7f507c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.773 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 --2- 172.21.15.178:0/1662232785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507c197660 0x7f507c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:14.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 >> 172.21.15.178:0/1662232785 conn(0x7f507c0fc770 msgr2=0x7f507c0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:14.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 shutdown_connections 2024-04-19T22:37:14.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:14.777+0000 7f5083b27700 1 -- 172.21.15.178:0/1662232785 wait complete. 2024-04-19T22:37:14.774 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2024-04-19T22:37:15.440 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-19T22:37:15.441 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph config generate-minimal-conf 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: cluster 2024-04-19T22:37:14.256490+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: audit 2024-04-19T22:37:14.778182+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.178:0/1662232785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: audit 2024-04-19T22:37:14.946551+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: audit 2024-04-19T22:37:14.948313+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: cephadm 2024-04-19T22:37:14.950598+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: cephadm 2024-04-19T22:37:14.950976+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:37:15.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: cephadm 2024-04-19T22:37:15.165893+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:15.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: cephadm 2024-04-19T22:37:15.166226+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:15.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:15 smithi113 bash[21528]: audit 2024-04-19T22:37:15.179544+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: cluster 2024-04-19T22:37:14.256490+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: audit 2024-04-19T22:37:14.778182+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.178:0/1662232785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: audit 2024-04-19T22:37:14.946551+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: audit 2024-04-19T22:37:14.948313+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: cephadm 2024-04-19T22:37:14.950598+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: cephadm 2024-04-19T22:37:14.950976+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: cephadm 2024-04-19T22:37:15.165893+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: cephadm 2024-04-19T22:37:15.166226+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:15.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:15 smithi178 bash[23441]: audit 2024-04-19T22:37:15.179544+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:03.388498+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:03.388921+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:03.391543+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:04.254651+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:04.382627+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.489 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:05.383198+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:05.384405+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:06.254975+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:06.382902+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:07.178025+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:07.383304+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:08.178614+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:08.383492+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.411903+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:16.491 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417678+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-04-19T22:37:16.491 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417713+0000 mon.a (mon.0) 157 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:16.491 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417778+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-04-19T22:37:03.382384+0000 2024-04-19T22:37:16.491 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417821+0000 mon.a (mon.0) 159 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:16.491 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417854+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:16.492 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417891+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-04-19T22:37:16.492 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417921+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:16.492 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.417957+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:16.492 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.435292+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-04-19T22:37:16.493 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.435415+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.435730+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 74s) 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.435993+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:08.442920+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:08.450293+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:08.482970+0000 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:08.255333+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.494 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:09.185988+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:09.186188+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:09.186667+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:09.207914+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:09.208210+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:10.179213+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:10.255727+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:11.179288+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:12.179584+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.495 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:12.256118+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:13.179566+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.179758+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.207978+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213650+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213686+0000 mon.a (mon.0) 185 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213714+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213741+0000 mon.a (mon.0) 187 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213766+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213789+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213815+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213846+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.213870+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:16.496 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.231394+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-04-19T22:37:16.497 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.231484+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:16.497 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.231766+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 80s) 2024-04-19T22:37:16.497 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.232084+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.238856+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.238894+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.238916+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] is down (out of quorum) 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.243396+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.248776+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.254481+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.260914+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.267167+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:16.498 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:14.256490+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.778182+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.178:0/1662232785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.946551+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:14.948313+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:14.950598+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:14.950976+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:15.165893+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:15.166226+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: audit 2024-04-19T22:37:15.179544+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:16.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:11.181784+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cephadm 2024-04-19T22:37:15.494447+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cephadm 2024-04-19T22:37:15.498087+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi113 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.217238+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.217885+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.218279+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.241775+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249287+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249324+0000 mon.a (mon.0) 225 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249361+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249423+0000 mon.a (mon.0) 227 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249465+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249509+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-04-19T22:37:16.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249554+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249599+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.249641+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.250672+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.250754+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.251042+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 82s) 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.251334+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.251376+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.257549+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:11.181784+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:15.494447+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cephadm 2024-04-19T22:37:15.498087+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi113 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.217238+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.217885+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.218279+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.241775+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249287+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249324+0000 mon.a (mon.0) 225 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249361+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249423+0000 mon.a (mon.0) 227 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249465+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249509+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249554+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249599+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.249641+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:16.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.250672+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-04-19T22:37:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.250754+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.251042+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 82s) 2024-04-19T22:37:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.251334+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-04-19T22:37:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.251376+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-04-19T22:37:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:16 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.257549+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:11.181784+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cephadm 2024-04-19T22:37:15.494447+0000 mgr.y (mgr.14152) 61 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cephadm 2024-04-19T22:37:15.498087+0000 mgr.y (mgr.14152) 62 : cephadm 1 Reconfiguring daemon mon.a on smithi113 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.217238+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.217885+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.218279+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-04-19T22:37:16.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.241775+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249287+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249324+0000 mon.a (mon.0) 225 : cluster 0 fsid dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249361+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-04-19T22:37:09.179726+0000 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249423+0000 mon.a (mon.0) 227 : cluster 0 created 2024-04-19T22:34:42.772794+0000 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249465+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249509+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249554+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249599+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.249641+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.250672+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.250754+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.251042+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 82s) 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.251334+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.251376+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-04-19T22:37:16.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:16 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.257549+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-04-19T22:37:18.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: cluster 2024-04-19T22:37:16.256855+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.179254+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.731939+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.737005+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.767642+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.769055+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[21528]: audit 2024-04-19T22:37:17.770494+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: cluster 2024-04-19T22:37:16.256855+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:18.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.179254+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.731939+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.737005+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.767642+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.769055+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:18 smithi113 bash[28910]: audit 2024-04-19T22:37:17.770494+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:18.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: cluster 2024-04-19T22:37:16.256855+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.179254+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.731939+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.737005+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.767642+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.769055+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:18 smithi178 bash[23441]: audit 2024-04-19T22:37:17.770494+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:19.269 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:19 smithi113 bash[21528]: cephadm 2024-04-19T22:37:17.767048+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-04-19T22:37:19.269 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:19 smithi113 bash[21528]: cephadm 2024-04-19T22:37:17.772211+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi113 2024-04-19T22:37:19.269 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:19 smithi113 bash[28910]: cephadm 2024-04-19T22:37:17.767048+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-04-19T22:37:19.269 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:19 smithi113 bash[28910]: cephadm 2024-04-19T22:37:17.772211+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi113 2024-04-19T22:37:19.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:19 smithi178 bash[23441]: cephadm 2024-04-19T22:37:17.767048+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-04-19T22:37:19.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:19 smithi178 bash[23441]: cephadm 2024-04-19T22:37:17.772211+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi113 2024-04-19T22:37:20.165 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:37:20.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: cluster 2024-04-19T22:37:18.257223+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:20.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: audit 2024-04-19T22:37:19.717359+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: audit 2024-04-19T22:37:19.724396+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: audit 2024-04-19T22:37:19.741393+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:20.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: audit 2024-04-19T22:37:19.742736+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[21528]: audit 2024-04-19T22:37:19.744049+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: cluster 2024-04-19T22:37:18.257223+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: audit 2024-04-19T22:37:19.717359+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: audit 2024-04-19T22:37:19.724396+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: audit 2024-04-19T22:37:19.741393+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: audit 2024-04-19T22:37:19.742736+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:20.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:20 smithi113 bash[28910]: audit 2024-04-19T22:37:19.744049+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:20.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: cluster 2024-04-19T22:37:18.257223+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:20.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: audit 2024-04-19T22:37:19.717359+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: audit 2024-04-19T22:37:19.724396+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:20.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: audit 2024-04-19T22:37:19.741393+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-19T22:37:20.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: audit 2024-04-19T22:37:19.742736+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-19T22:37:20.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:20 smithi178 bash[23441]: audit 2024-04-19T22:37:19.744049+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:21.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:21 smithi113 bash[21528]: cephadm 2024-04-19T22:37:19.740883+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-04-19T22:37:21.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:21 smithi113 bash[21528]: cephadm 2024-04-19T22:37:19.745544+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi178 2024-04-19T22:37:21.291 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:21 smithi113 bash[28910]: cephadm 2024-04-19T22:37:19.740883+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-04-19T22:37:21.291 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:21 smithi113 bash[28910]: cephadm 2024-04-19T22:37:19.745544+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi178 2024-04-19T22:37:21.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:21 smithi178 bash[23441]: cephadm 2024-04-19T22:37:19.740883+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-04-19T22:37:21.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:21 smithi178 bash[23441]: cephadm 2024-04-19T22:37:19.745544+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi178 2024-04-19T22:37:22.499 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: cluster 2024-04-19T22:37:20.257610+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:22.499 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.492980+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.499 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.500416+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.499 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.514295+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:22.499 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.518170+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:22.500 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.520062+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:22.500 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[21528]: audit 2024-04-19T22:37:21.528953+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.500 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: cluster 2024-04-19T22:37:20.257610+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:22.500 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.492980+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.501 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.500416+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.501 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.514295+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:22.501 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.518170+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:22.501 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.520062+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:22.501 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:22 smithi113 bash[28910]: audit 2024-04-19T22:37:21.528953+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: cluster 2024-04-19T22:37:20.257610+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.492980+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.500416+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.514295+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.518170+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.520062+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:22.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:22 smithi178 bash[23441]: audit 2024-04-19T22:37:21.528953+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- 172.21.15.113:0/4220279295 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 msgr2=0x7f1a6810f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- 172.21.15.113:0/4220279295 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a6810f100 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009990 tx=0x7f1a58009ca0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- 172.21.15.113:0/4220279295 shutdown_connections 2024-04-19T22:37:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- 172.21.15.113:0/4220279295 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a6810f100 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- 172.21.15.113:0/4220279295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a68108350 0x7f1a68108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- 172.21.15.113:0/4220279295 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a681023b0 0x7f1a68102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- 172.21.15.113:0/4220279295 >> 172.21.15.113:0/4220279295 conn(0x7f1a68079390 msgr2=0x7f1a680797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- 172.21.15.113:0/4220279295 shutdown_connections 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- 172.21.15.113:0/4220279295 wait complete. 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 Processor -- start 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- start start 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 0x7f1a68074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:22.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 0x7f1a68074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68111c60 con 0x7f1a68102d70 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68111ae0 con 0x7f1a681023b0 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6e292700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f1a68111de0 con 0x7f1a68108350 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a677fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:22.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a6c82f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 0x7f1a68074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a677fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:57234/0 (socket says 172.21.15.113:57234) 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a677fe700 1 -- 172.21.15.113:0/300313001 learned_addr learned my addr 172.21.15.113:0/300313001 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.676+0000 7f1a67fff700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 0x7f1a68074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 -- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 msgr2=0x7f1a68074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 0x7f1a68074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 -- 172.21.15.113:0/300313001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 msgr2=0x7f1a68074530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 0x7f1a68074530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 -- 172.21.15.113:0/300313001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a681a64e0 con 0x7f1a68102d70 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a67fff700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 0x7f1a68074530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a6c82f700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 0x7f1a68074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a677fe700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00e9a0 tx=0x7f1a5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00cbd0 con 0x7f1a68102d70 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1a5c00cd70 con 0x7f1a68102d70 2024-04-19T22:37:22.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a681a67d0 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c018680 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a681a6d60 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6804ff50 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f1a5c0188e0 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 --2- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 0x7f1a5003b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f1a5c04c580 con 0x7f1a68102d70 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a67fff700 1 --2- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 0x7f1a5003b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:22.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.680+0000 7f1a67fff700 1 --2- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 0x7f1a5003b7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000e350 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:22.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.684+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1a5c00b2c0 con 0x7f1a68102d70 2024-04-19T22:37:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.896+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f1a681a6fc0 con 0x7f1a68102d70 2024-04-19T22:37:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.896+0000 7f1a657fa700 1 -- 172.21.15.113:0/300313001 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f1a5c020520 con 0x7f1a68102d70 2024-04-19T22:37:22.893 INFO:teuthology.orchestra.run.smithi113.stdout:# minimal ceph.conf for dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:22.893 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2024-04-19T22:37:22.893 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:37:22.893 INFO:teuthology.orchestra.run.smithi113.stdout: mon_host = [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] 2024-04-19T22:37:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 msgr2=0x7f1a5003b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 0x7f1a5003b7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000e350 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2024-04-19T22:37:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 msgr2=0x7f1a68074a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00e9a0 tx=0x7f1a5c00ecb0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 shutdown_connections 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> v2:172.21.15.113:6800/467518466 conn(0x7f1a500392f0 0x7f1a5003b7b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a68108350 0x7f1a68074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a681023b0 0x7f1a68074530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 --2- 172.21.15.113:0/300313001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a68102d70 0x7f1a68074a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 >> 172.21.15.113:0/300313001 conn(0x7f1a68079390 msgr2=0x7f1a68105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 shutdown_connections 2024-04-19T22:37:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:22.900+0000 7f1a6e292700 1 -- 172.21.15.113:0/300313001 wait complete. 2024-04-19T22:37:23.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:23 smithi113 bash[21528]: audit 2024-04-19T22:37:22.901127+0000 mon.a (mon.0) 256 : audit 0 from='client.? 172.21.15.113:0/300313001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:23.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:23 smithi113 bash[28910]: audit 2024-04-19T22:37:22.901127+0000 mon.a (mon.0) 256 : audit 0 from='client.? 172.21.15.113:0/300313001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:23.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:23 smithi178 bash[23441]: audit 2024-04-19T22:37:22.901127+0000 mon.a (mon.0) 256 : audit 0 from='client.? 172.21.15.113:0/300313001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:23.572 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-19T22:37:23.572 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:37:23.572 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.conf 2024-04-19T22:37:23.623 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:37:23.624 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:37:23.679 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:37:23.679 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2024-04-19T22:37:23.694 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:37:23.694 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:37:23.747 INFO:tasks.cephadm:Adding mgr.y on smithi113 2024-04-19T22:37:23.748 INFO:tasks.cephadm:Adding mgr.x on smithi178 2024-04-19T22:37:23.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply mgr '2;smithi113=y;smithi178=x' 2024-04-19T22:37:24.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:24 smithi113 bash[28910]: cluster 2024-04-19T22:37:22.258021+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:24.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:24 smithi113 bash[21528]: cluster 2024-04-19T22:37:22.258021+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:24.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:24 smithi178 bash[23441]: cluster 2024-04-19T22:37:22.258021+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:26.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:26 smithi113 bash[28910]: cluster 2024-04-19T22:37:24.258522+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:26.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:26 smithi113 bash[21528]: cluster 2024-04-19T22:37:24.258522+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:26.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:26 smithi178 bash[23441]: cluster 2024-04-19T22:37:24.258522+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:27.488 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:37:28.508 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:28 smithi178 bash[23441]: cluster 2024-04-19T22:37:26.258934+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:28.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:28 smithi113 bash[21528]: cluster 2024-04-19T22:37:26.258934+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:28.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:28 smithi113 bash[28910]: cluster 2024-04-19T22:37:26.258934+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3807116047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81034f0 msgr2=0x7f90f8103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3807116047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81034f0 0x7f90f8103950 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90e00099c0 tx=0x7f90e0009cd0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3807116047 shutdown_connections 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3807116047 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f810a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3807116047 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90f81022f0 0x7f90f8102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3807116047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81034f0 0x7f90f8103950 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3807116047 >> 172.21.15.178:0/3807116047 conn(0x7f90f80fd8b0 msgr2=0x7f90f80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3807116047 shutdown_connections 2024-04-19T22:37:29.646 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3807116047 wait complete. 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 Processor -- start 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- start start 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90f81034f0 0x7f90f81981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f90f810d6b0 con 0x7f90f81034f0 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90f810d530 con 0x7f90f81022f0 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f90f810d830 con 0x7f90f8103e90 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41306/0 (socket says 172.21.15.178:41306) 2024-04-19T22:37:29.648 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 -- 172.21.15.178:0/3803758431 learned_addr learned my addr 172.21.15.178:0/3803758431 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 -- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 msgr2=0x7f90f819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fcf64700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 -- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90f81034f0 msgr2=0x7f90f81981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90f81034f0 0x7f90f81981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 -- 172.21.15.178:0/3803758431 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f819f8b0 con 0x7f90f81022f0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fcf64700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f7fff700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90f000ada0 tx=0x7f90f000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0017020 con 0x7f90f81022f0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f90f000c980 con 0x7f90f81022f0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f00043b0 con 0x7f90f81022f0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f819fba0 con 0x7f90f81022f0 2024-04-19T22:37:29.649 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.648+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f81a0060 con 0x7f90f81022f0 2024-04-19T22:37:29.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) ==== 46309+0+0 (secure 0 0 0) 0x7f90f0004550 con 0x7f90f81022f0 2024-04-19T22:37:29.650 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f804ff50 con 0x7f90f81022f0 2024-04-19T22:37:29.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90f57fa700 1 --2- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 0x7f90e403b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:29.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7f90f004b850 con 0x7f90f81022f0 2024-04-19T22:37:29.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90f77fe700 1 --2- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 0x7f90e403b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:29.651 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.652+0000 7f90f77fe700 1 --2- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 0x7f90e403b7b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009990 tx=0x7f90e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:29.654 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.656+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f90f0008a40 con 0x7f90f81022f0 2024-04-19T22:37:29.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.876+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi113=y;smithi178=x", "target": ["mon-mgr", ""]}) -- 0x7f90f8062670 con 0x7f90e40392f0 2024-04-19T22:37:29.889 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2024-04-19T22:37:29.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90f57fa700 1 -- 172.21.15.178:0/3803758431 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f90f8062670 con 0x7f90e40392f0 2024-04-19T22:37:29.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 msgr2=0x7f90e403b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:29.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 0x7f90e403b7b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009990 tx=0x7f90e0000bc0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 msgr2=0x7f90f8197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:29.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90f000ada0 tx=0x7f90f000c330 comp rx=0 tx=0).stop 2024-04-19T22:37:29.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 shutdown_connections 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> v2:172.21.15.113:6800/467518466 conn(0x7f90e40392f0 0x7f90e403b7b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90f8103e90 0x7f90f819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f81022f0 0x7f90f8197c60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 --2- 172.21.15.178:0/3803758431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90f81034f0 0x7f90f81981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 >> 172.21.15.178:0/3803758431 conn(0x7f90f80fd8b0 msgr2=0x7f90f80ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 shutdown_connections 2024-04-19T22:37:29.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:37:29.892+0000 7f90fe9c7700 1 -- 172.21.15.178:0/3803758431 wait complete. 2024-04-19T22:37:30.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: cluster 2024-04-19T22:37:28.259306+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:30.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.896333+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.935858+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:30.451 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.939493+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.941175+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.951701+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.955055+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.957530+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.962455+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:30.452 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:30 smithi178 bash[23441]: audit 2024-04-19T22:37:29.964615+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.453 DEBUG:teuthology.orchestra.run.smithi178:mgr.x> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.x.service 2024-04-19T22:37:30.455 INFO:tasks.cephadm:Deploying OSDs... 2024-04-19T22:37:30.455 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:37:30.456 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T22:37:30.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T22:37:30.462 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2024-04-19T22:37:30.511 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T22:37:30.511 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:30.511 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-04-19T22:37:30.511 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:30.512 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-19 22:28:07.608024059 +0000 2024-04-19T22:37:30.512 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-19 22:28:07.336026488 +0000 2024-04-19T22:37:30.512 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-19 22:28:07.336026488 +0000 2024-04-19T22:37:30.512 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2024-04-19T22:37:30.512 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T22:37:30.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: cluster 2024-04-19T22:37:28.259306+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:30.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.896333+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.935858+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:30.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.939493+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.941175+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.951701+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.955055+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.957530+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.962455+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[21528]: audit 2024-04-19T22:37:29.964615+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: cluster 2024-04-19T22:37:28.259306+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:30.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.896333+0000 mon.a (mon.0) 257 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.935858+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.939493+0000 mon.a (mon.0) 259 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.941175+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.951701+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.955055+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.957530+0000 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.962455+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:30 smithi113 bash[28910]: audit 2024-04-19T22:37:29.964615+0000 mon.a (mon.0) 265 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-19T22:37:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-19T22:37:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000354031 s, 1.4 MB/s 2024-04-19T22:37:30.556 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T22:37:30.604 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2024-04-19T22:37:30.654 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-19 22:28:08.104019628 +0000 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-19 22:28:07.836022021 +0000 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-19 22:28:07.836022021 +0000 2024-04-19T22:37:30.655 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2024-04-19T22:37:30.655 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T22:37:30.709 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-19T22:37:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-19T22:37:30.710 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000416936 s, 1.2 MB/s 2024-04-19T22:37:30.711 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T22:37:30.759 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2024-04-19T22:37:30.806 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-19 22:28:08.572015448 +0000 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-19 22:28:08.328017627 +0000 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-19 22:28:08.328017627 +0000 2024-04-19T22:37:30.807 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2024-04-19T22:37:30.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T22:37:30.861 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-19T22:37:30.861 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-19T22:37:30.861 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000411763 s, 1.2 MB/s 2024-04-19T22:37:30.862 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T22:37:30.912 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2024-04-19T22:37:30.959 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T22:37:30.959 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:30.959 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-19T22:37:30.959 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:30.960 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-19 22:28:09.060011089 +0000 2024-04-19T22:37:30.960 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-19 22:28:08.824013197 +0000 2024-04-19T22:37:30.960 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-19 22:28:08.824013197 +0000 2024-04-19T22:37:30.960 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2024-04-19T22:37:30.960 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T22:37:31.013 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-19T22:37:31.013 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-19T22:37:31.013 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000394281 s, 1.3 MB/s 2024-04-19T22:37:31.014 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T22:37:31.063 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:37:31.063 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T22:37:31.069 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T22:37:31.069 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-19 22:28:07.583200511 +0000 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-19 22:28:07.323202832 +0000 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-19 22:28:07.323202832 +0000 2024-04-19T22:37:31.117 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-04-19T22:37:31.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T22:37:31.171 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-19T22:37:31.171 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-19T22:37:31.172 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000325524 s, 1.6 MB/s 2024-04-19T22:37:31.172 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T22:37:31.223 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-19 22:28:08.071196159 +0000 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-19 22:28:07.815198442 +0000 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-19 22:28:07.815198442 +0000 2024-04-19T22:37:31.269 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-04-19T22:37:31.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T22:37:31.324 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-19T22:37:31.324 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-19T22:37:31.324 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000310491 s, 1.6 MB/s 2024-04-19T22:37:31.325 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T22:37:31.374 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-04-19T22:37:31.424 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T22:37:31.424 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:31.424 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-04-19T22:37:31.425 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:31.425 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-19 22:28:08.603191412 +0000 2024-04-19T22:37:31.425 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-19 22:28:08.319193947 +0000 2024-04-19T22:37:31.425 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-19 22:28:08.319193947 +0000 2024-04-19T22:37:31.425 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-04-19T22:37:31.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T22:37:31.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:31 smithi178 bash[23441]: audit 2024-04-19T22:37:29.886459+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi113=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:31.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:31 smithi178 bash[23441]: cephadm 2024-04-19T22:37:29.890041+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi113=y;smithi178=x;count:2 2024-04-19T22:37:31.426 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:31 smithi178 bash[23441]: cephadm 2024-04-19T22:37:29.966638+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi178 2024-04-19T22:37:31.434 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-19T22:37:31.435 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-19T22:37:31.435 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000162528 s, 3.2 MB/s 2024-04-19T22:37:31.436 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T22:37:31.485 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-04-19T22:37:31.532 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T22:37:31.532 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-19 22:28:09.115186846 +0000 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-19 22:28:08.859189129 +0000 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-19 22:28:08.859189129 +0000 2024-04-19T22:37:31.533 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-04-19T22:37:31.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T22:37:31.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[21528]: audit 2024-04-19T22:37:29.886459+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi113=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:31.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[21528]: cephadm 2024-04-19T22:37:29.890041+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi113=y;smithi178=x;count:2 2024-04-19T22:37:31.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[21528]: cephadm 2024-04-19T22:37:29.966638+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi178 2024-04-19T22:37:31.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[28910]: audit 2024-04-19T22:37:29.886459+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi113=y;smithi178=x", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:31.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[28910]: cephadm 2024-04-19T22:37:29.890041+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi113=y;smithi178=x;count:2 2024-04-19T22:37:31.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:31 smithi113 bash[28910]: cephadm 2024-04-19T22:37:29.966638+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi178 2024-04-19T22:37:31.588 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-19T22:37:31.588 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-19T22:37:31.589 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000168243 s, 3.0 MB/s 2024-04-19T22:37:31.590 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T22:37:31.638 INFO:tasks.cephadm:Deploying osd.0 on smithi113 with /dev/vg_nvme/lv_4... 2024-04-19T22:37:31.638 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-19T22:37:32.499 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:32 smithi178 bash[23441]: cluster 2024-04-19T22:37:30.259842+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:32.500 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.500 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.500 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.500 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:32 smithi113 bash[28910]: cluster 2024-04-19T22:37:30.259842+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:32.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:32 smithi113 bash[21528]: cluster 2024-04-19T22:37:30.259842+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:32.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:37:32.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:32 smithi178 systemd[1]: Started Ceph mgr.x for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: cluster 2024-04-19T22:37:32.260301+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: audit 2024-04-19T22:37:32.654024+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: audit 2024-04-19T22:37:32.663531+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: audit 2024-04-19T22:37:32.698479+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: audit 2024-04-19T22:37:32.707506+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:33.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[23441]: audit 2024-04-19T22:37:32.777176+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:33.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[24363]: debug 2024-04-19T22:37:33.508+0000 7ffaabb7f700 1 -- 172.21.15.178:0/30390086 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56154729c5a0 con 0x56154801c400 2024-04-19T22:37:33.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:33 smithi178 bash[24363]: debug 2024-04-19T22:37:33.652+0000 7ffab5d86200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:37:34.041 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: cluster 2024-04-19T22:37:32.260301+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:34.041 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: audit 2024-04-19T22:37:32.654024+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.041 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: audit 2024-04-19T22:37:32.663531+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.041 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: audit 2024-04-19T22:37:32.698479+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: audit 2024-04-19T22:37:32.707506+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[28910]: audit 2024-04-19T22:37:32.777176+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: cluster 2024-04-19T22:37:32.260301+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: audit 2024-04-19T22:37:32.654024+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: audit 2024-04-19T22:37:32.663531+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: audit 2024-04-19T22:37:32.698479+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: audit 2024-04-19T22:37:32.707506+0000 mon.a (mon.0) 269 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:34.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:33 smithi113 bash[21528]: audit 2024-04-19T22:37:32.777176+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:35.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:35 smithi113 bash[28910]: audit 2024-04-19T22:37:34.251474+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:35.541 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:35 smithi113 bash[28910]: cluster 2024-04-19T22:37:34.260703+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:35.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:35 smithi113 bash[21528]: audit 2024-04-19T22:37:34.251474+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:35.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:35 smithi113 bash[21528]: cluster 2024-04-19T22:37:34.260703+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:35.547 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:35 smithi178 bash[24363]: debug 2024-04-19T22:37:35.204+0000 7ffab5d86200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:37:35.547 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:35 smithi178 bash[24363]: debug 2024-04-19T22:37:35.300+0000 7ffab5d86200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:37:35.547 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:35 smithi178 bash[24363]: debug 2024-04-19T22:37:35.548+0000 7ffab5d86200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:37:35.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:35 smithi178 bash[23441]: audit 2024-04-19T22:37:34.251474+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:35.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:35 smithi178 bash[23441]: cluster 2024-04-19T22:37:34.260703+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:36.361 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:37:36.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:36 smithi178 bash[24363]: debug 2024-04-19T22:37:36.340+0000 7ffab5d86200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:37:36.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:36 smithi178 bash[24363]: debug 2024-04-19T22:37:36.448+0000 7ffab5d86200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:37:36.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:36 smithi178 bash[24363]: debug 2024-04-19T22:37:36.552+0000 7ffab5d86200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:37:37.298 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:36 smithi178 bash[24363]: debug 2024-04-19T22:37:36.908+0000 7ffab5d86200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:37:37.298 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[24363]: debug 2024-04-19T22:37:37.020+0000 7ffab5d86200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:37:37.298 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[24363]: debug 2024-04-19T22:37:37.120+0000 7ffab5d86200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:37:37.490 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:37 smithi113 bash[21528]: cluster 2024-04-19T22:37:36.261110+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:37.490 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:37 smithi113 bash[28910]: cluster 2024-04-19T22:37:36.261110+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:37.710 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[23441]: cluster 2024-04-19T22:37:36.261110+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:37.711 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[24363]: debug 2024-04-19T22:37:37.472+0000 7ffab5d86200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:37:37.990 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[24363]: debug 2024-04-19T22:37:37.712+0000 7ffab5d86200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:37:38.298 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:37 smithi178 bash[24363]: debug 2024-04-19T22:37:37.992+0000 7ffab5d86200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:37:38.298 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[24363]: debug 2024-04-19T22:37:38.104+0000 7ffab5d86200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:37:38.788 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[24363]: debug 2024-04-19T22:37:38.376+0000 7ffab5d86200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[24363]: debug 2024-04-19T22:37:38.788+0000 7ffab5d86200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:39 smithi178 bash[24363]: debug 2024-04-19T22:37:39.028+0000 7ffab5d86200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:37.962519+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:37.967945+0000 mon.a (mon.0) 273 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:37.969056+0000 mon.a (mon.0) 274 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:37.970039+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:39.048 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:37.975326+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: cephadm 2024-04-19T22:37:38.009147+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-04-19T22:37:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:38.009608+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:38.010676+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: audit 2024-04-19T22:37:38.011396+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:38 smithi178 bash[23441]: cephadm 2024-04-19T22:37:38.012223+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi113 2024-04-19T22:37:39.291 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:37.962519+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:37.967945+0000 mon.a (mon.0) 273 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:37.969056+0000 mon.a (mon.0) 274 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:37.970039+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:37.975326+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: cephadm 2024-04-19T22:37:38.009147+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:38.009608+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:38.010676+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: audit 2024-04-19T22:37:38.011396+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[28910]: cephadm 2024-04-19T22:37:38.012223+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi113 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:37.962519+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:37.967945+0000 mon.a (mon.0) 273 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:37.969056+0000 mon.a (mon.0) 274 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:37.970039+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:37.975326+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: cephadm 2024-04-19T22:37:38.009147+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:38.009608+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:38.010676+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: audit 2024-04-19T22:37:38.011396+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:39.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:38 smithi113 bash[21528]: cephadm 2024-04-19T22:37:38.012223+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi113 2024-04-19T22:37:39.548 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:39 smithi178 bash[24363]: debug 2024-04-19T22:37:39.144+0000 7ffab5d86200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:37:39.548 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:39 smithi178 bash[24363]: debug 2024-04-19T22:37:39.388+0000 7ffab5d86200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:37:39.737 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-19T22:37:39.738 INFO:teuthology.orchestra.run.smithi113.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-19T22:37:39.738 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 10+0 records in 2024-04-19T22:37:39.738 INFO:teuthology.orchestra.run.smithi113.stderr:10+0 records out 2024-04-19T22:37:39.738 INFO:teuthology.orchestra.run.smithi113.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00837231 s, 1.3 GB/s 2024-04-19T22:37:39.738 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping successful for: 2024-04-19T22:37:40.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:39 smithi113 bash[21528]: cluster 2024-04-19T22:37:38.261520+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:40.291 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:39 smithi113 bash[28910]: cluster 2024-04-19T22:37:38.261520+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:40.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:39 smithi178 bash[23441]: cluster 2024-04-19T22:37:38.261520+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:40.610 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi113:vg_nvme/lv_4 2024-04-19T22:37:40.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:40 smithi178 bash[24363]: debug 2024-04-19T22:37:40.396+0000 7ffab5d86200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:37:40.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:40 smithi178 bash[24363]: debug 2024-04-19T22:37:40.512+0000 7ffab5d86200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:37:41.222 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:40 smithi178 bash[24363]: debug 2024-04-19T22:37:40.808+0000 7ffab5d86200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:37:41.222 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:40 smithi178 bash[24363]: debug 2024-04-19T22:37:40.916+0000 7ffab5d86200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[24363]: debug 2024-04-19T22:37:41.364+0000 7ffab5d86200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.233871+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.243428+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.282301+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.855112+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.855913+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:41.481 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[23441]: audit 2024-04-19T22:37:40.860340+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.233871+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.243428+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.282301+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.855112+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.855913+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[21528]: audit 2024-04-19T22:37:40.860340+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.233871+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.243428+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.282301+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.855112+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.855913+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:37:41.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:41 smithi113 bash[28910]: audit 2024-04-19T22:37:40.860340+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:37:41.798 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:37:41 smithi178 bash[24363]: debug 2024-04-19T22:37:41.480+0000 7ffab5d86200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:37:42.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: cluster 2024-04-19T22:37:40.261966+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:42.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: cluster 2024-04-19T22:37:41.512736+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: audit 2024-04-19T22:37:41.513095+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: audit 2024-04-19T22:37:41.513915+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: audit 2024-04-19T22:37:41.515112+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[21528]: audit 2024-04-19T22:37:41.515672+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: cluster 2024-04-19T22:37:40.261966+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: cluster 2024-04-19T22:37:41.512736+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: audit 2024-04-19T22:37:41.513095+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: audit 2024-04-19T22:37:41.513915+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: audit 2024-04-19T22:37:41.515112+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:37:42.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:42 smithi113 bash[28910]: audit 2024-04-19T22:37:41.515672+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: cluster 2024-04-19T22:37:40.261966+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: cluster 2024-04-19T22:37:41.512736+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: audit 2024-04-19T22:37:41.513095+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: audit 2024-04-19T22:37:41.513915+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: audit 2024-04-19T22:37:41.515112+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:37:42.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:42 smithi178 bash[23441]: audit 2024-04-19T22:37:41.515672+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.178:0/2030527738' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:37:43.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[21528]: cluster 2024-04-19T22:37:42.255275+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-04-19T22:37:43.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[21528]: audit 2024-04-19T22:37:42.255614+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:37:43.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[21528]: cluster 2024-04-19T22:37:42.262394+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:43.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[28910]: cluster 2024-04-19T22:37:42.255275+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-04-19T22:37:43.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[28910]: audit 2024-04-19T22:37:42.255614+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:37:43.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:43 smithi113 bash[28910]: cluster 2024-04-19T22:37:42.262394+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:43.547 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:43 smithi178 bash[23441]: cluster 2024-04-19T22:37:42.255275+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-04-19T22:37:43.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:43 smithi178 bash[23441]: audit 2024-04-19T22:37:42.255614+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:37:43.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:43 smithi178 bash[23441]: cluster 2024-04-19T22:37:42.262394+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:45.327 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:37:45.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:45 smithi113 bash[21528]: cluster 2024-04-19T22:37:44.262880+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:45.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:45 smithi113 bash[28910]: cluster 2024-04-19T22:37:44.262880+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:45.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:45 smithi178 bash[23441]: cluster 2024-04-19T22:37:44.262880+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:47.643 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:47 smithi113 bash[21528]: cluster 2024-04-19T22:37:46.263192+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:47.643 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:47 smithi113 bash[28910]: cluster 2024-04-19T22:37:46.263192+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:47.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:47 smithi178 bash[23441]: cluster 2024-04-19T22:37:46.263192+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/2780186496 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 msgr2=0x7fee3c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- 172.21.15.113:0/2780186496 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c105b60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009990 tx=0x7fee2c009ca0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/2780186496 shutdown_connections 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- 172.21.15.113:0/2780186496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c1060a0 0x7fee3c10c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- 172.21.15.113:0/2780186496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c104500 0x7fee3c104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- 172.21.15.113:0/2780186496 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c105b60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/2780186496 >> 172.21.15.113:0/2780186496 conn(0x7fee3c0ffb00 msgr2=0x7fee3c101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/2780186496 shutdown_connections 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/2780186496 wait complete. 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 Processor -- start 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- start start 2024-04-19T22:37:47.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 0x7fee3c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c10f880 con 0x7fee3c1060a0 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c10f700 con 0x7fee3c104500 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c10fa00 con 0x7fee3c105700 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3bfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3bfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:36342/0 (socket says 172.21.15.113:36342) 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3bfff700 1 -- 172.21.15.113:0/1585445580 learned_addr learned my addr 172.21.15.113:0/1585445580 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:37:47.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3b7fe700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 0x7fee3c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:47.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 -- 172.21.15.113:0/1585445580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 msgr2=0x7fee3c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 0x7fee3c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 -- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 msgr2=0x7fee3c1a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 -- 172.21.15.113:0/1585445580 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c1a1a90 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3bfff700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3b7fe700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 0x7fee3c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee3affd700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c19a370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c026070 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fee2c00fe20 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0173f0 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c1a1d20 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.812+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c1a2120 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3c04ff50 con 0x7fee3c105700 2024-04-19T22:37:47.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 14) ==== 92026+0+0 (secure 0 0 0) 0x7fee2c029070 con 0x7fee3c105700 2024-04-19T22:37:47.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee38ff9700 1 --2- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 0x7fee240703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:37:47.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1069+0+0 (secure 0 0 0) 0x7fee2c08d860 con 0x7fee3c105700 2024-04-19T22:37:47.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee3b7fe700 1 --2- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 0x7fee240703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:37:47.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.816+0000 7fee3b7fe700 1 --2- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 0x7fee240703e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee3c105560 tx=0x7fee30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:37:47.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:47.820+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fee2c013070 con 0x7fee3c105700 2024-04-19T22:37:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:37:48.036+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fee3c062670 con 0x7fee2406df20 2024-04-19T22:37:48.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[21528]: audit 2024-04-19T22:37:48.041539+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:48.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[21528]: audit 2024-04-19T22:37:48.046308+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:37:48.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[21528]: audit 2024-04-19T22:37:48.052318+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:37:48.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[21528]: audit 2024-04-19T22:37:48.053653+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:48.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[28910]: audit 2024-04-19T22:37:48.041539+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:48.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[28910]: audit 2024-04-19T22:37:48.046308+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:37:48.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[28910]: audit 2024-04-19T22:37:48.052318+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:37:48.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:48 smithi113 bash[28910]: audit 2024-04-19T22:37:48.053653+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:48.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:48 smithi178 bash[23441]: audit 2024-04-19T22:37:48.041539+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:37:48.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:48 smithi178 bash[23441]: audit 2024-04-19T22:37:48.046308+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:37:48.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:48 smithi178 bash[23441]: audit 2024-04-19T22:37:48.052318+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:37:48.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:48 smithi178 bash[23441]: audit 2024-04-19T22:37:48.053653+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:37:49.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:49 smithi113 bash[21528]: cluster 2024-04-19T22:37:48.263570+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:49.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:49 smithi113 bash[28910]: cluster 2024-04-19T22:37:48.263570+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:49.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:49 smithi178 bash[23441]: cluster 2024-04-19T22:37:48.263570+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:51.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:51 smithi113 bash[21528]: cluster 2024-04-19T22:37:50.263945+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:51.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:51 smithi113 bash[28910]: cluster 2024-04-19T22:37:50.263945+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:51.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:51 smithi178 bash[23441]: cluster 2024-04-19T22:37:50.263945+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:53.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:53 smithi113 bash[21528]: cluster 2024-04-19T22:37:52.264309+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:53.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:53 smithi113 bash[28910]: cluster 2024-04-19T22:37:52.264309+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:53.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:53 smithi178 bash[23441]: cluster 2024-04-19T22:37:52.264309+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:55.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:55 smithi113 bash[28910]: cluster 2024-04-19T22:37:54.264663+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:55.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:55 smithi113 bash[21528]: cluster 2024-04-19T22:37:54.264663+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:55.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:55 smithi178 bash[23441]: cluster 2024-04-19T22:37:54.264663+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:56.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[21528]: audit 2024-04-19T22:37:56.260882+0000 mon.a (mon.0) 292 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]: dispatch 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[21528]: audit 2024-04-19T22:37:56.263556+0000 mon.a (mon.0) 293 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]': finished 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[21528]: cluster 2024-04-19T22:37:56.268351+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[21528]: audit 2024-04-19T22:37:56.268662+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[28910]: audit 2024-04-19T22:37:56.260882+0000 mon.a (mon.0) 292 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]: dispatch 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[28910]: audit 2024-04-19T22:37:56.263556+0000 mon.a (mon.0) 293 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]': finished 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[28910]: cluster 2024-04-19T22:37:56.268351+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-04-19T22:37:56.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:56 smithi113 bash[28910]: audit 2024-04-19T22:37:56.268662+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:37:56.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:56 smithi178 bash[23441]: audit 2024-04-19T22:37:56.260882+0000 mon.a (mon.0) 292 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]: dispatch 2024-04-19T22:37:56.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:56 smithi178 bash[23441]: audit 2024-04-19T22:37:56.263556+0000 mon.a (mon.0) 293 : audit 1 from='client.? 172.21.15.113:0/3691377863' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf68f079-0f8d-4dca-8791-8e3fe35c1d87"}]': finished 2024-04-19T22:37:56.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:56 smithi178 bash[23441]: cluster 2024-04-19T22:37:56.268351+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-04-19T22:37:56.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:56 smithi178 bash[23441]: audit 2024-04-19T22:37:56.268662+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:37:57.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:57 smithi113 bash[21528]: cluster 2024-04-19T22:37:56.265005+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:57.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:57 smithi113 bash[21528]: audit 2024-04-19T22:37:56.978672+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.113:0/3063586315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:37:57.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:57 smithi113 bash[28910]: cluster 2024-04-19T22:37:56.265005+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:57.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:57 smithi113 bash[28910]: audit 2024-04-19T22:37:56.978672+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.113:0/3063586315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:37:57.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:57 smithi178 bash[23441]: cluster 2024-04-19T22:37:56.265005+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:57.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:57 smithi178 bash[23441]: audit 2024-04-19T22:37:56.978672+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.113:0/3063586315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:37:59.619 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:37:59 smithi113 bash[21528]: cluster 2024-04-19T22:37:58.265391+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:59.619 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:37:59 smithi113 bash[28910]: cluster 2024-04-19T22:37:58.265391+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:37:59.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:37:59 smithi178 bash[23441]: cluster 2024-04-19T22:37:58.265391+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:01.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:01 smithi113 bash[21528]: cluster 2024-04-19T22:38:00.265703+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:01.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:01 smithi113 bash[28910]: cluster 2024-04-19T22:38:00.265703+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:01.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:01 smithi178 bash[23441]: cluster 2024-04-19T22:38:00.265703+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:03.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:03 smithi113 bash[21528]: cluster 2024-04-19T22:38:02.266100+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:03.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:03 smithi113 bash[28910]: cluster 2024-04-19T22:38:02.266100+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:03.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:03 smithi178 bash[23441]: cluster 2024-04-19T22:38:02.266100+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:05.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:05 smithi113 bash[21528]: cluster 2024-04-19T22:38:04.266546+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:05.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:05 smithi113 bash[28910]: cluster 2024-04-19T22:38:04.266546+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:05.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:05 smithi178 bash[23441]: cluster 2024-04-19T22:38:04.266546+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:07.616 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:07 smithi113 bash[21528]: cluster 2024-04-19T22:38:06.266819+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:07.616 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:07 smithi113 bash[28910]: cluster 2024-04-19T22:38:06.266819+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:07.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:07 smithi178 bash[23441]: cluster 2024-04-19T22:38:06.266819+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[21528]: cluster 2024-04-19T22:38:08.267205+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[21528]: audit 2024-04-19T22:38:08.684034+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[21528]: audit 2024-04-19T22:38:08.685421+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[21528]: cephadm 2024-04-19T22:38:08.686791+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi113 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[28910]: cluster 2024-04-19T22:38:08.267205+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[28910]: audit 2024-04-19T22:38:08.684034+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[28910]: audit 2024-04-19T22:38:08.685421+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:09.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:09 smithi113 bash[28910]: cephadm 2024-04-19T22:38:08.686791+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi113 2024-04-19T22:38:09.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:09 smithi178 bash[23441]: cluster 2024-04-19T22:38:08.267205+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:09.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:09 smithi178 bash[23441]: audit 2024-04-19T22:38:08.684034+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-19T22:38:09.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:09 smithi178 bash[23441]: audit 2024-04-19T22:38:08.685421+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:09.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:09 smithi178 bash[23441]: cephadm 2024-04-19T22:38:08.686791+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi113 2024-04-19T22:38:11.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:11 smithi113 bash[21528]: cluster 2024-04-19T22:38:10.267593+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:11.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:11 smithi113 bash[28910]: cluster 2024-04-19T22:38:10.267593+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:11.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:11 smithi178 bash[23441]: cluster 2024-04-19T22:38:10.267593+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:12.948 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:12.948 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:12.948 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:13.291 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:13.291 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:13.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:38:14.291 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[21528]: cluster 2024-04-19T22:38:12.268007+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[21528]: audit 2024-04-19T22:38:13.100556+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[21528]: audit 2024-04-19T22:38:13.105058+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[21528]: audit 2024-04-19T22:38:13.128054+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[28910]: cluster 2024-04-19T22:38:12.268007+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[28910]: audit 2024-04-19T22:38:13.100556+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[28910]: audit 2024-04-19T22:38:13.105058+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:14 smithi113 bash[28910]: audit 2024-04-19T22:38:13.128054+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:14.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:14 smithi178 bash[23441]: cluster 2024-04-19T22:38:12.268007+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:14.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:14 smithi178 bash[23441]: audit 2024-04-19T22:38:13.100556+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:14 smithi178 bash[23441]: audit 2024-04-19T22:38:13.105058+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:14.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:14 smithi178 bash[23441]: audit 2024-04-19T22:38:13.128054+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:16.449 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:16 smithi113 bash[21528]: cluster 2024-04-19T22:38:14.268316+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:16.449 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:16 smithi113 bash[28910]: cluster 2024-04-19T22:38:14.268316+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:16.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:16 smithi178 bash[23441]: cluster 2024-04-19T22:38:14.268316+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:18.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:18 smithi113 bash[21528]: cluster 2024-04-19T22:38:16.268710+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:18.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:18 smithi113 bash[28910]: cluster 2024-04-19T22:38:16.268710+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:18.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:18 smithi178 bash[23441]: cluster 2024-04-19T22:38:16.268710+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:19.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: cluster 2024-04-19T22:38:18.268983+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:19.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: audit 2024-04-19T22:38:18.362836+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: audit 2024-04-19T22:38:18.367739+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: audit 2024-04-19T22:38:18.994034+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: audit 2024-04-19T22:38:18.995523+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[28910]: audit 2024-04-19T22:38:19.003097+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: cluster 2024-04-19T22:38:18.268983+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: audit 2024-04-19T22:38:18.362836+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: audit 2024-04-19T22:38:18.367739+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: audit 2024-04-19T22:38:18.994034+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:19.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: audit 2024-04-19T22:38:18.995523+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:19.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:19 smithi113 bash[21528]: audit 2024-04-19T22:38:19.003097+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: cluster 2024-04-19T22:38:18.268983+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: audit 2024-04-19T22:38:18.362836+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: audit 2024-04-19T22:38:18.367739+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: audit 2024-04-19T22:38:18.994034+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: audit 2024-04-19T22:38:18.995523+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:19 smithi178 bash[23441]: audit 2024-04-19T22:38:19.003097+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:20.654 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:20 smithi113 bash[21528]: audit 2024-04-19T22:38:19.413756+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-19T22:38:20.654 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:20 smithi113 bash[28910]: audit 2024-04-19T22:38:19.413756+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-19T22:38:20.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:20 smithi178 bash[23441]: audit 2024-04-19T22:38:19.413756+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: cluster 2024-04-19T22:38:20.269341+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: audit 2024-04-19T22:38:20.364578+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: cluster 2024-04-19T22:38:20.370787+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: audit 2024-04-19T22:38:20.371603+0000 mon.a (mon.0) 309 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: audit 2024-04-19T22:38:20.372219+0000 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[21528]: audit 2024-04-19T22:38:21.368985+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:38:21.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: cluster 2024-04-19T22:38:20.269341+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: audit 2024-04-19T22:38:20.364578+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-19T22:38:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: cluster 2024-04-19T22:38:20.370787+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-04-19T22:38:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: audit 2024-04-19T22:38:20.371603+0000 mon.a (mon.0) 309 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:38:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: audit 2024-04-19T22:38:20.372219+0000 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:21 smithi113 bash[28910]: audit 2024-04-19T22:38:21.368985+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:38:21.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: cluster 2024-04-19T22:38:20.269341+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: audit 2024-04-19T22:38:20.364578+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-19T22:38:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: cluster 2024-04-19T22:38:20.370787+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-04-19T22:38:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: audit 2024-04-19T22:38:20.371603+0000 mon.a (mon.0) 309 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:38:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: audit 2024-04-19T22:38:20.372219+0000 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:21 smithi178 bash[23441]: audit 2024-04-19T22:38:21.368985+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 v2:172.21.15.113:6801/947963826' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:38:22.047 INFO:teuthology.orchestra.run.smithi113.stdout:Created osd(s) 0 on host 'smithi113' 2024-04-19T22:38:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee38ff9700 1 -- 172.21.15.113:0/1585445580 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fee3c062670 con 0x7fee2406df20 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 msgr2=0x7fee240703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 0x7fee240703e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee3c105560 tx=0x7fee30009260 comp rx=0 tx=0).stop 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 msgr2=0x7fee3c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c19a370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c00f690 comp rx=0 tx=0).stop 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 shutdown_connections 2024-04-19T22:38:22.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> v2:172.21.15.113:6800/467518466 conn(0x7fee2406df20 0x7fee240703e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee3c1060a0 0x7fee3c1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee3c104500 0x7fee3c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 --2- 172.21.15.113:0/1585445580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fee3c105700 0x7fee3c19a370 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 >> 172.21.15.113:0/1585445580 conn(0x7fee3c0ffb00 msgr2=0x7fee3c108a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 shutdown_connections 2024-04-19T22:38:22.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:22.052+0000 7fee41e34700 1 -- 172.21.15.113:0/1585445580 wait complete. 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: cluster 2024-04-19T22:38:21.375598+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: audit 2024-04-19T22:38:21.377340+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: audit 2024-04-19T22:38:21.388488+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: audit 2024-04-19T22:38:22.011031+0000 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: audit 2024-04-19T22:38:22.023330+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.693 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[28910]: audit 2024-04-19T22:38:22.041311+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: cluster 2024-04-19T22:38:21.375598+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: audit 2024-04-19T22:38:21.377340+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: audit 2024-04-19T22:38:21.388488+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: audit 2024-04-19T22:38:22.011031+0000 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: audit 2024-04-19T22:38:22.023330+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.694 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:22 smithi113 bash[21528]: audit 2024-04-19T22:38:22.041311+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:22.696 DEBUG:teuthology.orchestra.run.smithi113:osd.0> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.0.service 2024-04-19T22:38:22.698 INFO:tasks.cephadm:Deploying osd.1 on smithi113 with /dev/vg_nvme/lv_3... 2024-04-19T22:38:22.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-19T22:38:22.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: cluster 2024-04-19T22:38:21.375598+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-04-19T22:38:22.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: audit 2024-04-19T22:38:21.377340+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: audit 2024-04-19T22:38:21.388488+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:22.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: audit 2024-04-19T22:38:22.011031+0000 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: audit 2024-04-19T22:38:22.023330+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:22.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:22 smithi178 bash[23441]: audit 2024-04-19T22:38:22.041311+0000 mon.a (mon.0) 317 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: cluster 2024-04-19T22:38:20.395319+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: cluster 2024-04-19T22:38:20.395444+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: cluster 2024-04-19T22:38:22.269765+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: cluster 2024-04-19T22:38:22.386735+0000 mon.a (mon.0) 318 : cluster 1 osd.0 v2:172.21.15.113:6801/947963826 boot 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: cluster 2024-04-19T22:38:22.386824+0000 mon.a (mon.0) 319 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[28910]: audit 2024-04-19T22:38:22.387439+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: cluster 2024-04-19T22:38:20.395319+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:38:23.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: cluster 2024-04-19T22:38:20.395444+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:38:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: cluster 2024-04-19T22:38:22.269765+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: cluster 2024-04-19T22:38:22.386735+0000 mon.a (mon.0) 318 : cluster 1 osd.0 v2:172.21.15.113:6801/947963826 boot 2024-04-19T22:38:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: cluster 2024-04-19T22:38:22.386824+0000 mon.a (mon.0) 319 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-04-19T22:38:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:23 smithi113 bash[21528]: audit 2024-04-19T22:38:22.387439+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: cluster 2024-04-19T22:38:20.395319+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: cluster 2024-04-19T22:38:20.395444+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: cluster 2024-04-19T22:38:22.269765+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: cluster 2024-04-19T22:38:22.386735+0000 mon.a (mon.0) 318 : cluster 1 osd.0 v2:172.21.15.113:6801/947963826 boot 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: cluster 2024-04-19T22:38:22.386824+0000 mon.a (mon.0) 319 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-04-19T22:38:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:23 smithi178 bash[23441]: audit 2024-04-19T22:38:22.387439+0000 mon.a (mon.0) 320 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:38:24.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:24 smithi113 bash[21528]: cluster 2024-04-19T22:38:23.395368+0000 mon.a (mon.0) 321 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-04-19T22:38:24.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:24 smithi113 bash[28910]: cluster 2024-04-19T22:38:23.395368+0000 mon.a (mon.0) 321 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-04-19T22:38:24.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:24 smithi178 bash[23441]: cluster 2024-04-19T22:38:23.395368+0000 mon.a (mon.0) 321 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-04-19T22:38:25.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:25 smithi113 bash[21528]: cluster 2024-04-19T22:38:24.270211+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:25.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:25 smithi113 bash[28910]: cluster 2024-04-19T22:38:24.270211+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:25.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:25 smithi178 bash[23441]: cluster 2024-04-19T22:38:24.270211+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:27.006 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:38:27.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:27 smithi113 bash[28910]: cluster 2024-04-19T22:38:26.270632+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:27.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:27 smithi113 bash[21528]: cluster 2024-04-19T22:38:26.270632+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:27.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:27 smithi178 bash[23441]: cluster 2024-04-19T22:38:26.270632+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:29.541 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:29 smithi113 bash[21528]: cluster 2024-04-19T22:38:28.270942+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:29.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:29 smithi113 bash[28910]: cluster 2024-04-19T22:38:28.270942+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:29.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:29 smithi178 bash[23441]: cluster 2024-04-19T22:38:28.270942+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-19T22:38:31.786 INFO:teuthology.orchestra.run.smithi113.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-19T22:38:31.787 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 10+0 records in 2024-04-19T22:38:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:10+0 records out 2024-04-19T22:38:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105519 s, 994 MB/s 2024-04-19T22:38:31.787 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 2024-04-19T22:38:31.787 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping successful for: 2024-04-19T22:38:31.791 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:31 smithi113 bash[21528]: cluster 2024-04-19T22:38:30.271317+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:31.791 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:31 smithi113 bash[28910]: cluster 2024-04-19T22:38:30.271317+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:31.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:31 smithi178 bash[23441]: cluster 2024-04-19T22:38:30.271317+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:32.886 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi113:vg_nvme/lv_3 2024-04-19T22:38:34.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: cluster 2024-04-19T22:38:32.271734+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:34.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: cephadm 2024-04-19T22:38:32.935769+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:38:34.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.943281+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.949425+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.950776+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: cephadm 2024-04-19T22:38:32.951606+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi113 to 16241M 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.957703+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.961877+0000 mon.a (mon.0) 326 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.963051+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[21528]: audit 2024-04-19T22:38:32.971730+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: cluster 2024-04-19T22:38:32.271734+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: cephadm 2024-04-19T22:38:32.935769+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.943281+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.949425+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.950776+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: cephadm 2024-04-19T22:38:32.951606+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi113 to 16241M 2024-04-19T22:38:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.957703+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.961877+0000 mon.a (mon.0) 326 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.963051+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:33 smithi113 bash[28910]: audit 2024-04-19T22:38:32.971730+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: cluster 2024-04-19T22:38:32.271734+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:34.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: cephadm 2024-04-19T22:38:32.935769+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.943281+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.949425+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.950776+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: cephadm 2024-04-19T22:38:32.951606+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi113 to 16241M 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.957703+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.961877+0000 mon.a (mon.0) 326 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.963051+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:38:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:33 smithi178 bash[23441]: audit 2024-04-19T22:38:32.971730+0000 mon.a (mon.0) 328 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:38:36.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:35 smithi113 bash[21528]: cluster 2024-04-19T22:38:34.272199+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:36.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:35 smithi113 bash[28910]: cluster 2024-04-19T22:38:34.272199+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:36.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:35 smithi178 bash[23441]: cluster 2024-04-19T22:38:34.272199+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:37.615 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:38:38.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:37 smithi113 bash[21528]: cluster 2024-04-19T22:38:36.272668+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:38.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:37 smithi113 bash[28910]: cluster 2024-04-19T22:38:36.272668+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:38.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:37 smithi178 bash[23441]: cluster 2024-04-19T22:38:36.272668+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:40.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- 172.21.15.113:0/4096353307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103500 msgr2=0x7f13ac103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- 172.21.15.113:0/4096353307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103500 0x7f13ac103960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009920 tx=0x7f13a0009c30 comp rx=0 tx=0).stop 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- 172.21.15.113:0/4096353307 shutdown_connections 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- 172.21.15.113:0/4096353307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac103ea0 0x7f13ac10a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- 172.21.15.113:0/4096353307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac102300 0x7f13ac102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- 172.21.15.113:0/4096353307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103500 0x7f13ac103960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- 172.21.15.113:0/4096353307 >> 172.21.15.113:0/4096353307 conn(0x7f13ac0fd8e0 msgr2=0x7f13ac0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- 172.21.15.113:0/4096353307 shutdown_connections 2024-04-19T22:38:40.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- 172.21.15.113:0/4096353307 wait complete. 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 Processor -- start 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- start start 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac103500 0x7f13ac074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103ea0 0x7f13ac074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10d670 con 0x7f13ac103ea0 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10d4f0 con 0x7f13ac103500 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.124+0000 7f13b4565700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f13ac10d7f0 con 0x7f13ac102300 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2b02700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103ea0 0x7f13ac074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:45624/0 (socket says 172.21.15.113:45624) 2024-04-19T22:38:40.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 -- 172.21.15.113:0/1727374947 learned_addr learned my addr 172.21.15.113:0/1727374947 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b1b00700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac103500 0x7f13ac074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 -- 172.21.15.113:0/1727374947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac103500 msgr2=0x7f13ac074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac103500 0x7f13ac074620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 -- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103ea0 msgr2=0x7f13ac074b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103ea0 0x7f13ac074b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 -- 172.21.15.113:0/1727374947 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac075410 con 0x7f13ac102300 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b2301700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d980 tx=0x7f13a800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8017030 con 0x7f13ac102300 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac1a1dc0 con 0x7f13ac102300 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f13a80044d0 con 0x7f13ac102300 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8003960 con 0x7f13ac102300 2024-04-19T22:38:40.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac1a2210 con 0x7f13ac102300 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac04ff50 con 0x7f13ac102300 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 14) ==== 92026+0+0 (secure 0 0 0) 0x7f13a801a070 con 0x7f13ac102300 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 --2- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 0x7f13980703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1541+0+0 (secure 0 0 0) 0x7f13a808c620 con 0x7f13ac102300 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b1b00700 1 --2- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 0x7f13980703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:38:40.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.128+0000 7f13b1b00700 1 --2- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 0x7f13980703e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13a000a010 tx=0x7f13a0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:38:40.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.136+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f13a805b1f0 con 0x7f13ac102300 2024-04-19T22:38:40.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:39 smithi113 bash[21528]: cluster 2024-04-19T22:38:38.273111+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:40.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:39 smithi113 bash[28910]: cluster 2024-04-19T22:38:38.273111+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:40.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:39 smithi178 bash[23441]: cluster 2024-04-19T22:38:38.273111+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:40.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:38:40.352+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f13ac062670 con 0x7f139806df20 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[21528]: audit 2024-04-19T22:38:40.361889+0000 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[21528]: audit 2024-04-19T22:38:40.367190+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[21528]: audit 2024-04-19T22:38:40.368229+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[28910]: audit 2024-04-19T22:38:40.361889+0000 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[28910]: audit 2024-04-19T22:38:40.367190+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:38:41.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:40 smithi113 bash[28910]: audit 2024-04-19T22:38:40.368229+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:41.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:40 smithi178 bash[23441]: audit 2024-04-19T22:38:40.361889+0000 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:38:41.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:40 smithi178 bash[23441]: audit 2024-04-19T22:38:40.367190+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:38:41.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:40 smithi178 bash[23441]: audit 2024-04-19T22:38:40.368229+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:38:42.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:41 smithi113 bash[21528]: cluster 2024-04-19T22:38:40.273536+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:42.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:41 smithi113 bash[21528]: audit 2024-04-19T22:38:40.358254+0000 mgr.y (mgr.14152) 119 : audit 0 from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:38:42.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:41 smithi113 bash[28910]: cluster 2024-04-19T22:38:40.273536+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:42.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:41 smithi113 bash[28910]: audit 2024-04-19T22:38:40.358254+0000 mgr.y (mgr.14152) 119 : audit 0 from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:38:42.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:41 smithi178 bash[23441]: cluster 2024-04-19T22:38:40.273536+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:42.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:41 smithi178 bash[23441]: audit 2024-04-19T22:38:40.358254+0000 mgr.y (mgr.14152) 119 : audit 0 from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:38:44.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:43 smithi113 bash[21528]: cluster 2024-04-19T22:38:42.274007+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:44.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:43 smithi113 bash[28910]: cluster 2024-04-19T22:38:42.274007+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:44.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:43 smithi178 bash[23441]: cluster 2024-04-19T22:38:42.274007+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:46.216 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:45 smithi113 bash[21528]: cluster 2024-04-19T22:38:44.274538+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:46.216 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:45 smithi113 bash[28910]: cluster 2024-04-19T22:38:44.274538+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:46.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:45 smithi178 bash[23441]: cluster 2024-04-19T22:38:44.274538+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:48.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:47 smithi113 bash[21528]: cluster 2024-04-19T22:38:46.274827+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:48.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:47 smithi113 bash[28910]: cluster 2024-04-19T22:38:46.274827+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:48.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:47 smithi178 bash[23441]: cluster 2024-04-19T22:38:46.274827+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:49.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[21528]: audit 2024-04-19T22:38:48.836961+0000 mon.a (mon.0) 332 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]: dispatch 2024-04-19T22:38:49.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[21528]: audit 2024-04-19T22:38:48.839388+0000 mon.a (mon.0) 333 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]': finished 2024-04-19T22:38:49.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[21528]: cluster 2024-04-19T22:38:48.845490+0000 mon.a (mon.0) 334 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-04-19T22:38:49.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[21528]: audit 2024-04-19T22:38:48.845807+0000 mon.a (mon.0) 335 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:38:49.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[28910]: audit 2024-04-19T22:38:48.836961+0000 mon.a (mon.0) 332 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]: dispatch 2024-04-19T22:38:49.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[28910]: audit 2024-04-19T22:38:48.839388+0000 mon.a (mon.0) 333 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]': finished 2024-04-19T22:38:49.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[28910]: cluster 2024-04-19T22:38:48.845490+0000 mon.a (mon.0) 334 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-04-19T22:38:49.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:48 smithi113 bash[28910]: audit 2024-04-19T22:38:48.845807+0000 mon.a (mon.0) 335 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:38:49.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:48 smithi178 bash[23441]: audit 2024-04-19T22:38:48.836961+0000 mon.a (mon.0) 332 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]: dispatch 2024-04-19T22:38:49.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:48 smithi178 bash[23441]: audit 2024-04-19T22:38:48.839388+0000 mon.a (mon.0) 333 : audit 1 from='client.? 172.21.15.113:0/2829424817' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88cfae52-7613-4c00-91bc-ffb48af3915d"}]': finished 2024-04-19T22:38:49.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:48 smithi178 bash[23441]: cluster 2024-04-19T22:38:48.845490+0000 mon.a (mon.0) 334 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-04-19T22:38:49.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:48 smithi178 bash[23441]: audit 2024-04-19T22:38:48.845807+0000 mon.a (mon.0) 335 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:38:50.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:49 smithi113 bash[21528]: cluster 2024-04-19T22:38:48.275210+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:50.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:49 smithi113 bash[21528]: audit 2024-04-19T22:38:49.611316+0000 mon.a (mon.0) 336 : audit 0 from='client.? 172.21.15.113:0/2696986389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:38:50.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:49 smithi113 bash[28910]: cluster 2024-04-19T22:38:48.275210+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:50.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:49 smithi113 bash[28910]: audit 2024-04-19T22:38:49.611316+0000 mon.a (mon.0) 336 : audit 0 from='client.? 172.21.15.113:0/2696986389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:38:50.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:49 smithi178 bash[23441]: cluster 2024-04-19T22:38:48.275210+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:50.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:49 smithi178 bash[23441]: audit 2024-04-19T22:38:49.611316+0000 mon.a (mon.0) 336 : audit 0 from='client.? 172.21.15.113:0/2696986389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:38:52.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:51 smithi113 bash[21528]: cluster 2024-04-19T22:38:50.275695+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:52.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:51 smithi113 bash[28910]: cluster 2024-04-19T22:38:50.275695+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:52.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:51 smithi178 bash[23441]: cluster 2024-04-19T22:38:50.275695+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:54.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:53 smithi113 bash[28910]: cluster 2024-04-19T22:38:52.276178+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:54.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:53 smithi113 bash[21528]: cluster 2024-04-19T22:38:52.276178+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:54.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:53 smithi178 bash[23441]: cluster 2024-04-19T22:38:52.276178+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:56.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:55 smithi113 bash[21528]: cluster 2024-04-19T22:38:54.276703+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:56.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:55 smithi113 bash[28910]: cluster 2024-04-19T22:38:54.276703+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:56.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:55 smithi178 bash[23441]: cluster 2024-04-19T22:38:54.276703+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:58.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:38:57 smithi113 bash[21528]: cluster 2024-04-19T22:38:56.277226+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:58.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:38:57 smithi113 bash[28910]: cluster 2024-04-19T22:38:56.277226+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:38:58.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:38:57 smithi178 bash[23441]: cluster 2024-04-19T22:38:56.277226+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:00.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:00 smithi113 bash[21528]: cluster 2024-04-19T22:38:58.277670+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:00.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:00 smithi113 bash[28910]: cluster 2024-04-19T22:38:58.277670+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:00.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:00 smithi178 bash[23441]: cluster 2024-04-19T22:38:58.277670+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:02.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[21528]: cluster 2024-04-19T22:39:00.278141+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:02.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[21528]: audit 2024-04-19T22:39:01.621260+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-19T22:39:02.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[21528]: audit 2024-04-19T22:39:01.623391+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:02.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[28910]: cluster 2024-04-19T22:39:00.278141+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:02.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[28910]: audit 2024-04-19T22:39:01.621260+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-19T22:39:02.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:02 smithi113 bash[28910]: audit 2024-04-19T22:39:01.623391+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:02.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:02 smithi178 bash[23441]: cluster 2024-04-19T22:39:00.278141+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:02.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:02 smithi178 bash[23441]: audit 2024-04-19T22:39:01.621260+0000 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-19T22:39:02.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:02 smithi178 bash[23441]: audit 2024-04-19T22:39:01.623391+0000 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:03.249 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:03 smithi113 bash[21528]: cephadm 2024-04-19T22:39:01.625211+0000 mgr.y (mgr.14152) 130 : cephadm 1 Deploying daemon osd.1 on smithi113 2024-04-19T22:39:03.249 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:03 smithi113 bash[28910]: cephadm 2024-04-19T22:39:01.625211+0000 mgr.y (mgr.14152) 130 : cephadm 1 Deploying daemon osd.1 on smithi113 2024-04-19T22:39:03.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:03 smithi178 bash[23441]: cephadm 2024-04-19T22:39:01.625211+0000 mgr.y (mgr.14152) 130 : cephadm 1 Deploying daemon osd.1 on smithi113 2024-04-19T22:39:04.042 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:04 smithi113 bash[28910]: cluster 2024-04-19T22:39:02.278604+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:04.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:04 smithi113 bash[21528]: cluster 2024-04-19T22:39:02.278604+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:04.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:04 smithi178 bash[23441]: cluster 2024-04-19T22:39:02.278604+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:05.949 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:39:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:05.949 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:05.949 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:05.950 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:39:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:06.218 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:06 smithi113 bash[21528]: cluster 2024-04-19T22:39:04.278915+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:06.218 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:06.218 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:06 smithi113 bash[28910]: cluster 2024-04-19T22:39:04.278915+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:06.218 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:06.219 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:39:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:06.219 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:39:06 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:06.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:06 smithi178 bash[23441]: cluster 2024-04-19T22:39:04.278915+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:07.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[21528]: audit 2024-04-19T22:39:06.219223+0000 mon.a (mon.0) 339 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[21528]: audit 2024-04-19T22:39:06.224900+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[21528]: audit 2024-04-19T22:39:06.238604+0000 mon.a (mon.0) 341 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:07.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[28910]: audit 2024-04-19T22:39:06.219223+0000 mon.a (mon.0) 339 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[28910]: audit 2024-04-19T22:39:06.224900+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:07 smithi113 bash[28910]: audit 2024-04-19T22:39:06.238604+0000 mon.a (mon.0) 341 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:07.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:07 smithi178 bash[23441]: audit 2024-04-19T22:39:06.219223+0000 mon.a (mon.0) 339 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:07 smithi178 bash[23441]: audit 2024-04-19T22:39:06.224900+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:07.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:07 smithi178 bash[23441]: audit 2024-04-19T22:39:06.238604+0000 mon.a (mon.0) 341 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:08.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:08 smithi113 bash[28910]: cluster 2024-04-19T22:39:06.279200+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:08.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:08 smithi113 bash[21528]: cluster 2024-04-19T22:39:06.279200+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:08.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:08 smithi178 bash[23441]: cluster 2024-04-19T22:39:06.279200+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:10.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:10 smithi113 bash[21528]: cluster 2024-04-19T22:39:08.279704+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:10.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:10 smithi113 bash[28910]: cluster 2024-04-19T22:39:08.279704+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:10.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:10 smithi178 bash[23441]: cluster 2024-04-19T22:39:08.279704+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:12.430 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: cluster 2024-04-19T22:39:10.280198+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:12.430 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: audit 2024-04-19T22:39:11.529721+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: audit 2024-04-19T22:39:11.534080+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: audit 2024-04-19T22:39:11.534980+0000 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: audit 2024-04-19T22:39:11.536207+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[21528]: audit 2024-04-19T22:39:11.542302+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: cluster 2024-04-19T22:39:10.280198+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: audit 2024-04-19T22:39:11.529721+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: audit 2024-04-19T22:39:11.534080+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: audit 2024-04-19T22:39:11.534980+0000 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: audit 2024-04-19T22:39:11.536207+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:12.431 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:12 smithi113 bash[28910]: audit 2024-04-19T22:39:11.542302+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: cluster 2024-04-19T22:39:10.280198+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: audit 2024-04-19T22:39:11.529721+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: audit 2024-04-19T22:39:11.534080+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: audit 2024-04-19T22:39:11.534980+0000 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: audit 2024-04-19T22:39:11.536207+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:12.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:12 smithi178 bash[23441]: audit 2024-04-19T22:39:11.542302+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:13.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:13 smithi113 bash[21528]: audit 2024-04-19T22:39:12.846426+0000 mon.c (mon.2) 4 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:13.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:13 smithi113 bash[21528]: audit 2024-04-19T22:39:12.846794+0000 mon.a (mon.0) 347 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:13.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:13 smithi113 bash[28910]: audit 2024-04-19T22:39:12.846426+0000 mon.c (mon.2) 4 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:13.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:13 smithi113 bash[28910]: audit 2024-04-19T22:39:12.846794+0000 mon.a (mon.0) 347 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:13.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:13 smithi178 bash[23441]: audit 2024-04-19T22:39:12.846426+0000 mon.c (mon.2) 4 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:13.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:13 smithi178 bash[23441]: audit 2024-04-19T22:39:12.846794+0000 mon.a (mon.0) 347 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: cluster 2024-04-19T22:39:12.280504+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: audit 2024-04-19T22:39:13.246024+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: cluster 2024-04-19T22:39:13.249581+0000 mon.a (mon.0) 349 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: audit 2024-04-19T22:39:13.249884+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: audit 2024-04-19T22:39:13.252935+0000 mon.c (mon.2) 5 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:14.516 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[21528]: audit 2024-04-19T22:39:13.253351+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: cluster 2024-04-19T22:39:12.280504+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: audit 2024-04-19T22:39:13.246024+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: cluster 2024-04-19T22:39:13.249581+0000 mon.a (mon.0) 349 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: audit 2024-04-19T22:39:13.249884+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: audit 2024-04-19T22:39:13.252935+0000 mon.c (mon.2) 5 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:14.517 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:14 smithi113 bash[28910]: audit 2024-04-19T22:39:13.253351+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: cluster 2024-04-19T22:39:12.280504+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: audit 2024-04-19T22:39:13.246024+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: cluster 2024-04-19T22:39:13.249581+0000 mon.a (mon.0) 349 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: audit 2024-04-19T22:39:13.249884+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: audit 2024-04-19T22:39:13.252935+0000 mon.c (mon.2) 5 : audit 1 from='osd.1 v2:172.21.15.113:6805/3290228916' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:14.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:14 smithi178 bash[23441]: audit 2024-04-19T22:39:13.253351+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:39:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f139f7fe700 1 -- 172.21.15.113:0/1727374947 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13ac062670 con 0x7f139806df20 2024-04-19T22:39:15.264 INFO:teuthology.orchestra.run.smithi113.stdout:Created osd(s) 1 on host 'smithi113' 2024-04-19T22:39:15.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 msgr2=0x7f13980703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:39:15.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 0x7f13980703e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13a000a010 tx=0x7f13a0019040 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 msgr2=0x7f13ac075fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d980 tx=0x7f13a800dc90 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 shutdown_connections 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> v2:172.21.15.113:6800/467518466 conn(0x7f139806df20 0x7f13980703e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13ac103ea0 0x7f13ac074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13ac102300 0x7f13ac075fd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 --2- 172.21.15.113:0/1727374947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13ac103500 0x7f13ac074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 >> 172.21.15.113:0/1727374947 conn(0x7f13ac0fd8e0 msgr2=0x7f13ac106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 shutdown_connections 2024-04-19T22:39:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:15.267+0000 7f13b4565700 1 -- 172.21.15.113:0/1727374947 wait complete. 2024-04-19T22:39:15.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:14.248126+0000 mon.a (mon.0) 352 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:39:15.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: cluster 2024-04-19T22:39:14.253481+0000 mon.a (mon.0) 353 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:14.254705+0000 mon.a (mon.0) 354 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:14.260925+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: cluster 2024-04-19T22:39:14.280795+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:15.213455+0000 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:15.214763+0000 mon.a (mon.0) 357 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[21528]: audit 2024-04-19T22:39:15.222649+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:14.248126+0000 mon.a (mon.0) 352 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: cluster 2024-04-19T22:39:14.253481+0000 mon.a (mon.0) 353 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:14.254705+0000 mon.a (mon.0) 354 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:14.260925+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: cluster 2024-04-19T22:39:14.280795+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:15.213455+0000 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:15.214763+0000 mon.a (mon.0) 357 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:15 smithi113 bash[28910]: audit 2024-04-19T22:39:15.222649+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:14.248126+0000 mon.a (mon.0) 352 : audit 1 from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: cluster 2024-04-19T22:39:14.253481+0000 mon.a (mon.0) 353 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:14.254705+0000 mon.a (mon.0) 354 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:14.260925+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: cluster 2024-04-19T22:39:14.280795+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:15.213455+0000 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:15.214763+0000 mon.a (mon.0) 357 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:39:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:15 smithi178 bash[23441]: audit 2024-04-19T22:39:15.222649+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:15.998 DEBUG:teuthology.orchestra.run.smithi113:osd.1> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.1.service 2024-04-19T22:39:16.001 INFO:tasks.cephadm:Deploying osd.2 on smithi113 with /dev/vg_nvme/lv_2... 2024-04-19T22:39:16.001 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-19T22:39:16.261 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[21528]: cluster 2024-04-19T22:39:13.872500+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:39:16.262 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[21528]: cluster 2024-04-19T22:39:13.872626+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:39:16.262 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[21528]: cluster 2024-04-19T22:39:15.263779+0000 mon.a (mon.0) 359 : cluster 1 osd.1 v2:172.21.15.113:6805/3290228916 boot 2024-04-19T22:39:16.262 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[21528]: cluster 2024-04-19T22:39:15.263863+0000 mon.a (mon.0) 360 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-04-19T22:39:16.262 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[21528]: audit 2024-04-19T22:39:15.264596+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:16.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[28910]: cluster 2024-04-19T22:39:13.872500+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:39:16.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[28910]: cluster 2024-04-19T22:39:13.872626+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:39:16.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[28910]: cluster 2024-04-19T22:39:15.263779+0000 mon.a (mon.0) 359 : cluster 1 osd.1 v2:172.21.15.113:6805/3290228916 boot 2024-04-19T22:39:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[28910]: cluster 2024-04-19T22:39:15.263863+0000 mon.a (mon.0) 360 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-04-19T22:39:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:16 smithi113 bash[28910]: audit 2024-04-19T22:39:15.264596+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:16.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:16 smithi178 bash[23441]: cluster 2024-04-19T22:39:13.872500+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:39:16.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:16 smithi178 bash[23441]: cluster 2024-04-19T22:39:13.872626+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:39:16.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:16 smithi178 bash[23441]: cluster 2024-04-19T22:39:15.263779+0000 mon.a (mon.0) 359 : cluster 1 osd.1 v2:172.21.15.113:6805/3290228916 boot 2024-04-19T22:39:16.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:16 smithi178 bash[23441]: cluster 2024-04-19T22:39:15.263863+0000 mon.a (mon.0) 360 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-04-19T22:39:16.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:16 smithi178 bash[23441]: audit 2024-04-19T22:39:15.264596+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:39:17.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:17 smithi113 bash[21528]: cluster 2024-04-19T22:39:16.274871+0000 mon.a (mon.0) 362 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-04-19T22:39:17.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:17 smithi113 bash[21528]: cluster 2024-04-19T22:39:16.281026+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:17.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:17 smithi113 bash[28910]: cluster 2024-04-19T22:39:16.274871+0000 mon.a (mon.0) 362 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-04-19T22:39:17.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:17 smithi113 bash[28910]: cluster 2024-04-19T22:39:16.281026+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:17.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:17 smithi178 bash[23441]: cluster 2024-04-19T22:39:16.274871+0000 mon.a (mon.0) 362 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-04-19T22:39:17.548 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:17 smithi178 bash[23441]: cluster 2024-04-19T22:39:16.281026+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:19.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:19 smithi113 bash[21528]: cluster 2024-04-19T22:39:18.281453+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:19.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:19 smithi113 bash[28910]: cluster 2024-04-19T22:39:18.281453+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:19.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:19 smithi178 bash[23441]: cluster 2024-04-19T22:39:18.281453+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:20.199 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:39:21.644 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:21 smithi113 bash[28910]: cluster 2024-04-19T22:39:20.281908+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:21.644 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:21 smithi113 bash[21528]: cluster 2024-04-19T22:39:20.281908+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:21 smithi178 bash[23441]: cluster 2024-04-19T22:39:20.281908+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:23.792 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:23 smithi113 bash[21528]: cluster 2024-04-19T22:39:22.282330+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:23.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:23 smithi113 bash[28910]: cluster 2024-04-19T22:39:22.282330+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:23.798 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:23 smithi178 bash[23441]: cluster 2024-04-19T22:39:22.282330+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:24.465 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 10+0 records in 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:10+0 records out 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010187 s, 1.0 GB/s 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 2024-04-19T22:39:24.466 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping successful for: 2024-04-19T22:39:25.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi113:vg_nvme/lv_2 2024-04-19T22:39:25.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:25 smithi113 bash[21528]: cluster 2024-04-19T22:39:24.282600+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:25.542 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:25 smithi113 bash[28910]: cluster 2024-04-19T22:39:24.282600+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:25.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:25 smithi178 bash[23441]: cluster 2024-04-19T22:39:24.282600+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: cephadm 2024-04-19T22:39:25.757898+0000 mgr.y (mgr.14152) 143 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.766912+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.776444+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.778901+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.780702+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: cephadm 2024-04-19T22:39:25.782065+0000 mgr.y (mgr.14152) 144 : cephadm 1 Adjusting osd_memory_target on smithi113 to 8120M 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.788599+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.792917+0000 mon.a (mon.0) 368 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.794561+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:27.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[21528]: audit 2024-04-19T22:39:25.803982+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: cephadm 2024-04-19T22:39:25.757898+0000 mgr.y (mgr.14152) 143 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.766912+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.776444+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.778901+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.780702+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: cephadm 2024-04-19T22:39:25.782065+0000 mgr.y (mgr.14152) 144 : cephadm 1 Adjusting osd_memory_target on smithi113 to 8120M 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.788599+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.792917+0000 mon.a (mon.0) 368 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.794561+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:27.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:26 smithi113 bash[28910]: audit 2024-04-19T22:39:25.803982+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: cephadm 2024-04-19T22:39:25.757898+0000 mgr.y (mgr.14152) 143 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.766912+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.776444+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.778901+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.780702+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: cephadm 2024-04-19T22:39:25.782065+0000 mgr.y (mgr.14152) 144 : cephadm 1 Adjusting osd_memory_target on smithi113 to 8120M 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.788599+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:27.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.792917+0000 mon.a (mon.0) 368 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:27.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.794561+0000 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:39:27.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:26 smithi178 bash[23441]: audit 2024-04-19T22:39:25.803982+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:39:28.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:27 smithi178 bash[23441]: cluster 2024-04-19T22:39:26.282975+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:28.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:27 smithi113 bash[21528]: cluster 2024-04-19T22:39:26.282975+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:28.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:27 smithi113 bash[28910]: cluster 2024-04-19T22:39:26.282975+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:30.049 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:39:30.070 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:29 smithi113 bash[21528]: cluster 2024-04-19T22:39:28.283437+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:30.071 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:29 smithi113 bash[28910]: cluster 2024-04-19T22:39:28.283437+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:30.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:29 smithi178 bash[23441]: cluster 2024-04-19T22:39:28.283437+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:32.042 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:31 smithi113 bash[28910]: cluster 2024-04-19T22:39:30.283922+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:32.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:31 smithi113 bash[21528]: cluster 2024-04-19T22:39:30.283922+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:32.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:31 smithi178 bash[23441]: cluster 2024-04-19T22:39:30.283922+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:32.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/46907163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630102430 msgr2=0x7f96301028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- 172.21.15.113:0/46907163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630102430 0x7f96301028b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9628009990 tx=0x7f9628009ca0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/46907163 shutdown_connections 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- 172.21.15.113:0/46907163 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 0x7f9630109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- 172.21.15.113:0/46907163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630101710 0x7f9630101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- 172.21.15.113:0/46907163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630102430 0x7f96301028b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/46907163 >> 172.21.15.113:0/46907163 conn(0x7f96300fbf30 msgr2=0x7f96300fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/46907163 shutdown_connections 2024-04-19T22:39:32.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/46907163 wait complete. 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 Processor -- start 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- start start 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 0x7f963010a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 0x7f963010a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f963010d690 con 0x7f9630101710 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f963010d510 con 0x7f9630102430 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f963010d810 con 0x7f9630102df0 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33090/0 (socket says 172.21.15.113:33090) 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 -- 172.21.15.113:0/243922113 learned_addr learned my addr 172.21.15.113:0/243922113 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:39:32.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963597c700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 0x7f963010a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963497a700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 0x7f963010a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 -- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 msgr2=0x7f963010a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 0x7f963010a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 -- 172.21.15.113:0/243922113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 msgr2=0x7f963010a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 0x7f963010a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 -- 172.21.15.113:0/243922113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963010ae70 con 0x7f9630101710 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963497a700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 0x7f963010a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f963517b700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9618007f10 tx=0x7f961800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961800dbd0 con 0x7f9630101710 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96301a1d90 con 0x7f9630101710 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f961800dd70 con 0x7f9630101710 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96180133f0 con 0x7f9630101710 2024-04-19T22:39:32.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.691+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301a2210 con 0x7f9630101710 2024-04-19T22:39:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963004ff50 con 0x7f9630101710 2024-04-19T22:39:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 14) ==== 92026+0+0 (secure 0 0 0) 0x7f961801a020 con 0x7f9630101710 2024-04-19T22:39:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f962e7fc700 1 --2- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 0x7f961c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:39:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 1833+0+0 (secure 0 0 0) 0x7f961808c440 con 0x7f9630101710 2024-04-19T22:39:32.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f963497a700 1 --2- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 0x7f961c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:39:32.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.695+0000 7f963497a700 1 --2- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 0x7f961c0703e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f962800b2e0 tx=0x7f962801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:39:32.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.699+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f9618010070 con 0x7f9630101710 2024-04-19T22:39:32.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:39:32.915+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9630062670 con 0x7f961c06df20 2024-04-19T22:39:34.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[28910]: cluster 2024-04-19T22:39:32.284384+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:34.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[28910]: audit 2024-04-19T22:39:32.923724+0000 mgr.y (mgr.14152) 149 : audit 0 from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[28910]: audit 2024-04-19T22:39:32.928570+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[28910]: audit 2024-04-19T22:39:32.933846+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[28910]: audit 2024-04-19T22:39:32.934771+0000 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[21528]: cluster 2024-04-19T22:39:32.284384+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[21528]: audit 2024-04-19T22:39:32.923724+0000 mgr.y (mgr.14152) 149 : audit 0 from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[21528]: audit 2024-04-19T22:39:32.928570+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[21528]: audit 2024-04-19T22:39:32.933846+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:39:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:33 smithi113 bash[21528]: audit 2024-04-19T22:39:32.934771+0000 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:33 smithi178 bash[23441]: cluster 2024-04-19T22:39:32.284384+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:33 smithi178 bash[23441]: audit 2024-04-19T22:39:32.923724+0000 mgr.y (mgr.14152) 149 : audit 0 from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:39:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:33 smithi178 bash[23441]: audit 2024-04-19T22:39:32.928570+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:39:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:33 smithi178 bash[23441]: audit 2024-04-19T22:39:32.933846+0000 mon.a (mon.0) 372 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:39:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:33 smithi178 bash[23441]: audit 2024-04-19T22:39:32.934771+0000 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:36.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:35 smithi113 bash[21528]: cluster 2024-04-19T22:39:34.284786+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:36.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:35 smithi113 bash[28910]: cluster 2024-04-19T22:39:34.284786+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:36.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:35 smithi178 bash[23441]: cluster 2024-04-19T22:39:34.284786+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:38.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:37 smithi113 bash[21528]: cluster 2024-04-19T22:39:36.285292+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:38.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:37 smithi113 bash[28910]: cluster 2024-04-19T22:39:36.285292+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:38.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:37 smithi178 bash[23441]: cluster 2024-04-19T22:39:36.285292+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:40.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:39 smithi113 bash[21528]: cluster 2024-04-19T22:39:38.285736+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:40.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:39 smithi113 bash[28910]: cluster 2024-04-19T22:39:38.285736+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:40.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:39 smithi178 bash[23441]: cluster 2024-04-19T22:39:38.285736+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:42.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: cluster 2024-04-19T22:39:40.286149+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: audit 2024-04-19T22:39:41.321757+0000 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.113:0/2620649783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: audit 2024-04-19T22:39:41.322329+0000 mon.a (mon.0) 374 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: audit 2024-04-19T22:39:41.325025+0000 mon.a (mon.0) 375 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]': finished 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: cluster 2024-04-19T22:39:41.327524+0000 mon.a (mon.0) 376 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[21528]: audit 2024-04-19T22:39:41.328108+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: cluster 2024-04-19T22:39:40.286149+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: audit 2024-04-19T22:39:41.321757+0000 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.113:0/2620649783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: audit 2024-04-19T22:39:41.322329+0000 mon.a (mon.0) 374 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: audit 2024-04-19T22:39:41.325025+0000 mon.a (mon.0) 375 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]': finished 2024-04-19T22:39:42.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: cluster 2024-04-19T22:39:41.327524+0000 mon.a (mon.0) 376 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-04-19T22:39:42.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:41 smithi113 bash[28910]: audit 2024-04-19T22:39:41.328108+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: cluster 2024-04-19T22:39:40.286149+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: audit 2024-04-19T22:39:41.321757+0000 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.113:0/2620649783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: audit 2024-04-19T22:39:41.322329+0000 mon.a (mon.0) 374 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]: dispatch 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: audit 2024-04-19T22:39:41.325025+0000 mon.a (mon.0) 375 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cb5d205-e57e-41c2-ad9d-1963cd39ad8c"}]': finished 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: cluster 2024-04-19T22:39:41.327524+0000 mon.a (mon.0) 376 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-04-19T22:39:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:41 smithi178 bash[23441]: audit 2024-04-19T22:39:41.328108+0000 mon.a (mon.0) 377 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:39:43.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:42 smithi113 bash[21528]: audit 2024-04-19T22:39:42.047158+0000 mon.a (mon.0) 378 : audit 0 from='client.? 172.21.15.113:0/3124712451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:39:43.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:42 smithi113 bash[28910]: audit 2024-04-19T22:39:42.047158+0000 mon.a (mon.0) 378 : audit 0 from='client.? 172.21.15.113:0/3124712451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:39:43.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:42 smithi178 bash[23441]: audit 2024-04-19T22:39:42.047158+0000 mon.a (mon.0) 378 : audit 0 from='client.? 172.21.15.113:0/3124712451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:39:44.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:43 smithi113 bash[21528]: cluster 2024-04-19T22:39:42.286560+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:44.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:43 smithi113 bash[28910]: cluster 2024-04-19T22:39:42.286560+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:44.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:43 smithi178 bash[23441]: cluster 2024-04-19T22:39:42.286560+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:46.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:45 smithi113 bash[21528]: cluster 2024-04-19T22:39:44.286996+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:46.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:45 smithi113 bash[28910]: cluster 2024-04-19T22:39:44.286996+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:46.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:45 smithi178 bash[23441]: cluster 2024-04-19T22:39:44.286996+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:48.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:47 smithi113 bash[21528]: cluster 2024-04-19T22:39:46.287471+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:48.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:47 smithi113 bash[28910]: cluster 2024-04-19T22:39:46.287471+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:48.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:47 smithi178 bash[23441]: cluster 2024-04-19T22:39:46.287471+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:50.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:49 smithi113 bash[21528]: cluster 2024-04-19T22:39:48.287963+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:50.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:49 smithi113 bash[28910]: cluster 2024-04-19T22:39:48.287963+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:50.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:49 smithi178 bash[23441]: cluster 2024-04-19T22:39:48.287963+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:52.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:51 smithi113 bash[21528]: cluster 2024-04-19T22:39:50.288433+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:52.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:51 smithi113 bash[28910]: cluster 2024-04-19T22:39:50.288433+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:52.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:51 smithi178 bash[23441]: cluster 2024-04-19T22:39:50.288433+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:54.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:53 smithi113 bash[21528]: cluster 2024-04-19T22:39:52.288938+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:54.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:53 smithi113 bash[28910]: cluster 2024-04-19T22:39:52.288938+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:54.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:53 smithi178 bash[23441]: cluster 2024-04-19T22:39:52.288938+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:55.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:54 smithi113 bash[21528]: audit 2024-04-19T22:39:54.294107+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-19T22:39:55.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:54 smithi113 bash[21528]: audit 2024-04-19T22:39:54.295638+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:55.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:54 smithi113 bash[28910]: audit 2024-04-19T22:39:54.294107+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-19T22:39:55.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:54 smithi113 bash[28910]: audit 2024-04-19T22:39:54.295638+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:55.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:54 smithi178 bash[23441]: audit 2024-04-19T22:39:54.294107+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-19T22:39:55.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:54 smithi178 bash[23441]: audit 2024-04-19T22:39:54.295638+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:39:56.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:55 smithi113 bash[21528]: cluster 2024-04-19T22:39:54.289370+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:56.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:55 smithi113 bash[21528]: cephadm 2024-04-19T22:39:54.297157+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi113 2024-04-19T22:39:56.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:55 smithi113 bash[28910]: cluster 2024-04-19T22:39:54.289370+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:56.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:55 smithi113 bash[28910]: cephadm 2024-04-19T22:39:54.297157+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi113 2024-04-19T22:39:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:55 smithi178 bash[23441]: cluster 2024-04-19T22:39:54.289370+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:55 smithi178 bash[23441]: cephadm 2024-04-19T22:39:54.297157+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi113 2024-04-19T22:39:58.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:57 smithi113 bash[21528]: cluster 2024-04-19T22:39:56.289881+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:58.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:57 smithi113 bash[28910]: cluster 2024-04-19T22:39:56.289881+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:58.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:39:57 smithi178 bash[23441]: cluster 2024-04-19T22:39:56.289881+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:39:58.965 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:58 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:58.965 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:39:58 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:58.965 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:39:58 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:58.966 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:58 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:58.966 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:39:58 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:59.237 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:39:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:59.237 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:39:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:59.237 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:39:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:59.238 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:39:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:39:59.238 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:39:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[21528]: cluster 2024-04-19T22:39:58.290333+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[21528]: audit 2024-04-19T22:39:59.244432+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[21528]: audit 2024-04-19T22:39:59.249040+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[21528]: audit 2024-04-19T22:39:59.270637+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[21528]: cluster 2024-04-19T22:40:00.000137+0000 mon.a (mon.0) 384 : cluster 1 overall HEALTH_OK 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[28910]: cluster 2024-04-19T22:39:58.290333+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[28910]: audit 2024-04-19T22:39:59.244432+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[28910]: audit 2024-04-19T22:39:59.249040+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[28910]: audit 2024-04-19T22:39:59.270637+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:00 smithi113 bash[28910]: cluster 2024-04-19T22:40:00.000137+0000 mon.a (mon.0) 384 : cluster 1 overall HEALTH_OK 2024-04-19T22:40:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:00 smithi178 bash[23441]: cluster 2024-04-19T22:39:58.290333+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:00 smithi178 bash[23441]: audit 2024-04-19T22:39:59.244432+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:00 smithi178 bash[23441]: audit 2024-04-19T22:39:59.249040+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:00 smithi178 bash[23441]: audit 2024-04-19T22:39:59.270637+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:00 smithi178 bash[23441]: cluster 2024-04-19T22:40:00.000137+0000 mon.a (mon.0) 384 : cluster 1 overall HEALTH_OK 2024-04-19T22:40:02.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:02 smithi113 bash[28910]: cluster 2024-04-19T22:40:00.290782+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:02.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:02 smithi113 bash[21528]: cluster 2024-04-19T22:40:00.290782+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:02 smithi178 bash[23441]: cluster 2024-04-19T22:40:00.290782+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:04.542 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:04 smithi113 bash[21528]: cluster 2024-04-19T22:40:02.291199+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:04.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:04 smithi113 bash[28910]: cluster 2024-04-19T22:40:02.291199+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:04 smithi178 bash[23441]: cluster 2024-04-19T22:40:02.291199+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: cluster 2024-04-19T22:40:04.291541+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: audit 2024-04-19T22:40:04.553306+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: audit 2024-04-19T22:40:04.557904+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: audit 2024-04-19T22:40:05.130507+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: audit 2024-04-19T22:40:05.132145+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:05 smithi178 bash[23441]: audit 2024-04-19T22:40:05.141552+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.867 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: cluster 2024-04-19T22:40:04.291541+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:05.867 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: audit 2024-04-19T22:40:04.553306+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.867 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: audit 2024-04-19T22:40:04.557904+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.867 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: audit 2024-04-19T22:40:05.130507+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:05.867 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: audit 2024-04-19T22:40:05.132145+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[28910]: audit 2024-04-19T22:40:05.141552+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: cluster 2024-04-19T22:40:04.291541+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: audit 2024-04-19T22:40:04.553306+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: audit 2024-04-19T22:40:04.557904+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: audit 2024-04-19T22:40:05.130507+0000 mon.a (mon.0) 387 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:05.868 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: audit 2024-04-19T22:40:05.132145+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:05.869 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:05 smithi113 bash[21528]: audit 2024-04-19T22:40:05.141552+0000 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:07.042 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:06 smithi113 bash[21528]: audit 2024-04-19T22:40:05.877596+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-19T22:40:07.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:06 smithi113 bash[28910]: audit 2024-04-19T22:40:05.877596+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-19T22:40:07.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:06 smithi178 bash[23441]: audit 2024-04-19T22:40:05.877596+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-19T22:40:07.926 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[28910]: cluster 2024-04-19T22:40:06.292077+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:07.926 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[28910]: audit 2024-04-19T22:40:06.562880+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-19T22:40:07.926 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[28910]: cluster 2024-04-19T22:40:06.566614+0000 mon.a (mon.0) 392 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-04-19T22:40:07.926 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[28910]: audit 2024-04-19T22:40:06.567041+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:40:07.926 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[28910]: audit 2024-04-19T22:40:06.567508+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:07.927 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[21528]: cluster 2024-04-19T22:40:06.292077+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:07.927 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[21528]: audit 2024-04-19T22:40:06.562880+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-19T22:40:07.927 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[21528]: cluster 2024-04-19T22:40:06.566614+0000 mon.a (mon.0) 392 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-04-19T22:40:07.927 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[21528]: audit 2024-04-19T22:40:06.567041+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:40:07.927 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:07 smithi113 bash[21528]: audit 2024-04-19T22:40:06.567508+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:07 smithi178 bash[23441]: cluster 2024-04-19T22:40:06.292077+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:07 smithi178 bash[23441]: audit 2024-04-19T22:40:06.562880+0000 mon.a (mon.0) 391 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-19T22:40:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:07 smithi178 bash[23441]: cluster 2024-04-19T22:40:06.566614+0000 mon.a (mon.0) 392 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-04-19T22:40:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:07 smithi178 bash[23441]: audit 2024-04-19T22:40:06.567041+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:40:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:07 smithi178 bash[23441]: audit 2024-04-19T22:40:06.567508+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.482+0000 7f962e7fc700 1 -- 172.21.15.113:0/243922113 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9630062670 con 0x7f961c06df20 2024-04-19T22:40:08.483 INFO:teuthology.orchestra.run.smithi113.stdout:Created osd(s) 2 on host 'smithi113' 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 msgr2=0x7f961c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 0x7f961c0703e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f962800b2e0 tx=0x7f962801a040 comp rx=0 tx=0).stop 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 msgr2=0x7f963010ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9618007f10 tx=0x7f961800d3b0 comp rx=0 tx=0).stop 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 shutdown_connections 2024-04-19T22:40:08.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> v2:172.21.15.113:6800/467518466 conn(0x7f961c06df20 0x7f961c0703e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9630102df0 0x7f963010a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9630101710 0x7f963010ba30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 --2- 172.21.15.113:0/243922113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630102430 0x7f963010a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 >> 172.21.15.113:0/243922113 conn(0x7f96300fbf30 msgr2=0x7f9630105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 shutdown_connections 2024-04-19T22:40:08.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:08.486+0000 7f96373df700 1 -- 172.21.15.113:0/243922113 wait complete. 2024-04-19T22:40:08.792 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:07.564376+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: cluster 2024-04-19T22:40:07.568482+0000 mon.a (mon.0) 396 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:07.569643+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:07.576475+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:08.476276+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:08.485645+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[28910]: audit 2024-04-19T22:40:08.486349+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:07.564376+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: cluster 2024-04-19T22:40:07.568482+0000 mon.a (mon.0) 396 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:07.569643+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:07.576475+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:08.476276+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:08.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:08.485645+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:08.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:08 smithi113 bash[21528]: audit 2024-04-19T22:40:08.486349+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:07.564376+0000 mon.a (mon.0) 395 : audit 1 from='osd.2 v2:172.21.15.113:6809/2132568950' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: cluster 2024-04-19T22:40:07.568482+0000 mon.a (mon.0) 396 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:07.569643+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:07.576475+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:08.476276+0000 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:08.485645+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:09.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:08 smithi178 bash[23441]: audit 2024-04-19T22:40:08.486349+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:09.226 DEBUG:teuthology.orchestra.run.smithi113:osd.2> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.2.service 2024-04-19T22:40:09.230 INFO:tasks.cephadm:Deploying osd.3 on smithi113 with /dev/vg_nvme/lv_1... 2024-04-19T22:40:09.230 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: cluster 2024-04-19T22:40:06.914364+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: cluster 2024-04-19T22:40:06.914507+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: cluster 2024-04-19T22:40:08.292569+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: audit 2024-04-19T22:40:08.573060+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: cluster 2024-04-19T22:40:08.578058+0000 mon.a (mon.0) 403 : cluster 1 osd.2 v2:172.21.15.113:6809/2132568950 boot 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: cluster 2024-04-19T22:40:08.578095+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-04-19T22:40:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[21528]: audit 2024-04-19T22:40:08.578652+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: cluster 2024-04-19T22:40:06.914364+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: cluster 2024-04-19T22:40:06.914507+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: cluster 2024-04-19T22:40:08.292569+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: audit 2024-04-19T22:40:08.573060+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: cluster 2024-04-19T22:40:08.578058+0000 mon.a (mon.0) 403 : cluster 1 osd.2 v2:172.21.15.113:6809/2132568950 boot 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: cluster 2024-04-19T22:40:08.578095+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-04-19T22:40:10.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:09 smithi113 bash[28910]: audit 2024-04-19T22:40:08.578652+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: cluster 2024-04-19T22:40:06.914364+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: cluster 2024-04-19T22:40:06.914507+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: cluster 2024-04-19T22:40:08.292569+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: audit 2024-04-19T22:40:08.573060+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: cluster 2024-04-19T22:40:08.578058+0000 mon.a (mon.0) 403 : cluster 1 osd.2 v2:172.21.15.113:6809/2132568950 boot 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: cluster 2024-04-19T22:40:08.578095+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-04-19T22:40:10.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:09 smithi178 bash[23441]: audit 2024-04-19T22:40:08.578652+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:40:11.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:10 smithi113 bash[28910]: cluster 2024-04-19T22:40:09.598004+0000 mon.a (mon.0) 406 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-04-19T22:40:11.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:10 smithi113 bash[21528]: cluster 2024-04-19T22:40:09.598004+0000 mon.a (mon.0) 406 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-04-19T22:40:11.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:10 smithi178 bash[23441]: cluster 2024-04-19T22:40:09.598004+0000 mon.a (mon.0) 406 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[21528]: cluster 2024-04-19T22:40:10.293028+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[21528]: audit 2024-04-19T22:40:10.420891+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[21528]: audit 2024-04-19T22:40:10.914369+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[21528]: cluster 2024-04-19T22:40:10.920415+0000 mon.a (mon.0) 409 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[21528]: audit 2024-04-19T22:40:10.921795+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[28910]: cluster 2024-04-19T22:40:10.293028+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:12.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[28910]: audit 2024-04-19T22:40:10.420891+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:12.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[28910]: audit 2024-04-19T22:40:10.914369+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:12.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[28910]: cluster 2024-04-19T22:40:10.920415+0000 mon.a (mon.0) 409 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-04-19T22:40:12.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:11 smithi113 bash[28910]: audit 2024-04-19T22:40:10.921795+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:11 smithi178 bash[23441]: cluster 2024-04-19T22:40:10.293028+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:11 smithi178 bash[23441]: audit 2024-04-19T22:40:10.420891+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:11 smithi178 bash[23441]: audit 2024-04-19T22:40:10.914369+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:11 smithi178 bash[23441]: cluster 2024-04-19T22:40:10.920415+0000 mon.a (mon.0) 409 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-04-19T22:40:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:11 smithi178 bash[23441]: audit 2024-04-19T22:40:10.921795+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:40:13.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:12 smithi113 bash[28910]: audit 2024-04-19T22:40:11.916620+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:13.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:12 smithi113 bash[28910]: cluster 2024-04-19T22:40:11.923435+0000 mon.a (mon.0) 412 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-04-19T22:40:13.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:12 smithi113 bash[21528]: audit 2024-04-19T22:40:11.916620+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:13.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:12 smithi113 bash[21528]: cluster 2024-04-19T22:40:11.923435+0000 mon.a (mon.0) 412 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-04-19T22:40:13.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:12 smithi178 bash[23441]: audit 2024-04-19T22:40:11.916620+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:40:13.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:12 smithi178 bash[23441]: cluster 2024-04-19T22:40:11.923435+0000 mon.a (mon.0) 412 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-04-19T22:40:13.470 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:40:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[28910]: cluster 2024-04-19T22:40:12.293487+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[28910]: cluster 2024-04-19T22:40:12.944831+0000 mon.a (mon.0) 413 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-04-19T22:40:14.292 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[28910]: cluster 2024-04-19T22:40:12.944944+0000 mon.a (mon.0) 414 : cluster 0 osdmap e22: 3 total, 3 up, 3 in 2024-04-19T22:40:14.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[28910]: audit 2024-04-19T22:40:13.317834+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:14.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[21528]: cluster 2024-04-19T22:40:12.293487+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:14.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[21528]: cluster 2024-04-19T22:40:12.944831+0000 mon.a (mon.0) 413 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-04-19T22:40:14.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[21528]: cluster 2024-04-19T22:40:12.944944+0000 mon.a (mon.0) 414 : cluster 0 osdmap e22: 3 total, 3 up, 3 in 2024-04-19T22:40:14.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:13 smithi113 bash[21528]: audit 2024-04-19T22:40:13.317834+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:14.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:13 smithi178 bash[23441]: cluster 2024-04-19T22:40:12.293487+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:14.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:13 smithi178 bash[23441]: cluster 2024-04-19T22:40:12.944831+0000 mon.a (mon.0) 413 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-04-19T22:40:14.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:13 smithi178 bash[23441]: cluster 2024-04-19T22:40:12.944944+0000 mon.a (mon.0) 414 : cluster 0 osdmap e22: 3 total, 3 up, 3 in 2024-04-19T22:40:14.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:13 smithi178 bash[23441]: audit 2024-04-19T22:40:13.317834+0000 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:17.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: cluster 2024-04-19T22:40:14.293806+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v142: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:15.140801+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.003506+0000 mon.a (mon.0) 417 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.004217+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.004578+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.004748+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.007265+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.007430+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[21528]: audit 2024-04-19T22:40:16.007583+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: cluster 2024-04-19T22:40:14.293806+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v142: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:17.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:15.140801+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.003506+0000 mon.a (mon.0) 417 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.004217+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.004578+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.004748+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.007265+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.007430+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:16 smithi113 bash[28910]: audit 2024-04-19T22:40:16.007583+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: cluster 2024-04-19T22:40:14.293806+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v142: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:15.140801+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.003506+0000 mon.a (mon.0) 417 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.004217+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.004578+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.004748+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.007265+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:17.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.007430+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:17.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:16 smithi178 bash[23441]: audit 2024-04-19T22:40:16.007583+0000 mon.a (mon.0) 423 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:18.080 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-19T22:40:18.081 INFO:teuthology.orchestra.run.smithi113.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-19T22:40:18.081 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 10+0 records in 2024-04-19T22:40:18.081 INFO:teuthology.orchestra.run.smithi113.stderr:10+0 records out 2024-04-19T22:40:18.081 INFO:teuthology.orchestra.run.smithi113.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012253 s, 856 MB/s 2024-04-19T22:40:18.081 INFO:teuthology.orchestra.run.smithi113.stderr:--> Zapping successful for: 2024-04-19T22:40:18.285 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.007225+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.285 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: cluster 2024-04-19T22:40:16.294333+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:18.285 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.916375+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.975075+0000 mon.a (mon.0) 424 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.977749+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.978246+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.978745+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:16.979175+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[21528]: audit 2024-04-19T22:40:17.869490+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.007225+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: cluster 2024-04-19T22:40:16.294333+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.916375+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.975075+0000 mon.a (mon.0) 424 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:18.286 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.977749+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.287 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.978246+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:18.287 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.978745+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:18.287 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:16.979175+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:18.287 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:17 smithi113 bash[28910]: audit 2024-04-19T22:40:17.869490+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.007225+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: cluster 2024-04-19T22:40:16.294333+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.916375+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.975075+0000 mon.a (mon.0) 424 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.977749+0000 mon.c (mon.2) 7 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-19T22:40:18.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.978246+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:40:18.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.978745+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:40:18.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:16.979175+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:40:18.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:17 smithi178 bash[23441]: audit 2024-04-19T22:40:17.869490+0000 mon.c (mon.2) 8 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-19T22:40:19.383 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi113:vg_nvme/lv_1 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: cluster 2024-04-19T22:40:18.294700+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.493188+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.501436+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.503464+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.504948+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.506342+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.512632+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.516112+0000 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.517587+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[28910]: audit 2024-04-19T22:40:19.525155+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: cluster 2024-04-19T22:40:18.294700+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.493188+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.501436+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.503464+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.504948+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.506342+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.512632+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.516112+0000 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:20.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.517587+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:20.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:19 smithi113 bash[21528]: audit 2024-04-19T22:40:19.525155+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: cluster 2024-04-19T22:40:18.294700+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.493188+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.501436+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.503464+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.504948+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.506342+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:40:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.512632+0000 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:20.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.516112+0000 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:20.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.517587+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:40:20.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:19 smithi178 bash[23441]: audit 2024-04-19T22:40:19.525155+0000 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:21.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:20 smithi113 bash[28910]: cephadm 2024-04-19T22:40:19.486191+0000 mgr.y (mgr.14152) 174 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:40:21.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:20 smithi113 bash[28910]: cephadm 2024-04-19T22:40:19.507592+0000 mgr.y (mgr.14152) 175 : cephadm 1 Adjusting osd_memory_target on smithi113 to 5413M 2024-04-19T22:40:21.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:20 smithi113 bash[21528]: cephadm 2024-04-19T22:40:19.486191+0000 mgr.y (mgr.14152) 174 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:40:21.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:20 smithi113 bash[21528]: cephadm 2024-04-19T22:40:19.507592+0000 mgr.y (mgr.14152) 175 : cephadm 1 Adjusting osd_memory_target on smithi113 to 5413M 2024-04-19T22:40:21.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:20 smithi178 bash[23441]: cephadm 2024-04-19T22:40:19.486191+0000 mgr.y (mgr.14152) 174 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:40:21.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:20 smithi178 bash[23441]: cephadm 2024-04-19T22:40:19.507592+0000 mgr.y (mgr.14152) 175 : cephadm 1 Adjusting osd_memory_target on smithi113 to 5413M 2024-04-19T22:40:22.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:21 smithi113 bash[21528]: cluster 2024-04-19T22:40:20.295231+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:22.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:21 smithi113 bash[28910]: cluster 2024-04-19T22:40:20.295231+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:22.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:21 smithi178 bash[23441]: cluster 2024-04-19T22:40:20.295231+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:24.136 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:40:24.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:23 smithi113 bash[21528]: cluster 2024-04-19T22:40:22.295821+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-19T22:40:24.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:23 smithi113 bash[28910]: cluster 2024-04-19T22:40:22.295821+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-19T22:40:24.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:23 smithi178 bash[23441]: cluster 2024-04-19T22:40:22.295821+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-19T22:40:26.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:25 smithi113 bash[21528]: cluster 2024-04-19T22:40:24.296379+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-19T22:40:26.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:25 smithi113 bash[28910]: cluster 2024-04-19T22:40:24.296379+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-19T22:40:26.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:25 smithi178 bash[23441]: cluster 2024-04-19T22:40:24.296379+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- 172.21.15.113:0/3117251730 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103eb0 msgr2=0x7f66c010a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- 172.21.15.113:0/3117251730 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103eb0 0x7f66c010a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b0a0 tx=0x7f66b800b3b0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- 172.21.15.113:0/3117251730 shutdown_connections 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- 172.21.15.113:0/3117251730 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103eb0 0x7f66c010a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- 172.21.15.113:0/3117251730 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0102310 0x7f66c0102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- 172.21.15.113:0/3117251730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0103510 0x7f66c0103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- 172.21.15.113:0/3117251730 >> 172.21.15.113:0/3117251730 conn(0x7f66c00fd8b0 msgr2=0x7f66c00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:40:27.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- 172.21.15.113:0/3117251730 shutdown_connections 2024-04-19T22:40:27.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- 172.21.15.113:0/3117251730 wait complete. 2024-04-19T22:40:27.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 Processor -- start 2024-04-19T22:40:27.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- start start 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0102310 0x7f66c0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f66c010d640 con 0x7f66c0103eb0 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f66c010d4c0 con 0x7f66c0102310 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c70b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f66c010d7c0 con 0x7f66c0103510 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c5656700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:33122/0 (socket says 172.21.15.113:33122) 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c5656700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39402/0 (socket says 172.21.15.113:39402) 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 -- 172.21.15.113:0/1021332255 learned_addr learned my addr 172.21.15.113:0/1021332255 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66c4e55700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0102310 0x7f66c0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 -- 172.21.15.113:0/1021332255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0102310 msgr2=0x7f66c0197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:40:27.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0102310 0x7f66c0197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.094+0000 7f66bffff700 1 -- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 msgr2=0x7f66c019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bffff700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bffff700 1 -- 172.21.15.113:0/1021332255 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c019f760 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c5656700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bffff700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d980 tx=0x7f66b400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4016070 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f66b400de70 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c019fa50 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b400f3c0 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c019ff90 con 0x7f66c0103510 2024-04-19T22:40:27.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c004ff50 con 0x7f66c0103510 2024-04-19T22:40:27.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f66b4019070 con 0x7f66c0103510 2024-04-19T22:40:27.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 --2- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 0x7f66a8070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:40:27.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 2511+0+0 (secure 0 0 0) 0x7f66b408cc80 con 0x7f66c0103510 2024-04-19T22:40:27.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c4e55700 1 --2- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 0x7f66a8070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:40:27.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.098+0000 7f66c4e55700 1 --2- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 0x7f66a8070470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009680 tx=0x7f66b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:40:27.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.102+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f66b405b3b0 con 0x7f66c0103510 2024-04-19T22:40:27.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:40:27.318+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f66c0062670 con 0x7f66a806dfb0 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[21528]: cluster 2024-04-19T22:40:26.296977+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[21528]: audit 2024-04-19T22:40:27.331977+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[21528]: audit 2024-04-19T22:40:27.335933+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[21528]: audit 2024-04-19T22:40:27.337109+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[28910]: cluster 2024-04-19T22:40:26.296977+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[28910]: audit 2024-04-19T22:40:27.331977+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:40:28.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[28910]: audit 2024-04-19T22:40:27.335933+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:40:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:27 smithi113 bash[28910]: audit 2024-04-19T22:40:27.337109+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:27 smithi178 bash[23441]: cluster 2024-04-19T22:40:26.296977+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-19T22:40:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:27 smithi178 bash[23441]: audit 2024-04-19T22:40:27.331977+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:40:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:27 smithi178 bash[23441]: audit 2024-04-19T22:40:27.335933+0000 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:40:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:27 smithi178 bash[23441]: audit 2024-04-19T22:40:27.337109+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:29.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:28 smithi113 bash[21528]: audit 2024-04-19T22:40:27.327391+0000 mgr.y (mgr.14152) 180 : audit 0 from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:40:29.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:28 smithi113 bash[28910]: audit 2024-04-19T22:40:27.327391+0000 mgr.y (mgr.14152) 180 : audit 0 from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:40:29.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:28 smithi178 bash[23441]: audit 2024-04-19T22:40:27.327391+0000 mgr.y (mgr.14152) 180 : audit 0 from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi113:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:40:30.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:29 smithi113 bash[21528]: cluster 2024-04-19T22:40:28.297510+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:30.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:29 smithi113 bash[28910]: cluster 2024-04-19T22:40:28.297510+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:30.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:29 smithi178 bash[23441]: cluster 2024-04-19T22:40:28.297510+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:32.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:31 smithi113 bash[21528]: cluster 2024-04-19T22:40:30.297894+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:32.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:31 smithi113 bash[28910]: cluster 2024-04-19T22:40:30.297894+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:32.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:31 smithi178 bash[23441]: cluster 2024-04-19T22:40:30.297894+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:33 smithi113 bash[21528]: cluster 2024-04-19T22:40:32.298489+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:33 smithi113 bash[28910]: cluster 2024-04-19T22:40:32.298489+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:33 smithi178 bash[23441]: cluster 2024-04-19T22:40:32.298489+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: cluster 2024-04-19T22:40:34.299063+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: audit 2024-04-19T22:40:35.892086+0000 mon.c (mon.2) 9 : audit 1 from='client.? 172.21.15.113:0/745925982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: audit 2024-04-19T22:40:35.892816+0000 mon.a (mon.0) 440 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: audit 2024-04-19T22:40:35.897702+0000 mon.a (mon.0) 441 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]': finished 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: cluster 2024-04-19T22:40:35.903066+0000 mon.a (mon.0) 442 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[28910]: audit 2024-04-19T22:40:35.903226+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: cluster 2024-04-19T22:40:34.299063+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: audit 2024-04-19T22:40:35.892086+0000 mon.c (mon.2) 9 : audit 1 from='client.? 172.21.15.113:0/745925982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: audit 2024-04-19T22:40:35.892816+0000 mon.a (mon.0) 440 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: audit 2024-04-19T22:40:35.897702+0000 mon.a (mon.0) 441 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]': finished 2024-04-19T22:40:36.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: cluster 2024-04-19T22:40:35.903066+0000 mon.a (mon.0) 442 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-04-19T22:40:36.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:35 smithi113 bash[21528]: audit 2024-04-19T22:40:35.903226+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:40:36.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: cluster 2024-04-19T22:40:34.299063+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:36.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: audit 2024-04-19T22:40:35.892086+0000 mon.c (mon.2) 9 : audit 1 from='client.? 172.21.15.113:0/745925982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: audit 2024-04-19T22:40:35.892816+0000 mon.a (mon.0) 440 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]: dispatch 2024-04-19T22:40:36.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: audit 2024-04-19T22:40:35.897702+0000 mon.a (mon.0) 441 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37fb43e-3da1-49da-a486-e4e4ec9328fc"}]': finished 2024-04-19T22:40:36.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: cluster 2024-04-19T22:40:35.903066+0000 mon.a (mon.0) 442 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-04-19T22:40:36.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:35 smithi178 bash[23441]: audit 2024-04-19T22:40:35.903226+0000 mon.a (mon.0) 443 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:40:37.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:36 smithi113 bash[21528]: audit 2024-04-19T22:40:36.658246+0000 mon.a (mon.0) 444 : audit 0 from='client.? 172.21.15.113:0/1949212573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:40:37.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:36 smithi113 bash[28910]: audit 2024-04-19T22:40:36.658246+0000 mon.a (mon.0) 444 : audit 0 from='client.? 172.21.15.113:0/1949212573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:40:37.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:36 smithi178 bash[23441]: audit 2024-04-19T22:40:36.658246+0000 mon.a (mon.0) 444 : audit 0 from='client.? 172.21.15.113:0/1949212573' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:40:38.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:37 smithi113 bash[21528]: cluster 2024-04-19T22:40:36.299512+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:38.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:37 smithi113 bash[28910]: cluster 2024-04-19T22:40:36.299512+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:38.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:37 smithi178 bash[23441]: cluster 2024-04-19T22:40:36.299512+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:40.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:39 smithi113 bash[21528]: cluster 2024-04-19T22:40:38.299973+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:40.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:39 smithi113 bash[28910]: cluster 2024-04-19T22:40:38.299973+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:40.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:39 smithi178 bash[23441]: cluster 2024-04-19T22:40:38.299973+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:41 smithi113 bash[21528]: cluster 2024-04-19T22:40:40.300356+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:41 smithi113 bash[28910]: cluster 2024-04-19T22:40:40.300356+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:42.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:41 smithi178 bash[23441]: cluster 2024-04-19T22:40:40.300356+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:44.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:43 smithi113 bash[21528]: cluster 2024-04-19T22:40:42.300887+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:44.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:43 smithi113 bash[28910]: cluster 2024-04-19T22:40:42.300887+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:44.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:43 smithi178 bash[23441]: cluster 2024-04-19T22:40:42.300887+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:46.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:45 smithi113 bash[21528]: cluster 2024-04-19T22:40:44.301423+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:46.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:45 smithi113 bash[28910]: cluster 2024-04-19T22:40:44.301423+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:46.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:45 smithi178 bash[23441]: cluster 2024-04-19T22:40:44.301423+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:48.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:47 smithi113 bash[21528]: cluster 2024-04-19T22:40:46.301952+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:48.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:47 smithi113 bash[28910]: cluster 2024-04-19T22:40:46.301952+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:48.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:47 smithi178 bash[23441]: cluster 2024-04-19T22:40:46.301952+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:49.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:49 smithi113 bash[21528]: audit 2024-04-19T22:40:48.883430+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-19T22:40:49.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:49 smithi113 bash[21528]: audit 2024-04-19T22:40:48.885330+0000 mon.a (mon.0) 446 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:49.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:49 smithi113 bash[28910]: audit 2024-04-19T22:40:48.883430+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-19T22:40:49.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:49 smithi113 bash[28910]: audit 2024-04-19T22:40:48.885330+0000 mon.a (mon.0) 446 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:49.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:49 smithi178 bash[23441]: audit 2024-04-19T22:40:48.883430+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-19T22:40:49.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:49 smithi178 bash[23441]: audit 2024-04-19T22:40:48.885330+0000 mon.a (mon.0) 446 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:40:50.280 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:50 smithi113 bash[21528]: cluster 2024-04-19T22:40:48.302538+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:50.280 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:50 smithi113 bash[21528]: cephadm 2024-04-19T22:40:48.887033+0000 mgr.y (mgr.14152) 192 : cephadm 1 Deploying daemon osd.3 on smithi113 2024-04-19T22:40:50.280 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:50 smithi113 bash[28910]: cluster 2024-04-19T22:40:48.302538+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:50.280 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:50 smithi113 bash[28910]: cephadm 2024-04-19T22:40:48.887033+0000 mgr.y (mgr.14152) 192 : cephadm 1 Deploying daemon osd.3 on smithi113 2024-04-19T22:40:50.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:50 smithi178 bash[23441]: cluster 2024-04-19T22:40:48.302538+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:50.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:50 smithi178 bash[23441]: cephadm 2024-04-19T22:40:48.887033+0000 mgr.y (mgr.14152) 192 : cephadm 1 Deploying daemon osd.3 on smithi113 2024-04-19T22:40:52.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:52 smithi113 bash[21528]: cluster 2024-04-19T22:40:50.302924+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:52 smithi113 bash[28910]: cluster 2024-04-19T22:40:50.302924+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:52.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:52 smithi178 bash[23441]: cluster 2024-04-19T22:40:50.302924+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:53.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.543 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.544 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.544 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.544 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.871 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.871 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.872 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.872 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.872 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:53.872 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:40:53 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:40:54.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[21528]: cluster 2024-04-19T22:40:52.303333+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[21528]: audit 2024-04-19T22:40:53.880517+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[21528]: audit 2024-04-19T22:40:53.885419+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[21528]: audit 2024-04-19T22:40:53.888328+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[28910]: cluster 2024-04-19T22:40:52.303333+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[28910]: audit 2024-04-19T22:40:53.880517+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[28910]: audit 2024-04-19T22:40:53.885419+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:54 smithi113 bash[28910]: audit 2024-04-19T22:40:53.888328+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:54.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:54 smithi178 bash[23441]: cluster 2024-04-19T22:40:52.303333+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:54.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:54 smithi178 bash[23441]: audit 2024-04-19T22:40:53.880517+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:54 smithi178 bash[23441]: audit 2024-04-19T22:40:53.885419+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:40:54.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:54 smithi178 bash[23441]: audit 2024-04-19T22:40:53.888328+0000 mon.a (mon.0) 449 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:40:56.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:56 smithi113 bash[21528]: cluster 2024-04-19T22:40:54.303646+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:56.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:56 smithi113 bash[28910]: cluster 2024-04-19T22:40:54.303646+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:56 smithi178 bash[23441]: cluster 2024-04-19T22:40:54.303646+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:58.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:40:58 smithi113 bash[28910]: cluster 2024-04-19T22:40:56.304199+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:58.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:40:58 smithi113 bash[21528]: cluster 2024-04-19T22:40:56.304199+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:40:58.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:40:58 smithi178 bash[23441]: cluster 2024-04-19T22:40:56.304199+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:00.292 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:00 smithi113 bash[21528]: cluster 2024-04-19T22:40:58.304782+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:00.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:00 smithi113 bash[28910]: cluster 2024-04-19T22:40:58.304782+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:00.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:00 smithi178 bash[23441]: cluster 2024-04-19T22:40:58.304782+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.224416+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.232167+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.233898+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.234825+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.243385+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[21528]: audit 2024-04-19T22:41:00.834513+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-19T22:41:01.424 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.224416+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.425 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.232167+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.425 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.233898+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:01.425 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.234825+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:01.425 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.243385+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.425 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:01 smithi113 bash[28910]: audit 2024-04-19T22:41:00.834513+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-19T22:41:01.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.224416+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.232167+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.233898+0000 mon.a (mon.0) 452 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:01.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.234825+0000 mon.a (mon.0) 453 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:01.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.243385+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:01.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:01 smithi178 bash[23441]: audit 2024-04-19T22:41:00.834513+0000 mon.a (mon.0) 455 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[21528]: cluster 2024-04-19T22:41:00.305200+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[21528]: audit 2024-04-19T22:41:01.248559+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[21528]: cluster 2024-04-19T22:41:01.256111+0000 mon.a (mon.0) 457 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[21528]: audit 2024-04-19T22:41:01.256375+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[21528]: audit 2024-04-19T22:41:01.256670+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:02.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[28910]: cluster 2024-04-19T22:41:00.305200+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[28910]: audit 2024-04-19T22:41:01.248559+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-19T22:41:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[28910]: cluster 2024-04-19T22:41:01.256111+0000 mon.a (mon.0) 457 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-04-19T22:41:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[28910]: audit 2024-04-19T22:41:01.256375+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:41:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:02 smithi113 bash[28910]: audit 2024-04-19T22:41:01.256670+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:02 smithi178 bash[23441]: cluster 2024-04-19T22:41:00.305200+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:02 smithi178 bash[23441]: audit 2024-04-19T22:41:01.248559+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-19T22:41:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:02 smithi178 bash[23441]: cluster 2024-04-19T22:41:01.256111+0000 mon.a (mon.0) 457 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-04-19T22:41:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:02 smithi178 bash[23441]: audit 2024-04-19T22:41:01.256375+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]: dispatch 2024-04-19T22:41:02.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:02 smithi178 bash[23441]: audit 2024-04-19T22:41:01.256670+0000 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[21528]: audit 2024-04-19T22:41:02.251113+0000 mon.a (mon.0) 460 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[21528]: cluster 2024-04-19T22:41:02.258937+0000 mon.a (mon.0) 461 : cluster 0 osdmap e25: 4 total, 3 up, 4 in 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[21528]: audit 2024-04-19T22:41:02.260229+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[21528]: audit 2024-04-19T22:41:02.271527+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[28910]: audit 2024-04-19T22:41:02.251113+0000 mon.a (mon.0) 460 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[28910]: cluster 2024-04-19T22:41:02.258937+0000 mon.a (mon.0) 461 : cluster 0 osdmap e25: 4 total, 3 up, 4 in 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[28910]: audit 2024-04-19T22:41:02.260229+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:03 smithi113 bash[28910]: audit 2024-04-19T22:41:02.271527+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:03 smithi178 bash[23441]: audit 2024-04-19T22:41:02.251113+0000 mon.a (mon.0) 460 : audit 1 from='osd.3 v2:172.21.15.113:6813/1760998485' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi113", "root=default"]}]': finished 2024-04-19T22:41:03.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:03 smithi178 bash[23441]: cluster 2024-04-19T22:41:02.258937+0000 mon.a (mon.0) 461 : cluster 0 osdmap e25: 4 total, 3 up, 4 in 2024-04-19T22:41:03.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:03 smithi178 bash[23441]: audit 2024-04-19T22:41:02.260229+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:03.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:03 smithi178 bash[23441]: audit 2024-04-19T22:41:02.271527+0000 mon.a (mon.0) 463 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:04.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.282+0000 7f66bdffb700 1 -- 172.21.15.113:0/1021332255 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f66c0062670 con 0x7f66a806dfb0 2024-04-19T22:41:04.280 INFO:teuthology.orchestra.run.smithi113.stdout:Created osd(s) 3 on host 'smithi113' 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 msgr2=0x7f66a8070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 0x7f66a8070470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009680 tx=0x7f66b0009260 comp rx=0 tx=0).stop 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 msgr2=0x7f66c0198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d980 tx=0x7f66b400dc90 comp rx=0 tx=0).stop 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 shutdown_connections 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> v2:172.21.15.113:6800/467518466 conn(0x7f66a806dfb0 0x7f66a8070470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66c0103eb0 0x7f66c019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:04.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0102310 0x7f66c0197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:04.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 --2- 172.21.15.113:0/1021332255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f66c0103510 0x7f66c0198040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:04.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 >> 172.21.15.113:0/1021332255 conn(0x7f66c00fd8b0 msgr2=0x7f66c0106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:41:04.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.286+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 shutdown_connections 2024-04-19T22:41:04.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:41:04.290+0000 7f66c70b9700 1 -- 172.21.15.113:0/1021332255 wait complete. 2024-04-19T22:41:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: cluster 2024-04-19T22:41:01.834991+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: cluster 2024-04-19T22:41:01.835102+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: cluster 2024-04-19T22:41:02.305593+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: cluster 2024-04-19T22:41:03.270448+0000 mon.a (mon.0) 464 : cluster 1 osd.3 v2:172.21.15.113:6813/1760998485 boot 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: cluster 2024-04-19T22:41:03.270502+0000 mon.a (mon.0) 465 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: audit 2024-04-19T22:41:03.271226+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: audit 2024-04-19T22:41:04.259447+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[21528]: audit 2024-04-19T22:41:04.272079+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: cluster 2024-04-19T22:41:01.834991+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: cluster 2024-04-19T22:41:01.835102+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: cluster 2024-04-19T22:41:02.305593+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: cluster 2024-04-19T22:41:03.270448+0000 mon.a (mon.0) 464 : cluster 1 osd.3 v2:172.21.15.113:6813/1760998485 boot 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: cluster 2024-04-19T22:41:03.270502+0000 mon.a (mon.0) 465 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-04-19T22:41:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: audit 2024-04-19T22:41:03.271226+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:04.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: audit 2024-04-19T22:41:04.259447+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:04.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:04 smithi113 bash[28910]: audit 2024-04-19T22:41:04.272079+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: cluster 2024-04-19T22:41:01.834991+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: cluster 2024-04-19T22:41:01.835102+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: cluster 2024-04-19T22:41:02.305593+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: cluster 2024-04-19T22:41:03.270448+0000 mon.a (mon.0) 464 : cluster 1 osd.3 v2:172.21.15.113:6813/1760998485 boot 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: cluster 2024-04-19T22:41:03.270502+0000 mon.a (mon.0) 465 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-04-19T22:41:04.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: audit 2024-04-19T22:41:03.271226+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:41:04.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: audit 2024-04-19T22:41:04.259447+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:04.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:04 smithi178 bash[23441]: audit 2024-04-19T22:41:04.272079+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:05.058 DEBUG:teuthology.orchestra.run.smithi113:osd.3> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.3.service 2024-04-19T22:41:05.061 INFO:tasks.cephadm:Deploying osd.4 on smithi178 with /dev/vg_nvme/lv_4... 2024-04-19T22:41:05.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-19T22:41:05.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[21528]: audit 2024-04-19T22:41:04.273362+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:05.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[21528]: cluster 2024-04-19T22:41:04.293627+0000 mon.a (mon.0) 470 : cluster 0 osdmap e27: 4 total, 4 up, 4 in 2024-04-19T22:41:05.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[21528]: cluster 2024-04-19T22:41:04.305972+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:05.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[28910]: audit 2024-04-19T22:41:04.273362+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:05.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[28910]: cluster 2024-04-19T22:41:04.293627+0000 mon.a (mon.0) 470 : cluster 0 osdmap e27: 4 total, 4 up, 4 in 2024-04-19T22:41:05.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:05 smithi113 bash[28910]: cluster 2024-04-19T22:41:04.305972+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:05.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:05 smithi178 bash[23441]: audit 2024-04-19T22:41:04.273362+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:05.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:05 smithi178 bash[23441]: cluster 2024-04-19T22:41:04.293627+0000 mon.a (mon.0) 470 : cluster 0 osdmap e27: 4 total, 4 up, 4 in 2024-04-19T22:41:05.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:05 smithi178 bash[23441]: cluster 2024-04-19T22:41:04.305972+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:07.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:07 smithi113 bash[21528]: cluster 2024-04-19T22:41:06.306560+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:07.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:07 smithi113 bash[28910]: cluster 2024-04-19T22:41:06.306560+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:07.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:07 smithi178 bash[23441]: cluster 2024-04-19T22:41:06.306560+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:09.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:09 smithi113 bash[21528]: cluster 2024-04-19T22:41:08.307019+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:09.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:09 smithi113 bash[28910]: cluster 2024-04-19T22:41:08.307019+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:09.770 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:41:09.792 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:09 smithi178 bash[23441]: cluster 2024-04-19T22:41:08.307019+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:11.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:11 smithi113 bash[21528]: cluster 2024-04-19T22:41:10.307576+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:11.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:11 smithi113 bash[28910]: cluster 2024-04-19T22:41:10.307576+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:11 smithi178 bash[23441]: cluster 2024-04-19T22:41:10.307576+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:12.651 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-19T22:41:12.651 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-19T22:41:12.652 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-04-19T22:41:12.652 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-04-19T22:41:12.652 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119969 s, 874 MB/s 2024-04-19T22:41:12.652 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-04-19T22:41:13.226 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2024-04-19T22:41:13.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:13 smithi178 bash[23441]: cluster 2024-04-19T22:41:12.308188+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:13.607 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:13 smithi113 bash[28910]: cluster 2024-04-19T22:41:12.308188+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:13.607 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:13 smithi113 bash[21528]: cluster 2024-04-19T22:41:12.308188+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: cephadm 2024-04-19T22:41:14.169805+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:41:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.179899+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.191369+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.193996+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.195697+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.197242+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.198747+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: cephadm 2024-04-19T22:41:14.199838+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi113 to 4060M 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.206129+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.211408+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.213144+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[21528]: audit 2024-04-19T22:41:14.224507+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: cephadm 2024-04-19T22:41:14.169805+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.179899+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.191369+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.193996+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.195697+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.197242+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.198747+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: cephadm 2024-04-19T22:41:14.199838+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi113 to 4060M 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.206129+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.211408+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.213144+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:15 smithi113 bash[28910]: audit 2024-04-19T22:41:14.224507+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: cephadm 2024-04-19T22:41:14.169805+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi113 2024-04-19T22:41:15.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.179899+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.191369+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.193996+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.195697+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.197242+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.198747+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: cephadm 2024-04-19T22:41:14.199838+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi113 to 4060M 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.206129+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.211408+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.213144+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:15 smithi178 bash[23441]: audit 2024-04-19T22:41:14.224507+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:16.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:16 smithi113 bash[21528]: cluster 2024-04-19T22:41:14.308720+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:16 smithi113 bash[28910]: cluster 2024-04-19T22:41:14.308720+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:16.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:16 smithi178 bash[23441]: cluster 2024-04-19T22:41:14.308720+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:17.935 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:41:18.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:18 smithi113 bash[21528]: cluster 2024-04-19T22:41:16.309224+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:18.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:18 smithi113 bash[28910]: cluster 2024-04-19T22:41:16.309224+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:18.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:18 smithi178 bash[23441]: cluster 2024-04-19T22:41:16.309224+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2143041393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc103e80 msgr2=0x7fbdbc10a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2143041393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc103e80 0x7fbdbc10a730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400b0d0 tx=0x7fbdb400b3e0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2143041393 shutdown_connections 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2143041393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc103e80 0x7fbdbc10a730 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2143041393 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1022e0 0x7fbdbc102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2143041393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc1034e0 0x7fbdbc103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2143041393 >> 172.21.15.178:0/2143041393 conn(0x7fbdbc0fd880 msgr2=0x7fbdbc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2143041393 shutdown_connections 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2143041393 wait complete. 2024-04-19T22:41:20.353 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 Processor -- start 2024-04-19T22:41:20.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- start start 2024-04-19T22:41:20.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1034e0 0x7fbdbc198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc103e80 0x7fbdbc19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc10d650 con 0x7fbdbc103e80 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc10d4d0 con 0x7fbdbc1022e0 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc2b8a700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc10d7d0 con 0x7fbdbc1034e0 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:52334/0 (socket says 172.21.15.178:52334) 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 -- 172.21.15.178:0/2031134212 learned_addr learned my addr 172.21.15.178:0/2031134212 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc1127700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc103e80 0x7fbdbc19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 -- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1034e0 msgr2=0x7fbdbc198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdbbfff700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1034e0 0x7fbdbc198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1034e0 0x7fbdbc198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.356 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 -- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc103e80 msgr2=0x7fbdbc19f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc103e80 0x7fbdbc19f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.355+0000 7fbdc0926700 1 -- 172.21.15.178:0/2031134212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc19f830 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdc0926700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00b500 tx=0x7fbdac00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac015020 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc19fac0 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fbdac011ce0 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac010d60 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc1a0000 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc04ff50 con 0x7fbdbc1022e0 2024-04-19T22:41:20.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7fbdac018020 con 0x7fbdbc1022e0 2024-04-19T22:41:20.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 --2- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 0x7fbda4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:41:20.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 2803+0+0 (secure 0 0 0) 0x7fbdac08ca90 con 0x7fbdbc1022e0 2024-04-19T22:41:20.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdbbfff700 1 --2- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 0x7fbda4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:41:20.359 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.359+0000 7fbdbbfff700 1 --2- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 0x7fbda4070470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0005950 tx=0x7fbdb0005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:41:20.361 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.363+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fbdac01f020 con 0x7fbdbc1022e0 2024-04-19T22:41:20.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:20 smithi113 bash[21528]: cluster 2024-04-19T22:41:18.309748+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:20.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:20 smithi113 bash[28910]: cluster 2024-04-19T22:41:18.309748+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:20.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:20 smithi178 bash[23441]: cluster 2024-04-19T22:41:18.309748+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:20.578 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:20.583+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbdbc062670 con 0x7fbda406dfb0 2024-04-19T22:41:21.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[21528]: audit 2024-04-19T22:41:20.594492+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:41:21.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[21528]: audit 2024-04-19T22:41:20.601207+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:41:21.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[21528]: audit 2024-04-19T22:41:20.602936+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:21.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[28910]: audit 2024-04-19T22:41:20.594492+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:41:21.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[28910]: audit 2024-04-19T22:41:20.601207+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:41:21.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:21 smithi113 bash[28910]: audit 2024-04-19T22:41:20.602936+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:21 smithi178 bash[23441]: audit 2024-04-19T22:41:20.594492+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:21 smithi178 bash[23441]: audit 2024-04-19T22:41:20.601207+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:21 smithi178 bash[23441]: audit 2024-04-19T22:41:20.602936+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:22.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:22 smithi113 bash[21528]: cluster 2024-04-19T22:41:20.310292+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:22.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:22 smithi113 bash[21528]: audit 2024-04-19T22:41:20.586952+0000 mgr.y (mgr.14152) 211 : audit 0 from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:41:22.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:22 smithi113 bash[28910]: cluster 2024-04-19T22:41:20.310292+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:22.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:22 smithi113 bash[28910]: audit 2024-04-19T22:41:20.586952+0000 mgr.y (mgr.14152) 211 : audit 0 from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:41:22.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:22 smithi178 bash[23441]: cluster 2024-04-19T22:41:20.310292+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:22.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:22 smithi178 bash[23441]: audit 2024-04-19T22:41:20.586952+0000 mgr.y (mgr.14152) 211 : audit 0 from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:41:24.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:24 smithi113 bash[21528]: cluster 2024-04-19T22:41:22.310929+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:24.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:24 smithi113 bash[28910]: cluster 2024-04-19T22:41:22.310929+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:24.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:24 smithi178 bash[23441]: cluster 2024-04-19T22:41:22.310929+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:26.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:26 smithi113 bash[21528]: cluster 2024-04-19T22:41:24.311466+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:26.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:26 smithi113 bash[28910]: cluster 2024-04-19T22:41:24.311466+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:26.544 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:26 smithi178 bash[23441]: cluster 2024-04-19T22:41:24.311466+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:28.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:28 smithi113 bash[21528]: cluster 2024-04-19T22:41:26.312097+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:28.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:28 smithi113 bash[28910]: cluster 2024-04-19T22:41:26.312097+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:28.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:28 smithi178 bash[23441]: cluster 2024-04-19T22:41:26.312097+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:29.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[21528]: audit 2024-04-19T22:41:28.769111+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.178:0/330651023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[21528]: audit 2024-04-19T22:41:28.769782+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[21528]: audit 2024-04-19T22:41:28.772932+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]': finished 2024-04-19T22:41:29.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[21528]: cluster 2024-04-19T22:41:28.778388+0000 mon.a (mon.0) 486 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-04-19T22:41:29.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[21528]: audit 2024-04-19T22:41:28.779073+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:29.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[28910]: audit 2024-04-19T22:41:28.769111+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.178:0/330651023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[28910]: audit 2024-04-19T22:41:28.769782+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[28910]: audit 2024-04-19T22:41:28.772932+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]': finished 2024-04-19T22:41:29.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[28910]: cluster 2024-04-19T22:41:28.778388+0000 mon.a (mon.0) 486 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-04-19T22:41:29.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:29 smithi113 bash[28910]: audit 2024-04-19T22:41:28.779073+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:29.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:29 smithi178 bash[23441]: audit 2024-04-19T22:41:28.769111+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.178:0/330651023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:29 smithi178 bash[23441]: audit 2024-04-19T22:41:28.769782+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]: dispatch 2024-04-19T22:41:29.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:29 smithi178 bash[23441]: audit 2024-04-19T22:41:28.772932+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb1d832c-ddaf-4a8e-943f-b6af469c3102"}]': finished 2024-04-19T22:41:29.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:29 smithi178 bash[23441]: cluster 2024-04-19T22:41:28.778388+0000 mon.a (mon.0) 486 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-04-19T22:41:29.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:29 smithi178 bash[23441]: audit 2024-04-19T22:41:28.779073+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:30.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:30 smithi113 bash[21528]: cluster 2024-04-19T22:41:28.312769+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:30.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:30 smithi113 bash[21528]: audit 2024-04-19T22:41:29.473760+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.178:0/2264430185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:41:30.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:30 smithi113 bash[28910]: cluster 2024-04-19T22:41:28.312769+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:30.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:30 smithi113 bash[28910]: audit 2024-04-19T22:41:29.473760+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.178:0/2264430185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:41:30.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:30 smithi178 bash[23441]: cluster 2024-04-19T22:41:28.312769+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:30.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:30 smithi178 bash[23441]: audit 2024-04-19T22:41:29.473760+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.178:0/2264430185' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:41:31.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:31 smithi113 bash[21528]: cluster 2024-04-19T22:41:30.313291+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:31.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:31 smithi113 bash[28910]: cluster 2024-04-19T22:41:30.313291+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:31.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:31 smithi178 bash[23441]: cluster 2024-04-19T22:41:30.313291+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:33.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:33 smithi113 bash[21528]: cluster 2024-04-19T22:41:32.313834+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:33.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:33 smithi113 bash[28910]: cluster 2024-04-19T22:41:32.313834+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:33.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:33 smithi178 bash[23441]: cluster 2024-04-19T22:41:32.313834+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:35.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:35 smithi113 bash[21528]: cluster 2024-04-19T22:41:34.314351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:35 smithi113 bash[28910]: cluster 2024-04-19T22:41:34.314351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:35.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:35 smithi178 bash[23441]: cluster 2024-04-19T22:41:34.314351+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:37.607 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:37 smithi178 bash[23441]: cluster 2024-04-19T22:41:36.314900+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:37.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:37 smithi113 bash[21528]: cluster 2024-04-19T22:41:36.314900+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:37.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:37 smithi113 bash[28910]: cluster 2024-04-19T22:41:36.314900+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:39.707 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:39 smithi178 bash[23441]: cluster 2024-04-19T22:41:38.315402+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:39.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:39 smithi113 bash[21528]: cluster 2024-04-19T22:41:38.315402+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:39.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:39 smithi113 bash[28910]: cluster 2024-04-19T22:41:38.315402+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:41.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:41 smithi178 bash[23441]: cluster 2024-04-19T22:41:40.315965+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:41.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:41 smithi178 bash[23441]: audit 2024-04-19T22:41:40.745550+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-19T22:41:41.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:41 smithi178 bash[23441]: audit 2024-04-19T22:41:40.747420+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:41.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:41 smithi178 bash[23441]: cephadm 2024-04-19T22:41:40.749211+0000 mgr.y (mgr.14152) 222 : cephadm 1 Deploying daemon osd.4 on smithi178 2024-04-19T22:41:41.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[21528]: cluster 2024-04-19T22:41:40.315965+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:41.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[21528]: audit 2024-04-19T22:41:40.745550+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-19T22:41:41.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[21528]: audit 2024-04-19T22:41:40.747420+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:41.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[21528]: cephadm 2024-04-19T22:41:40.749211+0000 mgr.y (mgr.14152) 222 : cephadm 1 Deploying daemon osd.4 on smithi178 2024-04-19T22:41:41.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[28910]: cluster 2024-04-19T22:41:40.315965+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:41.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[28910]: audit 2024-04-19T22:41:40.745550+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-19T22:41:41.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[28910]: audit 2024-04-19T22:41:40.747420+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:41.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:41 smithi113 bash[28910]: cephadm 2024-04-19T22:41:40.749211+0000 mgr.y (mgr.14152) 222 : cephadm 1 Deploying daemon osd.4 on smithi178 2024-04-19T22:41:43.639 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:43 smithi178 bash[23441]: cluster 2024-04-19T22:41:42.316494+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:43.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:43 smithi113 bash[21528]: cluster 2024-04-19T22:41:42.316494+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:43.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:43 smithi113 bash[28910]: cluster 2024-04-19T22:41:42.316494+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:44.652 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:44 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:41:44.652 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:41:44 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:41:45.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:44 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:41:45.050 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:41:44 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:41:46.209 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:45 smithi178 bash[23441]: cluster 2024-04-19T22:41:44.317035+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:46.209 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:45 smithi178 bash[23441]: audit 2024-04-19T22:41:44.921256+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.209 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:45 smithi178 bash[23441]: audit 2024-04-19T22:41:44.929815+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.209 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:45 smithi178 bash[23441]: audit 2024-04-19T22:41:44.945426+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:46.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[21528]: cluster 2024-04-19T22:41:44.317035+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:46.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[21528]: audit 2024-04-19T22:41:44.921256+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[21528]: audit 2024-04-19T22:41:44.929815+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[21528]: audit 2024-04-19T22:41:44.945426+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[28910]: cluster 2024-04-19T22:41:44.317035+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[28910]: audit 2024-04-19T22:41:44.921256+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[28910]: audit 2024-04-19T22:41:44.929815+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:46.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:45 smithi113 bash[28910]: audit 2024-04-19T22:41:44.945426+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:48.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:47 smithi113 bash[21528]: cluster 2024-04-19T22:41:46.317654+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:48.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:47 smithi113 bash[28910]: cluster 2024-04-19T22:41:46.317654+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:48.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:47 smithi178 bash[23441]: cluster 2024-04-19T22:41:46.317654+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:50.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:49 smithi113 bash[21528]: cluster 2024-04-19T22:41:48.318205+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:50.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:49 smithi113 bash[28910]: cluster 2024-04-19T22:41:48.318205+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:50.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:49 smithi178 bash[23441]: cluster 2024-04-19T22:41:48.318205+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:52.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:51 smithi178 bash[23441]: cluster 2024-04-19T22:41:50.318778+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:52.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:51 smithi178 bash[23441]: audit 2024-04-19T22:41:51.013074+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:51 smithi178 bash[23441]: audit 2024-04-19T22:41:51.013709+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:51 smithi178 bash[23441]: audit 2024-04-19T22:41:51.653281+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:52.179 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:51 smithi178 bash[23441]: audit 2024-04-19T22:41:51.662510+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[28910]: cluster 2024-04-19T22:41:50.318778+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[28910]: audit 2024-04-19T22:41:51.013074+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[28910]: audit 2024-04-19T22:41:51.013709+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[28910]: audit 2024-04-19T22:41:51.653281+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:52.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[28910]: audit 2024-04-19T22:41:51.662510+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:52.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[21528]: cluster 2024-04-19T22:41:50.318778+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:52.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[21528]: audit 2024-04-19T22:41:51.013074+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[21528]: audit 2024-04-19T22:41:51.013709+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-19T22:41:52.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[21528]: audit 2024-04-19T22:41:51.653281+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:52.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:51 smithi113 bash[21528]: audit 2024-04-19T22:41:51.662510+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:53.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:51.941167+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:51.946510+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: cluster 2024-04-19T22:41:51.947932+0000 mon.a (mon.0) 497 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:51.948925+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:51.949474+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:52.342540+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:53.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:52.344692+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[21528]: audit 2024-04-19T22:41:52.354645+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:51.941167+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:51.946510+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: cluster 2024-04-19T22:41:51.947932+0000 mon.a (mon.0) 497 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:51.948925+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:51.949474+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:52.342540+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:53.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:52.344692+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:53.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:52 smithi113 bash[28910]: audit 2024-04-19T22:41:52.354645+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:53.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:51.941167+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-19T22:41:53.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:51.946510+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v2:172.21.15.178:6800/2100817193' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: cluster 2024-04-19T22:41:51.947932+0000 mon.a (mon.0) 497 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-04-19T22:41:53.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:51.948925+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:53.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:51.949474+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:41:53.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:52.342540+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:41:53.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:52.344692+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:41:53.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:52 smithi178 bash[23441]: audit 2024-04-19T22:41:52.354645+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: cluster 2024-04-19T22:41:52.319257+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: audit 2024-04-19T22:41:52.943645+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: cluster 2024-04-19T22:41:52.949459+0000 mon.a (mon.0) 504 : cluster 0 osdmap e30: 5 total, 4 up, 5 in 2024-04-19T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: audit 2024-04-19T22:41:52.950864+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: audit 2024-04-19T22:41:52.960519+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.213 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: cluster 2024-04-19T22:41:53.356419+0000 mon.a (mon.0) 507 : cluster 1 osd.4 v2:172.21.15.178:6800/2100817193 boot 2024-04-19T22:41:54.213 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: cluster 2024-04-19T22:41:53.356543+0000 mon.a (mon.0) 508 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-04-19T22:41:54.213 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:53 smithi178 bash[23441]: audit 2024-04-19T22:41:53.356853+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: cluster 2024-04-19T22:41:52.319257+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: audit 2024-04-19T22:41:52.943645+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:41:54.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: cluster 2024-04-19T22:41:52.949459+0000 mon.a (mon.0) 504 : cluster 0 osdmap e30: 5 total, 4 up, 5 in 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: audit 2024-04-19T22:41:52.950864+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: audit 2024-04-19T22:41:52.960519+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: cluster 2024-04-19T22:41:53.356419+0000 mon.a (mon.0) 507 : cluster 1 osd.4 v2:172.21.15.178:6800/2100817193 boot 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: cluster 2024-04-19T22:41:53.356543+0000 mon.a (mon.0) 508 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[21528]: audit 2024-04-19T22:41:53.356853+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: cluster 2024-04-19T22:41:52.319257+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-19T22:41:54.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: audit 2024-04-19T22:41:52.943645+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: cluster 2024-04-19T22:41:52.949459+0000 mon.a (mon.0) 504 : cluster 0 osdmap e30: 5 total, 4 up, 5 in 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: audit 2024-04-19T22:41:52.950864+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: audit 2024-04-19T22:41:52.960519+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: cluster 2024-04-19T22:41:53.356419+0000 mon.a (mon.0) 507 : cluster 1 osd.4 v2:172.21.15.178:6800/2100817193 boot 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: cluster 2024-04-19T22:41:53.356543+0000 mon.a (mon.0) 508 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-04-19T22:41:54.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:53 smithi113 bash[28910]: audit 2024-04-19T22:41:53.356853+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:41:54.713 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.714+0000 7fbdb9ffb700 1 -- 172.21.15.178:0/2031134212 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbdbc062670 con 0x7fbda406dfb0 2024-04-19T22:41:54.714 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 4 on host 'smithi178' 2024-04-19T22:41:54.716 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 msgr2=0x7fbda4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 0x7fbda4070470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0005950 tx=0x7fbdb0005cf0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 msgr2=0x7fbdbc197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00b500 tx=0x7fbdac00b8c0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 shutdown_connections 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> v2:172.21.15.113:6800/467518466 conn(0x7fbda406dfb0 0x7fbda4070470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdbc103e80 0x7fbdbc19f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1022e0 0x7fbdbc197bd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 --2- 172.21.15.178:0/2031134212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbdbc1034e0 0x7fbdbc198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 >> 172.21.15.178:0/2031134212 conn(0x7fbdbc0fd880 msgr2=0x7fbdbc0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 shutdown_connections 2024-04-19T22:41:54.717 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:41:54.718+0000 7fbdc2b8a700 1 -- 172.21.15.178:0/2031134212 wait complete. 2024-04-19T22:41:55.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: cluster 2024-04-19T22:41:52.051499+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:55.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: cluster 2024-04-19T22:41:52.051579+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:55.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: cluster 2024-04-19T22:41:54.359903+0000 mon.a (mon.0) 510 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-04-19T22:41:55.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: audit 2024-04-19T22:41:54.646654+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:55.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: audit 2024-04-19T22:41:54.654352+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:54 smithi178 bash[23441]: audit 2024-04-19T22:41:54.665465+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: cluster 2024-04-19T22:41:52.051499+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:55.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: cluster 2024-04-19T22:41:52.051579+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: cluster 2024-04-19T22:41:54.359903+0000 mon.a (mon.0) 510 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: audit 2024-04-19T22:41:54.646654+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: audit 2024-04-19T22:41:54.654352+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[28910]: audit 2024-04-19T22:41:54.665465+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: cluster 2024-04-19T22:41:52.051499+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: cluster 2024-04-19T22:41:52.051579+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: cluster 2024-04-19T22:41:54.359903+0000 mon.a (mon.0) 510 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: audit 2024-04-19T22:41:54.646654+0000 mon.a (mon.0) 511 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: audit 2024-04-19T22:41:54.654352+0000 mon.a (mon.0) 512 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:54 smithi113 bash[21528]: audit 2024-04-19T22:41:54.665465+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:41:55.362 DEBUG:teuthology.orchestra.run.smithi178:osd.4> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.4.service 2024-04-19T22:41:55.365 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2024-04-19T22:41:55.365 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-19T22:41:56.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:55 smithi113 bash[21528]: cluster 2024-04-19T22:41:54.319852+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:41:56.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:55 smithi113 bash[21528]: cluster 2024-04-19T22:41:55.362800+0000 mon.a (mon.0) 514 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-04-19T22:41:56.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:55 smithi113 bash[28910]: cluster 2024-04-19T22:41:54.319852+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:41:56.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:55 smithi113 bash[28910]: cluster 2024-04-19T22:41:55.362800+0000 mon.a (mon.0) 514 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-04-19T22:41:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:55 smithi178 bash[23441]: cluster 2024-04-19T22:41:54.319852+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:41:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:55 smithi178 bash[23441]: cluster 2024-04-19T22:41:55.362800+0000 mon.a (mon.0) 514 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-04-19T22:41:57.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:57 smithi113 bash[21528]: cluster 2024-04-19T22:41:56.320473+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:41:57.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:57 smithi113 bash[21528]: cluster 2024-04-19T22:41:56.369653+0000 mon.a (mon.0) 515 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-04-19T22:41:57.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:57 smithi113 bash[28910]: cluster 2024-04-19T22:41:56.320473+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:41:57.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:57 smithi113 bash[28910]: cluster 2024-04-19T22:41:56.369653+0000 mon.a (mon.0) 515 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-04-19T22:41:57.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:57 smithi178 bash[23441]: cluster 2024-04-19T22:41:56.320473+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:41:57.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:57 smithi178 bash[23441]: cluster 2024-04-19T22:41:56.369653+0000 mon.a (mon.0) 515 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-04-19T22:41:58.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:58 smithi113 bash[21528]: cluster 2024-04-19T22:41:57.373579+0000 mon.a (mon.0) 516 : cluster 0 osdmap e35: 5 total, 5 up, 5 in 2024-04-19T22:41:58.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:58 smithi113 bash[28910]: cluster 2024-04-19T22:41:57.373579+0000 mon.a (mon.0) 516 : cluster 0 osdmap e35: 5 total, 5 up, 5 in 2024-04-19T22:41:58.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:58 smithi178 bash[23441]: cluster 2024-04-19T22:41:57.373579+0000 mon.a (mon.0) 516 : cluster 0 osdmap e35: 5 total, 5 up, 5 in 2024-04-19T22:41:59.635 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:41:59.657 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:41:59 smithi178 bash[23441]: cluster 2024-04-19T22:41:58.321037+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:41:59.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:41:59 smithi113 bash[21528]: cluster 2024-04-19T22:41:58.321037+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:41:59.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:41:59 smithi113 bash[28910]: cluster 2024-04-19T22:41:58.321037+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v207: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-19T22:42:01.655 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:01 smithi178 bash[23441]: cluster 2024-04-19T22:42:00.321595+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:42:01.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:01 smithi113 bash[21528]: cluster 2024-04-19T22:42:00.321595+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:42:01.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:01 smithi113 bash[28910]: cluster 2024-04-19T22:42:00.321595+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v208: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0149873 s, 700 MB/s 2024-04-19T22:42:03.360 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-04-19T22:42:03.655 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:03 smithi178 bash[23441]: cluster 2024-04-19T22:42:02.322181+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:42:03.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:03 smithi113 bash[21528]: cluster 2024-04-19T22:42:02.322181+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:42:03.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:03 smithi113 bash[28910]: cluster 2024-04-19T22:42:02.322181+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:42:04.087 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2024-04-19T22:42:05.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: cluster 2024-04-19T22:42:04.322776+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: cephadm 2024-04-19T22:42:04.447254+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.458188+0000 mon.a (mon.0) 517 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.467076+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.469139+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: cephadm 2024-04-19T22:42:04.470503+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi178 to 17265M 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.476656+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.480816+0000 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.482549+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[21528]: audit 2024-04-19T22:42:04.492196+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: cluster 2024-04-19T22:42:04.322776+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:05.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: cephadm 2024-04-19T22:42:04.447254+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.458188+0000 mon.a (mon.0) 517 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.467076+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.469139+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: cephadm 2024-04-19T22:42:04.470503+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi178 to 17265M 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.476656+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.480816+0000 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.482549+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:05.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:05 smithi113 bash[28910]: audit 2024-04-19T22:42:04.492196+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: cluster 2024-04-19T22:42:04.322776+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: cephadm 2024-04-19T22:42:04.447254+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.458188+0000 mon.a (mon.0) 517 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.467076+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.469139+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: cephadm 2024-04-19T22:42:04.470503+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi178 to 17265M 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.476656+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.480816+0000 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.482549+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:05.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:05 smithi178 bash[23441]: audit 2024-04-19T22:42:04.492196+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:07.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:07 smithi113 bash[21528]: cluster 2024-04-19T22:42:06.323357+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:07.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:07 smithi113 bash[28910]: cluster 2024-04-19T22:42:06.323357+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:07.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:07 smithi178 bash[23441]: cluster 2024-04-19T22:42:06.323357+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:08.804 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:42:09.732 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:09 smithi178 bash[23441]: cluster 2024-04-19T22:42:08.323902+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:09.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:09 smithi113 bash[21528]: cluster 2024-04-19T22:42:08.323902+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:09.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:09 smithi113 bash[28910]: cluster 2024-04-19T22:42:08.323902+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- 172.21.15.178:0/2934028696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c1056a0 msgr2=0x7f996c107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- 172.21.15.178:0/2934028696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c1056a0 0x7f996c107a90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f995c009990 tx=0x7f995c009ca0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- 172.21.15.178:0/2934028696 shutdown_connections 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- 172.21.15.178:0/2934028696 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c107fd0 0x7f996c10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- 172.21.15.178:0/2934028696 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c102d70 0x7f996c105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- 172.21.15.178:0/2934028696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c1056a0 0x7f996c107a90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- 172.21.15.178:0/2934028696 >> 172.21.15.178:0/2934028696 conn(0x7f996c0fc780 msgr2=0x7f996c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:42:11.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- 172.21.15.178:0/2934028696 shutdown_connections 2024-04-19T22:42:11.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- 172.21.15.178:0/2934028696 wait complete. 2024-04-19T22:42:11.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 Processor -- start 2024-04-19T22:42:11.050 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- start start 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 0x7f996c197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c1056a0 0x7f996c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10d600 con 0x7f996c102d70 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10d480 con 0x7f996c107fd0 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9973c7c700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f996c10d780 con 0x7f996c1056a0 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9972219700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9972219700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:45840/0 (socket says 172.21.15.178:45840) 2024-04-19T22:42:11.052 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9972219700 1 -- 172.21.15.178:0/852997581 learned_addr learned my addr 172.21.15.178:0/852997581 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9971a18700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 0x7f996c197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9971217700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c1056a0 0x7f996c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.050+0000 7f9972219700 1 -- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c1056a0 msgr2=0x7f996c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9972219700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c1056a0 0x7f996c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9972219700 1 -- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 msgr2=0x7f996c197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9972219700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 0x7f996c197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9972219700 1 -- 172.21.15.178:0/852997581 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c19f900 con 0x7f996c107fd0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9971a18700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 0x7f996c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9972219700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f996800c970 tx=0x7f996800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968007b00 con 0x7f996c107fd0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c19fbf0 con 0x7f996c107fd0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f996800ce50 con 0x7f996c107fd0 2024-04-19T22:42:11.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968005580 con 0x7f996c107fd0 2024-04-19T22:42:11.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c1a00e0 con 0x7f996c107fd0 2024-04-19T22:42:11.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9950005150 con 0x7f996c107fd0 2024-04-19T22:42:11.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f9968004830 con 0x7f996c107fd0 2024-04-19T22:42:11.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 --2- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 0x7f9958070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:42:11.054 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 3205+0+0 (secure 0 0 0) 0x7f996808cec0 con 0x7f996c107fd0 2024-04-19T22:42:11.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9971a18700 1 --2- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 0x7f9958070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:42:11.055 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.054+0000 7f9971a18700 1 --2- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 0x7f9958070470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f996c198b60 tx=0x7f99640073e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:42:11.057 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.058+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f9968014030 con 0x7f996c107fd0 2024-04-19T22:42:11.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:11.274+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9950000bf0 con 0x7f995806dfb0 2024-04-19T22:42:11.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[21528]: cluster 2024-04-19T22:42:10.324429+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:11.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[21528]: audit 2024-04-19T22:42:11.286927+0000 mon.a (mon.0) 524 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:42:11.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[21528]: audit 2024-04-19T22:42:11.293349+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:42:11.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[21528]: audit 2024-04-19T22:42:11.295127+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:11.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[28910]: cluster 2024-04-19T22:42:10.324429+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:11.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[28910]: audit 2024-04-19T22:42:11.286927+0000 mon.a (mon.0) 524 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:42:11.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[28910]: audit 2024-04-19T22:42:11.293349+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:42:11.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:11 smithi113 bash[28910]: audit 2024-04-19T22:42:11.295127+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:11 smithi178 bash[23441]: cluster 2024-04-19T22:42:10.324429+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:11 smithi178 bash[23441]: audit 2024-04-19T22:42:11.286927+0000 mon.a (mon.0) 524 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:42:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:11 smithi178 bash[23441]: audit 2024-04-19T22:42:11.293349+0000 mon.a (mon.0) 525 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:42:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:11 smithi178 bash[23441]: audit 2024-04-19T22:42:11.295127+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:12.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:12 smithi113 bash[21528]: audit 2024-04-19T22:42:11.279547+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:42:12.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:12 smithi113 bash[28910]: audit 2024-04-19T22:42:11.279547+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:42:12.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:12 smithi178 bash[23441]: audit 2024-04-19T22:42:11.279547+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:42:13.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:13 smithi113 bash[21528]: cluster 2024-04-19T22:42:12.324997+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:13.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:13 smithi113 bash[28910]: cluster 2024-04-19T22:42:12.324997+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:13.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:13 smithi178 bash[23441]: cluster 2024-04-19T22:42:12.324997+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:15.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:15 smithi113 bash[28910]: cluster 2024-04-19T22:42:14.325518+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:15.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:15 smithi113 bash[21528]: cluster 2024-04-19T22:42:14.325518+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:15.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:15 smithi178 bash[23441]: cluster 2024-04-19T22:42:14.325518+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:17.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:17 smithi178 bash[23441]: cluster 2024-04-19T22:42:16.326072+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:17.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:17 smithi113 bash[21528]: cluster 2024-04-19T22:42:16.326072+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:17.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:17 smithi113 bash[28910]: cluster 2024-04-19T22:42:16.326072+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:19.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: cluster 2024-04-19T22:42:18.326617+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:19.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: audit 2024-04-19T22:42:19.243225+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.178:0/3696039208' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: audit 2024-04-19T22:42:19.244003+0000 mon.a (mon.0) 527 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: audit 2024-04-19T22:42:19.247349+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]': finished 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: cluster 2024-04-19T22:42:19.253246+0000 mon.a (mon.0) 529 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[21528]: audit 2024-04-19T22:42:19.253905+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: cluster 2024-04-19T22:42:18.326617+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: audit 2024-04-19T22:42:19.243225+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.178:0/3696039208' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: audit 2024-04-19T22:42:19.244003+0000 mon.a (mon.0) 527 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: audit 2024-04-19T22:42:19.247349+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]': finished 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: cluster 2024-04-19T22:42:19.253246+0000 mon.a (mon.0) 529 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-04-19T22:42:19.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:19 smithi113 bash[28910]: audit 2024-04-19T22:42:19.253905+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:19.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: cluster 2024-04-19T22:42:18.326617+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:19.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: audit 2024-04-19T22:42:19.243225+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.178:0/3696039208' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: audit 2024-04-19T22:42:19.244003+0000 mon.a (mon.0) 527 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]: dispatch 2024-04-19T22:42:19.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: audit 2024-04-19T22:42:19.247349+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cb4fd11-e8ba-4531-8f77-cad3a865b53a"}]': finished 2024-04-19T22:42:19.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: cluster 2024-04-19T22:42:19.253246+0000 mon.a (mon.0) 529 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-04-19T22:42:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:19 smithi178 bash[23441]: audit 2024-04-19T22:42:19.253905+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:20.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:20 smithi113 bash[21528]: audit 2024-04-19T22:42:19.991319+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.178:0/3209270142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:42:20.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:20 smithi113 bash[28910]: audit 2024-04-19T22:42:19.991319+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.178:0/3209270142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:42:20.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:20 smithi178 bash[23441]: audit 2024-04-19T22:42:19.991319+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.178:0/3209270142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:42:21.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:21 smithi113 bash[21528]: cluster 2024-04-19T22:42:20.327104+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:21.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:21 smithi113 bash[28910]: cluster 2024-04-19T22:42:20.327104+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:21 smithi178 bash[23441]: cluster 2024-04-19T22:42:20.327104+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:23 smithi113 bash[21528]: cluster 2024-04-19T22:42:22.327667+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:23.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:23 smithi113 bash[28910]: cluster 2024-04-19T22:42:22.327667+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:23.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:23 smithi178 bash[23441]: cluster 2024-04-19T22:42:22.327667+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:25.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:25 smithi113 bash[21528]: cluster 2024-04-19T22:42:24.328182+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:25.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:25 smithi113 bash[28910]: cluster 2024-04-19T22:42:24.328182+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:25.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:25 smithi178 bash[23441]: cluster 2024-04-19T22:42:24.328182+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:27.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:27 smithi113 bash[21528]: cluster 2024-04-19T22:42:26.328745+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:27.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:27 smithi113 bash[28910]: cluster 2024-04-19T22:42:26.328745+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:27.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:27 smithi178 bash[23441]: cluster 2024-04-19T22:42:26.328745+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:29.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:29 smithi113 bash[21528]: cluster 2024-04-19T22:42:28.329259+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:29.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:29 smithi113 bash[28910]: cluster 2024-04-19T22:42:28.329259+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:29.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:29 smithi178 bash[23441]: cluster 2024-04-19T22:42:28.329259+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:31.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[21528]: cluster 2024-04-19T22:42:30.329823+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:31.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[21528]: audit 2024-04-19T22:42:31.192495+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[21528]: audit 2024-04-19T22:42:31.194437+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[21528]: cephadm 2024-04-19T22:42:31.196118+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi178 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[28910]: cluster 2024-04-19T22:42:30.329823+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[28910]: audit 2024-04-19T22:42:31.192495+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[28910]: audit 2024-04-19T22:42:31.194437+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:31.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:31 smithi113 bash[28910]: cephadm 2024-04-19T22:42:31.196118+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi178 2024-04-19T22:42:31.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:31 smithi178 bash[23441]: cluster 2024-04-19T22:42:30.329823+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:31.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:31 smithi178 bash[23441]: audit 2024-04-19T22:42:31.192495+0000 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-19T22:42:31.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:31 smithi178 bash[23441]: audit 2024-04-19T22:42:31.194437+0000 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:31.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:31 smithi178 bash[23441]: cephadm 2024-04-19T22:42:31.196118+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi178 2024-04-19T22:42:33.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:33 smithi113 bash[21528]: cluster 2024-04-19T22:42:32.330372+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:33.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:33 smithi113 bash[28910]: cluster 2024-04-19T22:42:32.330372+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:33.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:33 smithi178 bash[23441]: cluster 2024-04-19T22:42:32.330372+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:35.206 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:34 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.207 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:42:34 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.207 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:42:34 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.526 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:35 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.526 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:42:35 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.527 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:42:35 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:42:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[28910]: cluster 2024-04-19T22:42:34.331025+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[28910]: audit 2024-04-19T22:42:35.362460+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[28910]: audit 2024-04-19T22:42:35.363249+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[28910]: audit 2024-04-19T22:42:35.373942+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[21528]: cluster 2024-04-19T22:42:34.331025+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[21528]: audit 2024-04-19T22:42:35.362460+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[21528]: audit 2024-04-19T22:42:35.363249+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:35 smithi113 bash[21528]: audit 2024-04-19T22:42:35.373942+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:35.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:35 smithi178 bash[23441]: cluster 2024-04-19T22:42:34.331025+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:35.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:35 smithi178 bash[23441]: audit 2024-04-19T22:42:35.362460+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:35.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:35 smithi178 bash[23441]: audit 2024-04-19T22:42:35.363249+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:35 smithi178 bash[23441]: audit 2024-04-19T22:42:35.373942+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:37.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:37 smithi113 bash[21528]: cluster 2024-04-19T22:42:36.331594+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:37.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:37 smithi113 bash[28910]: cluster 2024-04-19T22:42:36.331594+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:37.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:37 smithi178 bash[23441]: cluster 2024-04-19T22:42:36.331594+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:39.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:39 smithi113 bash[21528]: cluster 2024-04-19T22:42:38.332129+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:39.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:39 smithi113 bash[28910]: cluster 2024-04-19T22:42:38.332129+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:39.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:39 smithi178 bash[23441]: cluster 2024-04-19T22:42:38.332129+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:42.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: cluster 2024-04-19T22:42:40.332625+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: audit 2024-04-19T22:42:40.710709+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: audit 2024-04-19T22:42:40.721885+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: audit 2024-04-19T22:42:40.723890+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: audit 2024-04-19T22:42:40.725880+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[21528]: audit 2024-04-19T22:42:40.737620+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: cluster 2024-04-19T22:42:40.332625+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: audit 2024-04-19T22:42:40.710709+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: audit 2024-04-19T22:42:40.721885+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: audit 2024-04-19T22:42:40.723890+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:42.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: audit 2024-04-19T22:42:40.725880+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:42.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:41 smithi113 bash[28910]: audit 2024-04-19T22:42:40.737620+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: cluster 2024-04-19T22:42:40.332625+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: audit 2024-04-19T22:42:40.710709+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: audit 2024-04-19T22:42:40.721885+0000 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: audit 2024-04-19T22:42:40.723890+0000 mon.a (mon.0) 538 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: audit 2024-04-19T22:42:40.725880+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:41 smithi178 bash[23441]: audit 2024-04-19T22:42:40.737620+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:43.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:42 smithi113 bash[28910]: audit 2024-04-19T22:42:41.760724+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:42 smithi113 bash[28910]: audit 2024-04-19T22:42:41.761408+0000 mon.a (mon.0) 541 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:42 smithi113 bash[21528]: audit 2024-04-19T22:42:41.760724+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:42 smithi113 bash[21528]: audit 2024-04-19T22:42:41.761408+0000 mon.a (mon.0) 541 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:42 smithi178 bash[23441]: audit 2024-04-19T22:42:41.760724+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:42 smithi178 bash[23441]: audit 2024-04-19T22:42:41.761408+0000 mon.a (mon.0) 541 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-19T22:42:43.936 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.938+0000 7f9962ffd700 1 -- 172.21.15.178:0/852997581 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9950000bf0 con 0x7f995806dfb0 2024-04-19T22:42:43.937 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5 on host 'smithi178' 2024-04-19T22:42:43.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 msgr2=0x7f9958070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:42:43.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 0x7f9958070470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f996c198b60 tx=0x7f99640073e0 comp rx=0 tx=0).stop 2024-04-19T22:42:43.939 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 msgr2=0x7f996c19f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f996800c970 tx=0x7f996800cd30 comp rx=0 tx=0).stop 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 shutdown_connections 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> v2:172.21.15.113:6800/467518466 conn(0x7f995806dfb0 0x7f9958070470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f996c107fd0 0x7f996c19f230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c102d70 0x7f996c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 --2- 172.21.15.178:0/852997581 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f996c1056a0 0x7f996c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 >> 172.21.15.178:0/852997581 conn(0x7f996c0fc780 msgr2=0x7f996c1039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 shutdown_connections 2024-04-19T22:42:43.940 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:42:43.942+0000 7f9973c7c700 1 -- 172.21.15.178:0/852997581 wait complete. 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: cluster 2024-04-19T22:42:42.333151+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: audit 2024-04-19T22:42:42.721460+0000 mon.a (mon.0) 542 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: audit 2024-04-19T22:42:42.725633+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: cluster 2024-04-19T22:42:42.729283+0000 mon.a (mon.0) 543 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: audit 2024-04-19T22:42:42.730153+0000 mon.a (mon.0) 544 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:43.984 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:43 smithi178 bash[23441]: audit 2024-04-19T22:42:42.730716+0000 mon.a (mon.0) 545 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:44.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: cluster 2024-04-19T22:42:42.333151+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:44.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: audit 2024-04-19T22:42:42.721460+0000 mon.a (mon.0) 542 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: audit 2024-04-19T22:42:42.725633+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: cluster 2024-04-19T22:42:42.729283+0000 mon.a (mon.0) 543 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: audit 2024-04-19T22:42:42.730153+0000 mon.a (mon.0) 544 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[21528]: audit 2024-04-19T22:42:42.730716+0000 mon.a (mon.0) 545 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: cluster 2024-04-19T22:42:42.333151+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: audit 2024-04-19T22:42:42.721460+0000 mon.a (mon.0) 542 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: audit 2024-04-19T22:42:42.725633+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v2:172.21.15.178:6804/2719719766' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: cluster 2024-04-19T22:42:42.729283+0000 mon.a (mon.0) 543 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: audit 2024-04-19T22:42:42.730153+0000 mon.a (mon.0) 544 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:44.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:43 smithi113 bash[28910]: audit 2024-04-19T22:42:42.730716+0000 mon.a (mon.0) 545 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:42:44.627 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.5.service 2024-04-19T22:42:44.630 INFO:tasks.cephadm:Deploying osd.6 on smithi178 with /dev/vg_nvme/lv_2... 2024-04-19T22:42:44.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-19T22:42:45.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.724009+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: cluster 2024-04-19T22:42:43.731856+0000 mon.a (mon.0) 547 : cluster 0 osdmap e38: 6 total, 5 up, 6 in 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.733265+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.743390+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.908318+0000 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.917743+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:43.933454+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: cluster 2024-04-19T22:42:44.732177+0000 mon.a (mon.0) 553 : cluster 1 osd.5 v2:172.21.15.178:6804/2719719766 boot 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: cluster 2024-04-19T22:42:44.732302+0000 mon.a (mon.0) 554 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[21528]: audit 2024-04-19T22:42:44.732625+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.724009+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: cluster 2024-04-19T22:42:43.731856+0000 mon.a (mon.0) 547 : cluster 0 osdmap e38: 6 total, 5 up, 6 in 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.733265+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.743390+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.908318+0000 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.917743+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:43.933454+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: cluster 2024-04-19T22:42:44.732177+0000 mon.a (mon.0) 553 : cluster 1 osd.5 v2:172.21.15.178:6804/2719719766 boot 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: cluster 2024-04-19T22:42:44.732302+0000 mon.a (mon.0) 554 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-04-19T22:42:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:44 smithi113 bash[28910]: audit 2024-04-19T22:42:44.732625+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.724009+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: cluster 2024-04-19T22:42:43.731856+0000 mon.a (mon.0) 547 : cluster 0 osdmap e38: 6 total, 5 up, 6 in 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.733265+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.743390+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.908318+0000 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.917743+0000 mon.a (mon.0) 551 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:43.933454+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: cluster 2024-04-19T22:42:44.732177+0000 mon.a (mon.0) 553 : cluster 1 osd.5 v2:172.21.15.178:6804/2719719766 boot 2024-04-19T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: cluster 2024-04-19T22:42:44.732302+0000 mon.a (mon.0) 554 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-04-19T22:42:45.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:44 smithi178 bash[23441]: audit 2024-04-19T22:42:44.732625+0000 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:42:46.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[28910]: cluster 2024-04-19T22:42:42.788848+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[28910]: cluster 2024-04-19T22:42:42.788934+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[28910]: cluster 2024-04-19T22:42:44.333687+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[28910]: cluster 2024-04-19T22:42:45.734230+0000 mon.a (mon.0) 556 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[21528]: cluster 2024-04-19T22:42:42.788848+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[21528]: cluster 2024-04-19T22:42:42.788934+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[21528]: cluster 2024-04-19T22:42:44.333687+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:45 smithi113 bash[21528]: cluster 2024-04-19T22:42:45.734230+0000 mon.a (mon.0) 556 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-04-19T22:42:46.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:45 smithi178 bash[23441]: cluster 2024-04-19T22:42:42.788848+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:42:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:45 smithi178 bash[23441]: cluster 2024-04-19T22:42:42.788934+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:42:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:45 smithi178 bash[23441]: cluster 2024-04-19T22:42:44.333687+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-19T22:42:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:45 smithi178 bash[23441]: cluster 2024-04-19T22:42:45.734230+0000 mon.a (mon.0) 556 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-04-19T22:42:48.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:47 smithi113 bash[28910]: cluster 2024-04-19T22:42:46.334209+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:48.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:47 smithi113 bash[28910]: cluster 2024-04-19T22:42:46.738259+0000 mon.a (mon.0) 557 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-04-19T22:42:48.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:47 smithi113 bash[21528]: cluster 2024-04-19T22:42:46.334209+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:48.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:47 smithi113 bash[21528]: cluster 2024-04-19T22:42:46.738259+0000 mon.a (mon.0) 557 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-04-19T22:42:48.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:47 smithi178 bash[23441]: cluster 2024-04-19T22:42:46.334209+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:48.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:47 smithi178 bash[23441]: cluster 2024-04-19T22:42:46.738259+0000 mon.a (mon.0) 557 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-04-19T22:42:48.881 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:42:49.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:48 smithi113 bash[21528]: cluster 2024-04-19T22:42:47.748712+0000 mon.a (mon.0) 558 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-04-19T22:42:49.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:48 smithi113 bash[28910]: cluster 2024-04-19T22:42:47.748712+0000 mon.a (mon.0) 558 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-04-19T22:42:49.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:48 smithi178 bash[23441]: cluster 2024-04-19T22:42:47.748712+0000 mon.a (mon.0) 558 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-04-19T22:42:50.008 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:49 smithi178 bash[23441]: cluster 2024-04-19T22:42:48.334748+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:50.008 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:49 smithi178 bash[23441]: cluster 2024-04-19T22:42:48.766960+0000 mon.a (mon.0) 559 : cluster 0 osdmap e43: 6 total, 6 up, 6 in 2024-04-19T22:42:50.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:49 smithi113 bash[21528]: cluster 2024-04-19T22:42:48.334748+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:50.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:49 smithi113 bash[21528]: cluster 2024-04-19T22:42:48.766960+0000 mon.a (mon.0) 559 : cluster 0 osdmap e43: 6 total, 6 up, 6 in 2024-04-19T22:42:50.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:49 smithi113 bash[28910]: cluster 2024-04-19T22:42:48.334748+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:50.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:49 smithi113 bash[28910]: cluster 2024-04-19T22:42:48.766960+0000 mon.a (mon.0) 559 : cluster 0 osdmap e43: 6 total, 6 up, 6 in 2024-04-19T22:42:52.017 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:51 smithi178 bash[23441]: cluster 2024-04-19T22:42:50.335417+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:52.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:51 smithi113 bash[21528]: cluster 2024-04-19T22:42:50.335417+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:52.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:51 smithi113 bash[28910]: cluster 2024-04-19T22:42:50.335417+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0157179 s, 667 MB/s 2024-04-19T22:42:52.692 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-04-19T22:42:53.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2024-04-19T22:42:54.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:53 smithi113 bash[28910]: cluster 2024-04-19T22:42:52.335987+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:54.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:53 smithi113 bash[21528]: cluster 2024-04-19T22:42:52.335987+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:54.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:53 smithi178 bash[23441]: cluster 2024-04-19T22:42:52.335987+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:55.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: cephadm 2024-04-19T22:42:53.878575+0000 mgr.y (mgr.14152) 263 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:55.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.887674+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.897203+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.899713+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.901851+0000 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: cephadm 2024-04-19T22:42:53.903161+0000 mgr.y (mgr.14152) 264 : cephadm 1 Adjusting osd_memory_target on smithi178 to 8632M 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.909668+0000 mon.a (mon.0) 564 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.914239+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.915907+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[28910]: audit 2024-04-19T22:42:53.925764+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: cephadm 2024-04-19T22:42:53.878575+0000 mgr.y (mgr.14152) 263 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:55.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.887674+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.897203+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.899713+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.901851+0000 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: cephadm 2024-04-19T22:42:53.903161+0000 mgr.y (mgr.14152) 264 : cephadm 1 Adjusting osd_memory_target on smithi178 to 8632M 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.909668+0000 mon.a (mon.0) 564 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.914239+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.915907+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:54 smithi113 bash[21528]: audit 2024-04-19T22:42:53.925764+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: cephadm 2024-04-19T22:42:53.878575+0000 mgr.y (mgr.14152) 263 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.887674+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.897203+0000 mon.a (mon.0) 561 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.899713+0000 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.901851+0000 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: cephadm 2024-04-19T22:42:53.903161+0000 mgr.y (mgr.14152) 264 : cephadm 1 Adjusting osd_memory_target on smithi178 to 8632M 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.909668+0000 mon.a (mon.0) 564 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.914239+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.915907+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:42:55.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:54 smithi178 bash[23441]: audit 2024-04-19T22:42:53.925764+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:42:56.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:55 smithi113 bash[21528]: cluster 2024-04-19T22:42:54.336538+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:56.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:55 smithi113 bash[28910]: cluster 2024-04-19T22:42:54.336538+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:56.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:55 smithi178 bash[23441]: cluster 2024-04-19T22:42:54.336538+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:58.235 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:42:58.257 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:57 smithi178 bash[23441]: cluster 2024-04-19T22:42:56.337104+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:58.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:57 smithi113 bash[21528]: cluster 2024-04-19T22:42:56.337104+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:42:58.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:57 smithi113 bash[28910]: cluster 2024-04-19T22:42:56.337104+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:00.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:42:59 smithi178 bash[23441]: cluster 2024-04-19T22:42:58.337657+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:00.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:42:59 smithi113 bash[21528]: cluster 2024-04-19T22:42:58.337657+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:00.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:42:59 smithi113 bash[28910]: cluster 2024-04-19T22:42:58.337657+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:00.613 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/611139893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541034f0 msgr2=0x7f9254103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- 172.21.15.178:0/611139893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541034f0 0x7f9254103950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f92480099c0 tx=0x7f9248009cd0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/611139893 shutdown_connections 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- 172.21.15.178:0/611139893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9254103e90 0x7f925410a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- 172.21.15.178:0/611139893 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f92541022f0 0x7f9254102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- 172.21.15.178:0/611139893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541034f0 0x7f9254103950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/611139893 >> 172.21.15.178:0/611139893 conn(0x7f92540fd8b0 msgr2=0x7f92540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/611139893 shutdown_connections 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/611139893 wait complete. 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 Processor -- start 2024-04-19T22:43:00.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- start start 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 0x7f9254198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 0x7f925419f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f925410d660 con 0x7f92541034f0 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f925410d4e0 con 0x7f92541022f0 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f925410d7e0 con 0x7f9254103e90 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:53874/0 (socket says 172.21.15.178:53874) 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 -- 172.21.15.178:0/3656076543 learned_addr learned my addr 172.21.15.178:0/3656076543 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925a1da700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 0x7f925419f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92591d8700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 0x7f9254198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 -- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 msgr2=0x7f925419f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:00.615 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 0x7f925419f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 -- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 msgr2=0x7f9254198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 0x7f9254198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 -- 172.21.15.178:0/3656076543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925419f8f0 con 0x7f92541022f0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925a1da700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 0x7f925419f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92591d8700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 0x7f9254198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f92599d9700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f924400b9c0 tx=0x7f924400bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244019070 con 0x7f92541022f0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f9244014440 con 0x7f92541022f0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92440125a0 con 0x7f92541022f0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925419fbe0 con 0x7f92541022f0 2024-04-19T22:43:00.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.614+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92541a00d0 con 0x7f92541022f0 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925404ff50 con 0x7f92541022f0 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f924401c070 con 0x7f92541022f0 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f9252ffd700 1 --2- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 0x7f923c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 3497+0+0 (secure 0 0 0) 0x7f924408c9b0 con 0x7f92541022f0 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f92591d8700 1 --2- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 0x7f923c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:00.617 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.618+0000 7f92591d8700 1 --2- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 0x7f923c070470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9248006010 tx=0x7f92480036a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:43:00.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.622+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f924405a6b0 con 0x7f92541022f0 2024-04-19T22:43:00.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:00.842+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9254062670 con 0x7f923c06dfb0 2024-04-19T22:43:01.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[21528]: audit 2024-04-19T22:43:00.856577+0000 mon.a (mon.0) 568 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:01.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[21528]: audit 2024-04-19T22:43:00.863197+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:01.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[21528]: audit 2024-04-19T22:43:00.865109+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:01.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[28910]: audit 2024-04-19T22:43:00.856577+0000 mon.a (mon.0) 568 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:01.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[28910]: audit 2024-04-19T22:43:00.863197+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:01.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:00 smithi113 bash[28910]: audit 2024-04-19T22:43:00.865109+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:01.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:00 smithi178 bash[23441]: audit 2024-04-19T22:43:00.856577+0000 mon.a (mon.0) 568 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:01.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:00 smithi178 bash[23441]: audit 2024-04-19T22:43:00.863197+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:01.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:00 smithi178 bash[23441]: audit 2024-04-19T22:43:00.865109+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:01 smithi113 bash[21528]: cluster 2024-04-19T22:43:00.338226+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:02.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:01 smithi113 bash[21528]: audit 2024-04-19T22:43:00.849500+0000 mgr.y (mgr.14152) 269 : audit 0 from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:01 smithi113 bash[28910]: cluster 2024-04-19T22:43:00.338226+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:02.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:01 smithi113 bash[28910]: audit 2024-04-19T22:43:00.849500+0000 mgr.y (mgr.14152) 269 : audit 0 from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:02.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:01 smithi178 bash[23441]: cluster 2024-04-19T22:43:00.338226+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:02.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:01 smithi178 bash[23441]: audit 2024-04-19T22:43:00.849500+0000 mgr.y (mgr.14152) 269 : audit 0 from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:04.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:03 smithi113 bash[21528]: cluster 2024-04-19T22:43:02.338771+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:04.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:03 smithi113 bash[28910]: cluster 2024-04-19T22:43:02.338771+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:04.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:03 smithi178 bash[23441]: cluster 2024-04-19T22:43:02.338771+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:06.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:05 smithi113 bash[21528]: cluster 2024-04-19T22:43:04.339355+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:06.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:05 smithi113 bash[28910]: cluster 2024-04-19T22:43:04.339355+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:06.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:05 smithi178 bash[23441]: cluster 2024-04-19T22:43:04.339355+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:08.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:07 smithi113 bash[21528]: cluster 2024-04-19T22:43:06.340042+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:08.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:07 smithi113 bash[28910]: cluster 2024-04-19T22:43:06.340042+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:08.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:07 smithi178 bash[23441]: cluster 2024-04-19T22:43:06.340042+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:09.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[21528]: audit 2024-04-19T22:43:08.949444+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.178:0/3618191588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[21528]: audit 2024-04-19T22:43:08.950402+0000 mon.a (mon.0) 571 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[21528]: audit 2024-04-19T22:43:08.953991+0000 mon.a (mon.0) 572 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]': finished 2024-04-19T22:43:09.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[28910]: audit 2024-04-19T22:43:08.949444+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.178:0/3618191588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[28910]: audit 2024-04-19T22:43:08.950402+0000 mon.a (mon.0) 571 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:08 smithi113 bash[28910]: audit 2024-04-19T22:43:08.953991+0000 mon.a (mon.0) 572 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]': finished 2024-04-19T22:43:09.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:08 smithi178 bash[23441]: audit 2024-04-19T22:43:08.949444+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.178:0/3618191588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:08 smithi178 bash[23441]: audit 2024-04-19T22:43:08.950402+0000 mon.a (mon.0) 571 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]: dispatch 2024-04-19T22:43:09.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:08 smithi178 bash[23441]: audit 2024-04-19T22:43:08.953991+0000 mon.a (mon.0) 572 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c"}]': finished 2024-04-19T22:43:10.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[21528]: cluster 2024-04-19T22:43:08.340611+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:10.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[21528]: cluster 2024-04-19T22:43:08.962075+0000 mon.a (mon.0) 573 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[21528]: audit 2024-04-19T22:43:08.963343+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[21528]: audit 2024-04-19T22:43:09.654453+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.178:0/1166530742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[28910]: cluster 2024-04-19T22:43:08.340611+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[28910]: cluster 2024-04-19T22:43:08.962075+0000 mon.a (mon.0) 573 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[28910]: audit 2024-04-19T22:43:08.963343+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:10.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:09 smithi113 bash[28910]: audit 2024-04-19T22:43:09.654453+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.178:0/1166530742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:43:10.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:09 smithi178 bash[23441]: cluster 2024-04-19T22:43:08.340611+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:10.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:09 smithi178 bash[23441]: cluster 2024-04-19T22:43:08.962075+0000 mon.a (mon.0) 573 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-04-19T22:43:10.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:09 smithi178 bash[23441]: audit 2024-04-19T22:43:08.963343+0000 mon.a (mon.0) 574 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:10.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:09 smithi178 bash[23441]: audit 2024-04-19T22:43:09.654453+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.178:0/1166530742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:43:12.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:11 smithi113 bash[21528]: cluster 2024-04-19T22:43:10.341254+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:12.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:11 smithi113 bash[28910]: cluster 2024-04-19T22:43:10.341254+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:12.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:11 smithi178 bash[23441]: cluster 2024-04-19T22:43:10.341254+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:14.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:13 smithi113 bash[21528]: cluster 2024-04-19T22:43:12.341813+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:14.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:13 smithi113 bash[28910]: cluster 2024-04-19T22:43:12.341813+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:14.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:13 smithi178 bash[23441]: cluster 2024-04-19T22:43:12.341813+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:16.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:15 smithi113 bash[21528]: cluster 2024-04-19T22:43:14.342338+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:16.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:15 smithi113 bash[28910]: cluster 2024-04-19T22:43:14.342338+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:16.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:15 smithi178 bash[23441]: cluster 2024-04-19T22:43:14.342338+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:18.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:17 smithi113 bash[21528]: cluster 2024-04-19T22:43:16.342836+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:18.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:17 smithi113 bash[28910]: cluster 2024-04-19T22:43:16.342836+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:18.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:18 smithi178 bash[23441]: cluster 2024-04-19T22:43:16.342836+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:20.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:19 smithi113 bash[21528]: cluster 2024-04-19T22:43:18.343365+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:20.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:19 smithi113 bash[28910]: cluster 2024-04-19T22:43:18.343365+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:19 smithi178 bash[23441]: cluster 2024-04-19T22:43:18.343365+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:22.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[21528]: cluster 2024-04-19T22:43:20.343932+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[21528]: audit 2024-04-19T22:43:21.232561+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[21528]: audit 2024-04-19T22:43:21.234597+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[21528]: cephadm 2024-04-19T22:43:21.236323+0000 mgr.y (mgr.14152) 280 : cephadm 1 Deploying daemon osd.6 on smithi178 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[28910]: cluster 2024-04-19T22:43:20.343932+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[28910]: audit 2024-04-19T22:43:21.232561+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[28910]: audit 2024-04-19T22:43:21.234597+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:22.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:21 smithi113 bash[28910]: cephadm 2024-04-19T22:43:21.236323+0000 mgr.y (mgr.14152) 280 : cephadm 1 Deploying daemon osd.6 on smithi178 2024-04-19T22:43:22.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:21 smithi178 bash[23441]: cluster 2024-04-19T22:43:20.343932+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:22.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:21 smithi178 bash[23441]: audit 2024-04-19T22:43:21.232561+0000 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-19T22:43:22.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:21 smithi178 bash[23441]: audit 2024-04-19T22:43:21.234597+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:22.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:21 smithi178 bash[23441]: cephadm 2024-04-19T22:43:21.236323+0000 mgr.y (mgr.14152) 280 : cephadm 1 Deploying daemon osd.6 on smithi178 2024-04-19T22:43:24.232 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:23 smithi178 bash[23441]: cluster 2024-04-19T22:43:22.344504+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:24.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:24 smithi113 bash[28910]: cluster 2024-04-19T22:43:22.344504+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:24.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:24 smithi113 bash[21528]: cluster 2024-04-19T22:43:22.344504+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:25.293 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.293 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.293 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.294 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.550 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.550 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:25.550 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:43:25 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:43:26.271 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:26 smithi178 bash[23441]: cluster 2024-04-19T22:43:24.345086+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:26.271 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:26 smithi178 bash[23441]: audit 2024-04-19T22:43:25.548060+0000 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.271 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:26 smithi178 bash[23441]: audit 2024-04-19T22:43:25.558227+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.271 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:26 smithi178 bash[23441]: audit 2024-04-19T22:43:25.559170+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:26.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[28910]: cluster 2024-04-19T22:43:24.345086+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:26.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[28910]: audit 2024-04-19T22:43:25.548060+0000 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[28910]: audit 2024-04-19T22:43:25.558227+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[28910]: audit 2024-04-19T22:43:25.559170+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:26.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[21528]: cluster 2024-04-19T22:43:24.345086+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:26.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[21528]: audit 2024-04-19T22:43:25.548060+0000 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[21528]: audit 2024-04-19T22:43:25.558227+0000 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:26.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:26 smithi113 bash[21528]: audit 2024-04-19T22:43:25.559170+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:28 smithi113 bash[21528]: cluster 2024-04-19T22:43:26.345596+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:28.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:28 smithi113 bash[28910]: cluster 2024-04-19T22:43:26.345596+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:28 smithi178 bash[23441]: cluster 2024-04-19T22:43:26.345596+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:30.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:30 smithi113 bash[28910]: cluster 2024-04-19T22:43:28.346129+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:30.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:30 smithi113 bash[21528]: cluster 2024-04-19T22:43:28.346129+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:30.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:30 smithi178 bash[23441]: cluster 2024-04-19T22:43:28.346129+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:32.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[21528]: cluster 2024-04-19T22:43:30.346750+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:32.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[21528]: audit 2024-04-19T22:43:31.755257+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:32.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[21528]: audit 2024-04-19T22:43:31.756049+0000 mon.a (mon.0) 580 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:32.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[28910]: cluster 2024-04-19T22:43:30.346750+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:32.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[28910]: audit 2024-04-19T22:43:31.755257+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:32.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:32 smithi113 bash[28910]: audit 2024-04-19T22:43:31.756049+0000 mon.a (mon.0) 580 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:32.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:32 smithi178 bash[23441]: cluster 2024-04-19T22:43:30.346750+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:32.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:32 smithi178 bash[23441]: audit 2024-04-19T22:43:31.755257+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:32.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:32 smithi178 bash[23441]: audit 2024-04-19T22:43:31.756049+0000 mon.a (mon.0) 580 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-19T22:43:33.070 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.014781+0000 mon.a (mon.0) 581 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-19T22:43:33.070 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.020904+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.070 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: cluster 2024-04-19T22:43:32.022091+0000 mon.a (mon.0) 582 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-04-19T22:43:33.070 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.023144+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.023830+0000 mon.a (mon.0) 584 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.365142+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:32.376240+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:33.017323+0000 mon.a (mon.0) 587 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: cluster 2024-04-19T22:43:33.023042+0000 mon.a (mon.0) 588 : cluster 0 osdmap e46: 7 total, 6 up, 7 in 2024-04-19T22:43:33.071 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:33 smithi178 bash[23441]: audit 2024-04-19T22:43:33.023763+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:33.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.014781+0000 mon.a (mon.0) 581 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.020904+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: cluster 2024-04-19T22:43:32.022091+0000 mon.a (mon.0) 582 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.023144+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.023830+0000 mon.a (mon.0) 584 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.365142+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:32.376240+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:33.017323+0000 mon.a (mon.0) 587 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: cluster 2024-04-19T22:43:33.023042+0000 mon.a (mon.0) 588 : cluster 0 osdmap e46: 7 total, 6 up, 7 in 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[21528]: audit 2024-04-19T22:43:33.023763+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:33.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.014781+0000 mon.a (mon.0) 581 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.020904+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v2:172.21.15.178:6808/2545851179' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: cluster 2024-04-19T22:43:32.022091+0000 mon.a (mon.0) 582 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.023144+0000 mon.a (mon.0) 583 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.023830+0000 mon.a (mon.0) 584 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.365142+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:32.376240+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:33.017323+0000 mon.a (mon.0) 587 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: cluster 2024-04-19T22:43:33.023042+0000 mon.a (mon.0) 588 : cluster 0 osdmap e46: 7 total, 6 up, 7 in 2024-04-19T22:43:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:33 smithi113 bash[28910]: audit 2024-04-19T22:43:33.023763+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: cluster 2024-04-19T22:43:32.347299+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.032136+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.059190+0000 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.061127+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.075024+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.324379+0000 mon.a (mon.0) 594 : audit 1 from='osd.6 ' entity='osd.6' 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: cluster 2024-04-19T22:43:33.377445+0000 mon.a (mon.0) 595 : cluster 1 osd.6 v2:172.21.15.178:6808/2545851179 boot 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: cluster 2024-04-19T22:43:33.377538+0000 mon.a (mon.0) 596 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[28910]: audit 2024-04-19T22:43:33.377840+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: cluster 2024-04-19T22:43:32.347299+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.032136+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.059190+0000 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.061127+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.075024+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.324379+0000 mon.a (mon.0) 594 : audit 1 from='osd.6 ' entity='osd.6' 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: cluster 2024-04-19T22:43:33.377445+0000 mon.a (mon.0) 595 : cluster 1 osd.6 v2:172.21.15.178:6808/2545851179 boot 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: cluster 2024-04-19T22:43:33.377538+0000 mon.a (mon.0) 596 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-04-19T22:43:34.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:34 smithi113 bash[21528]: audit 2024-04-19T22:43:33.377840+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: cluster 2024-04-19T22:43:32.347299+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.032136+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.059190+0000 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.061127+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.075024+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.324379+0000 mon.a (mon.0) 594 : audit 1 from='osd.6 ' entity='osd.6' 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: cluster 2024-04-19T22:43:33.377445+0000 mon.a (mon.0) 595 : cluster 1 osd.6 v2:172.21.15.178:6808/2545851179 boot 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: cluster 2024-04-19T22:43:33.377538+0000 mon.a (mon.0) 596 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-04-19T22:43:34.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:34 smithi178 bash[23441]: audit 2024-04-19T22:43:33.377840+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:43:35.585 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.586+0000 7f9252ffd700 1 -- 172.21.15.178:0/3656076543 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9254062670 con 0x7f923c06dfb0 2024-04-19T22:43:35.585 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 6 on host 'smithi178' 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 msgr2=0x7f923c070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 0x7f923c070470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9248006010 tx=0x7f92480036a0 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 msgr2=0x7f9254197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f924400b9c0 tx=0x7f924400bd80 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 shutdown_connections 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> v2:172.21.15.113:6800/467518466 conn(0x7f923c06dfb0 0x7f923c070470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9254103e90 0x7f925419f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92541022f0 0x7f9254197cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 --2- 172.21.15.178:0/3656076543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92541034f0 0x7f9254198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:35.588 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 >> 172.21.15.178:0/3656076543 conn(0x7f92540fd8b0 msgr2=0x7f92540ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:43:35.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 shutdown_connections 2024-04-19T22:43:35.589 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:35.590+0000 7f925bc3d700 1 -- 172.21.15.178:0/3656076543 wait complete. 2024-04-19T22:43:35.635 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:35 smithi178 bash[23441]: cluster 2024-04-19T22:43:32.712412+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:43:35.635 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:35 smithi178 bash[23441]: cluster 2024-04-19T22:43:32.712509+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:43:35.635 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:35 smithi178 bash[23441]: cluster 2024-04-19T22:43:34.347905+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v267: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:35.635 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:35 smithi178 bash[23441]: cluster 2024-04-19T22:43:34.380841+0000 mon.a (mon.0) 598 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-04-19T22:43:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[28910]: cluster 2024-04-19T22:43:32.712412+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:43:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[28910]: cluster 2024-04-19T22:43:32.712509+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[28910]: cluster 2024-04-19T22:43:34.347905+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v267: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[28910]: cluster 2024-04-19T22:43:34.380841+0000 mon.a (mon.0) 598 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[21528]: cluster 2024-04-19T22:43:32.712412+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[21528]: cluster 2024-04-19T22:43:32.712509+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[21528]: cluster 2024-04-19T22:43:34.347905+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v267: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:35 smithi113 bash[21528]: cluster 2024-04-19T22:43:34.380841+0000 mon.a (mon.0) 598 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-04-19T22:43:36.219 DEBUG:teuthology.orchestra.run.smithi178:osd.6> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.6.service 2024-04-19T22:43:36.222 INFO:tasks.cephadm:Deploying osd.7 on smithi178 with /dev/vg_nvme/lv_1... 2024-04-19T22:43:36.222 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-19T22:43:36.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:36 smithi178 bash[23441]: cluster 2024-04-19T22:43:35.391680+0000 mon.a (mon.0) 599 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-04-19T22:43:36.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:36 smithi178 bash[23441]: audit 2024-04-19T22:43:35.553342+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:36 smithi178 bash[23441]: audit 2024-04-19T22:43:35.562827+0000 mon.a (mon.0) 601 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:36 smithi178 bash[23441]: audit 2024-04-19T22:43:35.567176+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:36.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[21528]: cluster 2024-04-19T22:43:35.391680+0000 mon.a (mon.0) 599 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-04-19T22:43:36.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[21528]: audit 2024-04-19T22:43:35.553342+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[21528]: audit 2024-04-19T22:43:35.562827+0000 mon.a (mon.0) 601 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[21528]: audit 2024-04-19T22:43:35.567176+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[28910]: cluster 2024-04-19T22:43:35.391680+0000 mon.a (mon.0) 599 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-04-19T22:43:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[28910]: audit 2024-04-19T22:43:35.553342+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[28910]: audit 2024-04-19T22:43:35.562827+0000 mon.a (mon.0) 601 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:36 smithi113 bash[28910]: audit 2024-04-19T22:43:35.567176+0000 mon.a (mon.0) 602 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:43:38.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:37 smithi113 bash[21528]: cluster 2024-04-19T22:43:36.348469+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v270: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:38.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:37 smithi113 bash[21528]: cluster 2024-04-19T22:43:36.572051+0000 mon.a (mon.0) 603 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-04-19T22:43:38.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:37 smithi113 bash[28910]: cluster 2024-04-19T22:43:36.348469+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v270: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:38.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:37 smithi113 bash[28910]: cluster 2024-04-19T22:43:36.572051+0000 mon.a (mon.0) 603 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-04-19T22:43:38.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:37 smithi178 bash[23441]: cluster 2024-04-19T22:43:36.348469+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v270: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:38.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:37 smithi178 bash[23441]: cluster 2024-04-19T22:43:36.572051+0000 mon.a (mon.0) 603 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-04-19T22:43:39.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:38 smithi113 bash[21528]: cluster 2024-04-19T22:43:37.581245+0000 mon.a (mon.0) 604 : cluster 0 osdmap e51: 7 total, 7 up, 7 in 2024-04-19T22:43:39.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:38 smithi113 bash[28910]: cluster 2024-04-19T22:43:37.581245+0000 mon.a (mon.0) 604 : cluster 0 osdmap e51: 7 total, 7 up, 7 in 2024-04-19T22:43:39.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:38 smithi178 bash[23441]: cluster 2024-04-19T22:43:37.581245+0000 mon.a (mon.0) 604 : cluster 0 osdmap e51: 7 total, 7 up, 7 in 2024-04-19T22:43:40.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:39 smithi113 bash[21528]: cluster 2024-04-19T22:43:38.349001+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v273: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:40.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:39 smithi113 bash[28910]: cluster 2024-04-19T22:43:38.349001+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v273: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:40.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:39 smithi178 bash[23441]: cluster 2024-04-19T22:43:38.349001+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v273: 1 pgs: 1 remapped; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:40.542 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:43:42.001 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:41 smithi178 bash[23441]: cluster 2024-04-19T22:43:40.349544+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:43:42.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:41 smithi113 bash[21528]: cluster 2024-04-19T22:43:40.349544+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:43:42.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:41 smithi113 bash[28910]: cluster 2024-04-19T22:43:40.349544+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-19T22:43:43.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:43 smithi178 bash[23441]: cluster 2024-04-19T22:43:42.350119+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:43:44.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:43 smithi113 bash[21528]: cluster 2024-04-19T22:43:42.350119+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:43:44.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:43 smithi113 bash[28910]: cluster 2024-04-19T22:43:42.350119+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00978252 s, 1.1 GB/s 2024-04-19T22:43:44.170 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-04-19T22:43:44.978 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2024-04-19T22:43:46.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: cluster 2024-04-19T22:43:44.350824+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.373538+0000 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.383814+0000 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.386453+0000 mon.a (mon.0) 607 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.388314+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.390136+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.398164+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.402501+0000 mon.a (mon.0) 611 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.404254+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[21528]: audit 2024-04-19T22:43:45.414057+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: cluster 2024-04-19T22:43:44.350824+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:43:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.373538+0000 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.383814+0000 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.386453+0000 mon.a (mon.0) 607 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.388314+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.390136+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.398164+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.402501+0000 mon.a (mon.0) 611 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.404254+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:46.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:45 smithi113 bash[28910]: audit 2024-04-19T22:43:45.414057+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: cluster 2024-04-19T22:43:44.350824+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.373538+0000 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.383814+0000 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.386453+0000 mon.a (mon.0) 607 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.388314+0000 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.390136+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.398164+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.402501+0000 mon.a (mon.0) 611 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.404254+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:43:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:45 smithi178 bash[23441]: audit 2024-04-19T22:43:45.414057+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:43:47.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:46 smithi113 bash[21528]: cephadm 2024-04-19T22:43:45.364184+0000 mgr.y (mgr.14152) 293 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:43:47.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:46 smithi113 bash[21528]: cephadm 2024-04-19T22:43:45.391473+0000 mgr.y (mgr.14152) 294 : cephadm 1 Adjusting osd_memory_target on smithi178 to 5755M 2024-04-19T22:43:47.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:46 smithi113 bash[28910]: cephadm 2024-04-19T22:43:45.364184+0000 mgr.y (mgr.14152) 293 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:43:47.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:46 smithi113 bash[28910]: cephadm 2024-04-19T22:43:45.391473+0000 mgr.y (mgr.14152) 294 : cephadm 1 Adjusting osd_memory_target on smithi178 to 5755M 2024-04-19T22:43:47.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:46 smithi178 bash[23441]: cephadm 2024-04-19T22:43:45.364184+0000 mgr.y (mgr.14152) 293 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:43:47.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:46 smithi178 bash[23441]: cephadm 2024-04-19T22:43:45.391473+0000 mgr.y (mgr.14152) 294 : cephadm 1 Adjusting osd_memory_target on smithi178 to 5755M 2024-04-19T22:43:48.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:47 smithi113 bash[21528]: cluster 2024-04-19T22:43:46.351471+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-19T22:43:48.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:47 smithi113 bash[28910]: cluster 2024-04-19T22:43:46.351471+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-19T22:43:48.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:47 smithi178 bash[23441]: cluster 2024-04-19T22:43:46.351471+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-19T22:43:49.721 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:43:50.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:49 smithi113 bash[21528]: cluster 2024-04-19T22:43:48.351997+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-19T22:43:50.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:49 smithi113 bash[28910]: cluster 2024-04-19T22:43:48.351997+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-19T22:43:50.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:49 smithi178 bash[23441]: cluster 2024-04-19T22:43:48.351997+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-19T22:43:51.890 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:51 smithi178 bash[23441]: cluster 2024-04-19T22:43:50.352609+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:43:52.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:51 smithi113 bash[28910]: cluster 2024-04-19T22:43:50.352609+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:43:52.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:51 smithi113 bash[21528]: cluster 2024-04-19T22:43:50.352609+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:43:52.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 -- 172.21.15.178:0/2746054814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1701022f0 msgr2=0x7fb170102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:52.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 --2- 172.21.15.178:0/2746054814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1701022f0 0x7fb170102710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1640099c0 tx=0x7fb164009cd0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 -- 172.21.15.178:0/2746054814 shutdown_connections 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 --2- 172.21.15.178:0/2746054814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb170103e90 0x7fb17010a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 --2- 172.21.15.178:0/2746054814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1701022f0 0x7fb170102710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 --2- 172.21.15.178:0/2746054814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701034f0 0x7fb170103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 -- 172.21.15.178:0/2746054814 >> 172.21.15.178:0/2746054814 conn(0x7fb1700fd8b0 msgr2=0x7fb1700ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:43:52.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 -- 172.21.15.178:0/2746054814 shutdown_connections 2024-04-19T22:43:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.069+0000 7fb178696700 1 -- 172.21.15.178:0/2746054814 wait complete. 2024-04-19T22:43:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 Processor -- start 2024-04-19T22:43:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- start start 2024-04-19T22:43:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701022f0 0x7fb170197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1701034f0 0x7fb170198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb17010d670 con 0x7fb1701022f0 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb17010d4f0 con 0x7fb170103e90 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fb17010d7f0 con 0x7fb1701034f0 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:54830/0 (socket says 172.21.15.178:54830) 2024-04-19T22:43:52.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 -- 172.21.15.178:0/1664364890 learned_addr learned my addr 172.21.15.178:0/1664364890 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176432700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701022f0 0x7fb170197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 -- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1701034f0 msgr2=0x7fb170198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1701034f0 0x7fb170198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 -- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701022f0 msgr2=0x7fb170197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701022f0 0x7fb170197c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 -- 172.21.15.178:0/1664364890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17019f8a0 con 0x7fb170103e90 2024-04-19T22:43:52.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb176c33700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb168007ee0 tx=0x7fb16800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:43:52.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16800dbd0 con 0x7fb170103e90 2024-04-19T22:43:52.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb16800dd70 con 0x7fb170103e90 2024-04-19T22:43:52.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17019fb90 con 0x7fb170103e90 2024-04-19T22:43:52.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680059e0 con 0x7fb170103e90 2024-04-19T22:43:52.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1701a00d0 con 0x7fb170103e90 2024-04-19T22:43:52.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17004ff50 con 0x7fb170103e90 2024-04-19T22:43:52.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7fb16801a020 con 0x7fb170103e90 2024-04-19T22:43:52.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 --2- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 0x7fb15c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:43:52.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.073+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 3789+0+0 (secure 0 0 0) 0x7fb16808ce40 con 0x7fb170103e90 2024-04-19T22:43:52.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.077+0000 7fb176432700 1 --2- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 0x7fb15c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:43:52.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.077+0000 7fb176432700 1 --2- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 0x7fb15c070470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b580 tx=0x7fb164005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:43:52.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.081+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb168010070 con 0x7fb170103e90 2024-04-19T22:43:52.292 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:43:52.293+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb170062670 con 0x7fb15c06dfb0 2024-04-19T22:43:53.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[21528]: audit 2024-04-19T22:43:52.307651+0000 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:53.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[21528]: audit 2024-04-19T22:43:52.314051+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:53.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[21528]: audit 2024-04-19T22:43:52.315694+0000 mon.a (mon.0) 616 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:53.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[28910]: audit 2024-04-19T22:43:52.307651+0000 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:53.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[28910]: audit 2024-04-19T22:43:52.314051+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:53.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:52 smithi113 bash[28910]: audit 2024-04-19T22:43:52.315694+0000 mon.a (mon.0) 616 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:53.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:52 smithi178 bash[23441]: audit 2024-04-19T22:43:52.307651+0000 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-19T22:43:53.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:52 smithi178 bash[23441]: audit 2024-04-19T22:43:52.314051+0000 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-19T22:43:53.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:52 smithi178 bash[23441]: audit 2024-04-19T22:43:52.315694+0000 mon.a (mon.0) 616 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:43:54.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:53 smithi113 bash[21528]: audit 2024-04-19T22:43:52.300637+0000 mgr.y (mgr.14152) 298 : audit 0 from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:54.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:53 smithi113 bash[21528]: cluster 2024-04-19T22:43:52.353245+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:54.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:53 smithi113 bash[28910]: audit 2024-04-19T22:43:52.300637+0000 mgr.y (mgr.14152) 298 : audit 0 from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:54.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:53 smithi113 bash[28910]: cluster 2024-04-19T22:43:52.353245+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:54.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:53 smithi178 bash[23441]: audit 2024-04-19T22:43:52.300637+0000 mgr.y (mgr.14152) 298 : audit 0 from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:43:54.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:53 smithi178 bash[23441]: cluster 2024-04-19T22:43:52.353245+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:56.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:55 smithi113 bash[28910]: cluster 2024-04-19T22:43:54.353884+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:56.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:55 smithi113 bash[21528]: cluster 2024-04-19T22:43:54.353884+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:56.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:55 smithi178 bash[23441]: cluster 2024-04-19T22:43:54.353884+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:58.039 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:57 smithi178 bash[23441]: cluster 2024-04-19T22:43:56.354483+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:58.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:57 smithi113 bash[21528]: cluster 2024-04-19T22:43:56.354483+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:58.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:57 smithi113 bash[28910]: cluster 2024-04-19T22:43:56.354483+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:43:59.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:43:59 smithi178 bash[23441]: cluster 2024-04-19T22:43:58.355013+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:00.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:43:59 smithi113 bash[21528]: cluster 2024-04-19T22:43:58.355013+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:00.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:43:59 smithi113 bash[28910]: cluster 2024-04-19T22:43:58.355013+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:01.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[21528]: audit 2024-04-19T22:44:00.328059+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.178:0/871938607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[21528]: audit 2024-04-19T22:44:00.328782+0000 mon.a (mon.0) 617 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[21528]: audit 2024-04-19T22:44:00.332576+0000 mon.a (mon.0) 618 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]': finished 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[21528]: cluster 2024-04-19T22:44:00.339874+0000 mon.a (mon.0) 619 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[21528]: audit 2024-04-19T22:44:00.340542+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[28910]: audit 2024-04-19T22:44:00.328059+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.178:0/871938607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[28910]: audit 2024-04-19T22:44:00.328782+0000 mon.a (mon.0) 617 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[28910]: audit 2024-04-19T22:44:00.332576+0000 mon.a (mon.0) 618 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]': finished 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[28910]: cluster 2024-04-19T22:44:00.339874+0000 mon.a (mon.0) 619 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-04-19T22:44:01.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:00 smithi113 bash[28910]: audit 2024-04-19T22:44:00.340542+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:01.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:00 smithi178 bash[23441]: audit 2024-04-19T22:44:00.328059+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.178:0/871938607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:00 smithi178 bash[23441]: audit 2024-04-19T22:44:00.328782+0000 mon.a (mon.0) 617 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]: dispatch 2024-04-19T22:44:01.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:00 smithi178 bash[23441]: audit 2024-04-19T22:44:00.332576+0000 mon.a (mon.0) 618 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95319baf-3d59-43e3-820c-decd5a03bc92"}]': finished 2024-04-19T22:44:01.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:00 smithi178 bash[23441]: cluster 2024-04-19T22:44:00.339874+0000 mon.a (mon.0) 619 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-04-19T22:44:01.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:00 smithi178 bash[23441]: audit 2024-04-19T22:44:00.340542+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:02.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:01 smithi113 bash[21528]: cluster 2024-04-19T22:44:00.355502+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:02.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:01 smithi113 bash[21528]: audit 2024-04-19T22:44:01.030229+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.178:0/3802367941' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:44:02.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:01 smithi113 bash[28910]: cluster 2024-04-19T22:44:00.355502+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:02.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:01 smithi113 bash[28910]: audit 2024-04-19T22:44:01.030229+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.178:0/3802367941' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:44:02.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:01 smithi178 bash[23441]: cluster 2024-04-19T22:44:00.355502+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:02.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:01 smithi178 bash[23441]: audit 2024-04-19T22:44:01.030229+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.178:0/3802367941' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-19T22:44:03.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:03 smithi178 bash[23441]: cluster 2024-04-19T22:44:02.356085+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:04.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:03 smithi113 bash[21528]: cluster 2024-04-19T22:44:02.356085+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:04.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:03 smithi113 bash[28910]: cluster 2024-04-19T22:44:02.356085+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:06.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:05 smithi113 bash[21528]: cluster 2024-04-19T22:44:04.356649+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:06.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:05 smithi113 bash[28910]: cluster 2024-04-19T22:44:04.356649+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:06.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:05 smithi178 bash[23441]: cluster 2024-04-19T22:44:04.356649+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:08.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:07 smithi113 bash[21528]: cluster 2024-04-19T22:44:06.357196+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:08.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:07 smithi113 bash[28910]: cluster 2024-04-19T22:44:06.357196+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:08.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:07 smithi178 bash[23441]: cluster 2024-04-19T22:44:06.357196+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:10.019 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:09 smithi178 bash[23441]: cluster 2024-04-19T22:44:08.357776+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:10.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:09 smithi113 bash[21528]: cluster 2024-04-19T22:44:08.357776+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:10.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:09 smithi113 bash[28910]: cluster 2024-04-19T22:44:08.357776+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:11.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:11 smithi178 bash[23441]: cluster 2024-04-19T22:44:10.358451+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:12.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:11 smithi113 bash[21528]: cluster 2024-04-19T22:44:10.358451+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:12.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:11 smithi113 bash[28910]: cluster 2024-04-19T22:44:10.358451+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:13.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:12 smithi113 bash[21528]: audit 2024-04-19T22:44:12.625005+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-19T22:44:13.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:12 smithi113 bash[21528]: audit 2024-04-19T22:44:12.626892+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:13.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:12 smithi113 bash[28910]: audit 2024-04-19T22:44:12.625005+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-19T22:44:13.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:12 smithi113 bash[28910]: audit 2024-04-19T22:44:12.626892+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:13.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:12 smithi178 bash[23441]: audit 2024-04-19T22:44:12.625005+0000 mon.a (mon.0) 621 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-19T22:44:13.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:12 smithi178 bash[23441]: audit 2024-04-19T22:44:12.626892+0000 mon.a (mon.0) 622 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:13.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:13 smithi178 bash[23441]: cluster 2024-04-19T22:44:12.358961+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:13.919 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:13 smithi178 bash[23441]: cephadm 2024-04-19T22:44:12.628668+0000 mgr.y (mgr.14152) 310 : cephadm 1 Deploying daemon osd.7 on smithi178 2024-04-19T22:44:14.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:13 smithi113 bash[21528]: cluster 2024-04-19T22:44:12.358961+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:14.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:13 smithi113 bash[21528]: cephadm 2024-04-19T22:44:12.628668+0000 mgr.y (mgr.14152) 310 : cephadm 1 Deploying daemon osd.7 on smithi178 2024-04-19T22:44:14.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:13 smithi113 bash[28910]: cluster 2024-04-19T22:44:12.358961+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:14.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:13 smithi113 bash[28910]: cephadm 2024-04-19T22:44:12.628668+0000 mgr.y (mgr.14152) 310 : cephadm 1 Deploying daemon osd.7 on smithi178 2024-04-19T22:44:16.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:15 smithi113 bash[21528]: cluster 2024-04-19T22:44:14.359469+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:16.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:15 smithi113 bash[28910]: cluster 2024-04-19T22:44:14.359469+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:16.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:15 smithi178 bash[23441]: cluster 2024-04-19T22:44:14.359469+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:16.734 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:16.735 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:16.735 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:16.735 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:16.736 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:17.002 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:17.003 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:17.003 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:17.003 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:17.004 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:44:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:44:18.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:18 smithi178 bash[23441]: cluster 2024-04-19T22:44:16.360046+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:18.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:18 smithi178 bash[23441]: audit 2024-04-19T22:44:17.014407+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:18.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:18 smithi178 bash[23441]: audit 2024-04-19T22:44:17.015940+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:18.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:18 smithi178 bash[23441]: audit 2024-04-19T22:44:17.025338+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:18.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[21528]: cluster 2024-04-19T22:44:16.360046+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:18.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[21528]: audit 2024-04-19T22:44:17.014407+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:18.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[21528]: audit 2024-04-19T22:44:17.015940+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:18.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[21528]: audit 2024-04-19T22:44:17.025338+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:18.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[28910]: cluster 2024-04-19T22:44:16.360046+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:18.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[28910]: audit 2024-04-19T22:44:17.014407+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:18.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[28910]: audit 2024-04-19T22:44:17.015940+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:18.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:18 smithi113 bash[28910]: audit 2024-04-19T22:44:17.025338+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:20.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:20 smithi113 bash[21528]: cluster 2024-04-19T22:44:18.360598+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:20.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:20 smithi113 bash[28910]: cluster 2024-04-19T22:44:18.360598+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:20.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:20 smithi178 bash[23441]: cluster 2024-04-19T22:44:18.360598+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:22.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:22 smithi113 bash[21528]: cluster 2024-04-19T22:44:20.361196+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:22.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:22 smithi113 bash[28910]: cluster 2024-04-19T22:44:20.361196+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:22.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:22 smithi178 bash[23441]: cluster 2024-04-19T22:44:20.361196+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: cluster 2024-04-19T22:44:22.361749+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.168554+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.169322+0000 mon.a (mon.0) 626 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.814411+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.824536+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.826871+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:24.280 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.828822+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:24.280 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:24 smithi178 bash[23441]: audit 2024-04-19T22:44:23.839710+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: cluster 2024-04-19T22:44:22.361749+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:24.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.168554+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.169322+0000 mon.a (mon.0) 626 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.814411+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.824536+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.826871+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.828822+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[21528]: audit 2024-04-19T22:44:23.839710+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: cluster 2024-04-19T22:44:22.361749+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.168554+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.169322+0000 mon.a (mon.0) 626 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-19T22:44:24.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.814411+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.824536+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.826871+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.828822+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:24 smithi113 bash[28910]: audit 2024-04-19T22:44:23.839710+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:25.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:25 smithi178 bash[23441]: audit 2024-04-19T22:44:24.034797+0000 mon.a (mon.0) 632 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-19T22:44:25.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:25 smithi178 bash[23441]: audit 2024-04-19T22:44:24.040993+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:25.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:25 smithi178 bash[23441]: cluster 2024-04-19T22:44:24.041913+0000 mon.a (mon.0) 633 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-04-19T22:44:25.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:25 smithi178 bash[23441]: audit 2024-04-19T22:44:24.042711+0000 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:25.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:25 smithi178 bash[23441]: audit 2024-04-19T22:44:24.043753+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:25.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[21528]: audit 2024-04-19T22:44:24.034797+0000 mon.a (mon.0) 632 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-19T22:44:25.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[21528]: audit 2024-04-19T22:44:24.040993+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[21528]: cluster 2024-04-19T22:44:24.041913+0000 mon.a (mon.0) 633 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[21528]: audit 2024-04-19T22:44:24.042711+0000 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[21528]: audit 2024-04-19T22:44:24.043753+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[28910]: audit 2024-04-19T22:44:24.034797+0000 mon.a (mon.0) 632 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[28910]: audit 2024-04-19T22:44:24.040993+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v2:172.21.15.178:6812/1965706255' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[28910]: cluster 2024-04-19T22:44:24.041913+0000 mon.a (mon.0) 633 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[28910]: audit 2024-04-19T22:44:24.042711+0000 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:25.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:25 smithi113 bash[28910]: audit 2024-04-19T22:44:24.043753+0000 mon.a (mon.0) 635 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-04-19T22:44:26.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:26 smithi178 bash[23441]: cluster 2024-04-19T22:44:24.362454+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:26.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:26 smithi178 bash[23441]: audit 2024-04-19T22:44:25.046539+0000 mon.a (mon.0) 636 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:44:26.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:26 smithi178 bash[23441]: cluster 2024-04-19T22:44:25.058750+0000 mon.a (mon.0) 637 : cluster 0 osdmap e54: 8 total, 7 up, 8 in 2024-04-19T22:44:26.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:26 smithi178 bash[23441]: audit 2024-04-19T22:44:25.059423+0000 mon.a (mon.0) 638 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:26.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:26 smithi178 bash[23441]: audit 2024-04-19T22:44:25.375578+0000 mon.a (mon.0) 639 : audit 1 from='osd.7 ' entity='osd.7' 2024-04-19T22:44:26.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[21528]: cluster 2024-04-19T22:44:24.362454+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[21528]: audit 2024-04-19T22:44:25.046539+0000 mon.a (mon.0) 636 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[21528]: cluster 2024-04-19T22:44:25.058750+0000 mon.a (mon.0) 637 : cluster 0 osdmap e54: 8 total, 7 up, 8 in 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[21528]: audit 2024-04-19T22:44:25.059423+0000 mon.a (mon.0) 638 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[21528]: audit 2024-04-19T22:44:25.375578+0000 mon.a (mon.0) 639 : audit 1 from='osd.7 ' entity='osd.7' 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[28910]: cluster 2024-04-19T22:44:24.362454+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[28910]: audit 2024-04-19T22:44:25.046539+0000 mon.a (mon.0) 636 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[28910]: cluster 2024-04-19T22:44:25.058750+0000 mon.a (mon.0) 637 : cluster 0 osdmap e54: 8 total, 7 up, 8 in 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[28910]: audit 2024-04-19T22:44:25.059423+0000 mon.a (mon.0) 638 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:26 smithi113 bash[28910]: audit 2024-04-19T22:44:25.375578+0000 mon.a (mon.0) 639 : audit 1 from='osd.7 ' entity='osd.7' 2024-04-19T22:44:27.179 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb1637fe700 1 -- 172.21.15.178:0/1664364890 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb170062670 con 0x7fb15c06dfb0 2024-04-19T22:44:27.179 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 7 on host 'smithi178' 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 msgr2=0x7fb15c070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 0x7fb15c070470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b580 tx=0x7fb164005fb0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 msgr2=0x7fb17019f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb168007ee0 tx=0x7fb16800d3b0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 shutdown_connections 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> v2:172.21.15.113:6800/467518466 conn(0x7fb15c06dfb0 0x7fb15c070470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb170103e90 0x7fb17019f1d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1701022f0 0x7fb170197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 --2- 172.21.15.178:0/1664364890 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1701034f0 0x7fb170198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:27.182 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 >> 172.21.15.178:0/1664364890 conn(0x7fb1700fd8b0 msgr2=0x7fb1701067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:27.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 shutdown_connections 2024-04-19T22:44:27.183 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:44:27.181+0000 7fb178696700 1 -- 172.21.15.178:0/1664364890 wait complete. 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: cluster 2024-04-19T22:44:24.151749+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: cluster 2024-04-19T22:44:24.151911+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: cluster 2024-04-19T22:44:26.057237+0000 mon.a (mon.0) 640 : cluster 1 osd.7 v2:172.21.15.178:6812/1965706255 boot 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: cluster 2024-04-19T22:44:26.057362+0000 mon.a (mon.0) 641 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: audit 2024-04-19T22:44:26.058165+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:27.384 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:27 smithi178 bash[23441]: cluster 2024-04-19T22:44:27.059821+0000 mon.a (mon.0) 643 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-04-19T22:44:27.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: cluster 2024-04-19T22:44:24.151749+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: cluster 2024-04-19T22:44:24.151911+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: cluster 2024-04-19T22:44:26.057237+0000 mon.a (mon.0) 640 : cluster 1 osd.7 v2:172.21.15.178:6812/1965706255 boot 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: cluster 2024-04-19T22:44:26.057362+0000 mon.a (mon.0) 641 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: audit 2024-04-19T22:44:26.058165+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[21528]: cluster 2024-04-19T22:44:27.059821+0000 mon.a (mon.0) 643 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: cluster 2024-04-19T22:44:24.151749+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: cluster 2024-04-19T22:44:24.151911+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: cluster 2024-04-19T22:44:26.057237+0000 mon.a (mon.0) 640 : cluster 1 osd.7 v2:172.21.15.178:6812/1965706255 boot 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: cluster 2024-04-19T22:44:26.057362+0000 mon.a (mon.0) 641 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: audit 2024-04-19T22:44:26.058165+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:44:27.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:27 smithi113 bash[28910]: cluster 2024-04-19T22:44:27.059821+0000 mon.a (mon.0) 643 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-04-19T22:44:27.833 DEBUG:teuthology.orchestra.run.smithi178:osd.7> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.7.service 2024-04-19T22:44:27.836 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-04-19T22:44:27.836 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd stat -f json 2024-04-19T22:44:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[21528]: cluster 2024-04-19T22:44:26.362995+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[21528]: audit 2024-04-19T22:44:27.135462+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[21528]: audit 2024-04-19T22:44:27.144972+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[21528]: audit 2024-04-19T22:44:27.156932+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[21528]: cluster 2024-04-19T22:44:28.057054+0000 mon.a (mon.0) 647 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-04-19T22:44:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[28910]: cluster 2024-04-19T22:44:26.362995+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[28910]: audit 2024-04-19T22:44:27.135462+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[28910]: audit 2024-04-19T22:44:27.144972+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[28910]: audit 2024-04-19T22:44:27.156932+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:28 smithi113 bash[28910]: cluster 2024-04-19T22:44:28.057054+0000 mon.a (mon.0) 647 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-04-19T22:44:28.299 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:28 smithi178 bash[23441]: cluster 2024-04-19T22:44:26.362995+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-04-19T22:44:28.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:28 smithi178 bash[23441]: audit 2024-04-19T22:44:27.135462+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:44:28.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:28 smithi178 bash[23441]: audit 2024-04-19T22:44:27.144972+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:28 smithi178 bash[23441]: audit 2024-04-19T22:44:27.156932+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:28.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:28 smithi178 bash[23441]: cluster 2024-04-19T22:44:28.057054+0000 mon.a (mon.0) 647 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-04-19T22:44:29.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:29 smithi113 bash[21528]: cluster 2024-04-19T22:44:28.363536+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:29.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:29 smithi113 bash[21528]: cluster 2024-04-19T22:44:28.390832+0000 mon.a (mon.0) 648 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-04-19T22:44:29.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:29 smithi113 bash[28910]: cluster 2024-04-19T22:44:28.363536+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:29.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:29 smithi113 bash[28910]: cluster 2024-04-19T22:44:28.390832+0000 mon.a (mon.0) 648 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-04-19T22:44:29.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:29 smithi178 bash[23441]: cluster 2024-04-19T22:44:28.363536+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:29.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:29 smithi178 bash[23441]: cluster 2024-04-19T22:44:28.390832+0000 mon.a (mon.0) 648 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-04-19T22:44:30.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:30 smithi113 bash[21528]: cluster 2024-04-19T22:44:29.407049+0000 mon.a (mon.0) 649 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-04-19T22:44:30.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:30 smithi113 bash[28910]: cluster 2024-04-19T22:44:29.407049+0000 mon.a (mon.0) 649 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-04-19T22:44:30.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:30 smithi178 bash[23441]: cluster 2024-04-19T22:44:29.407049+0000 mon.a (mon.0) 649 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-04-19T22:44:31.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:31 smithi113 bash[21528]: cluster 2024-04-19T22:44:30.364105+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:31.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:31 smithi113 bash[28910]: cluster 2024-04-19T22:44:30.364105+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:31.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:31 smithi178 bash[23441]: cluster 2024-04-19T22:44:30.364105+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:32.595 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:44:33.768 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:33 smithi178 bash[23441]: cluster 2024-04-19T22:44:32.364826+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-19T22:44:33.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:33 smithi113 bash[21528]: cluster 2024-04-19T22:44:32.364826+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-19T22:44:33.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:33 smithi113 bash[28910]: cluster 2024-04-19T22:44:32.364826+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-19T22:44:35.683 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:35 smithi178 bash[23441]: cluster 2024-04-19T22:44:34.365500+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-19T22:44:35.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:35 smithi113 bash[21528]: cluster 2024-04-19T22:44:34.365500+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-19T22:44:35.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:35 smithi113 bash[28910]: cluster 2024-04-19T22:44:34.365500+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-19T22:44:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- 172.21.15.113:0/3254651448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc103e90 msgr2=0x7fb1fc10a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- 172.21.15.113:0/3254651448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc103e90 0x7fb1fc10a740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400b0d0 tx=0x7fb1f400b3e0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- 172.21.15.113:0/3254651448 shutdown_connections 2024-04-19T22:44:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- 172.21.15.113:0/3254651448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc103e90 0x7fb1fc10a740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- 172.21.15.113:0/3254651448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- 172.21.15.113:0/3254651448 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc1034f0 0x7fb1fc103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- 172.21.15.113:0/3254651448 >> 172.21.15.113:0/3254651448 conn(0x7fb1fc0fd8b0 msgr2=0x7fb1fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- 172.21.15.113:0/3254651448 shutdown_connections 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- 172.21.15.113:0/3254651448 wait complete. 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 Processor -- start 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- start start 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1034f0 0x7fb1fc198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc10d670 con 0x7fb1fc1022f0 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc10d4f0 con 0x7fb1fc1034f0 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb201313700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fb1fc10d7f0 con 0x7fb1fc103e90 2024-04-19T22:44:36.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:39912/0 (socket says 172.21.15.113:39912) 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb1fb7fe700 1 -- 172.21.15.113:0/3718916551 learned_addr learned my addr 172.21.15.113:0/3718916551 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.128+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37938/0 (socket says 172.21.15.113:37938) 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fa7fc700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1034f0 0x7fb1fc198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 -- 172.21.15.113:0/3718916551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1034f0 msgr2=0x7fb1fc198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1034f0 0x7fb1fc198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 -- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 msgr2=0x7fb1fc197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 -- 172.21.15.113:0/3718916551 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1fc19f820 con 0x7fb1fc103e90 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1faffd700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:44:36.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1fb7fe700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400d010 tx=0x7fb1f4004cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4021020 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb1f4007b80 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1fc19fab0 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4005350 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1fc19ffb0 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1fc04ff50 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7fb1f4024020 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 --2- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 0x7fb1e4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1faffd700 1 --2- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 0x7fb1e4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 4081+0+0 (secure 0 0 0) 0x7fb1f400f020 con 0x7fb1fc103e90 2024-04-19T22:44:36.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.132+0000 7fb1faffd700 1 --2- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 0x7fb1e4070470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc103350 tx=0x7fb1f000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:36.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.136+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb1f40253b0 con 0x7fb1fc103e90 2024-04-19T22:44:36.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.356+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb1fc02df50 con 0x7fb1fc103e90 2024-04-19T22:44:36.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb1e3fff700 1 -- 172.21.15.113:0/3718916551 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v59) ==== 74+0+130 (secure 0 0 0) 0x7fb1f405d460 con 0x7fb1fc103e90 2024-04-19T22:44:36.356 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:44:36.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 msgr2=0x7fb1e4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:36.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 0x7fb1e4070470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc103350 tx=0x7fb1f000a380 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 msgr2=0x7fb1fc19f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400d010 tx=0x7fb1f4004cd0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 shutdown_connections 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> v2:172.21.15.113:6800/467518466 conn(0x7fb1e406dfb0 0x7fb1e4070470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb1fc103e90 0x7fb1fc19f180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1fc1022f0 0x7fb1fc197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 --2- 172.21.15.113:0/3718916551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1fc1034f0 0x7fb1fc198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 >> 172.21.15.113:0/3718916551 conn(0x7fb1fc0fd8b0 msgr2=0x7fb1fc106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 shutdown_connections 2024-04-19T22:44:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:36.360+0000 7fb201313700 1 -- 172.21.15.113:0/3718916551 wait complete. 2024-04-19T22:44:37.208 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1713566666,"num_in_osds":8,"osd_in_since":1713566640,"num_remapped_pgs":0} 2024-04-19T22:44:37.209 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: cephadm 2024-04-19T22:44:36.181270+0000 mgr.y (mgr.14152) 322 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.188277+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.194521+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.195860+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.196904+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.198021+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.199078+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: cephadm 2024-04-19T22:44:36.199894+0000 mgr.y (mgr.14152) 323 : cephadm 1 Adjusting osd_memory_target on smithi178 to 4316M 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.205177+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.208981+0000 mon.a (mon.0) 657 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:37.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.210539+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.219619+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[21528]: audit 2024-04-19T22:44:36.362349+0000 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.113:0/3718916551' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: cephadm 2024-04-19T22:44:36.181270+0000 mgr.y (mgr.14152) 322 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.188277+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.194521+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.195860+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.196904+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.198021+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.199078+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: cephadm 2024-04-19T22:44:36.199894+0000 mgr.y (mgr.14152) 323 : cephadm 1 Adjusting osd_memory_target on smithi178 to 4316M 2024-04-19T22:44:37.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.205177+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.208981+0000 mon.a (mon.0) 657 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:37.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.210539+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:37.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.219619+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:37 smithi113 bash[28910]: audit 2024-04-19T22:44:36.362349+0000 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.113:0/3718916551' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: cephadm 2024-04-19T22:44:36.181270+0000 mgr.y (mgr.14152) 322 : cephadm 1 Detected new or changed devices on smithi178 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.188277+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.194521+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.195860+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.196904+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.198021+0000 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.199078+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: cephadm 2024-04-19T22:44:36.199894+0000 mgr.y (mgr.14152) 323 : cephadm 1 Adjusting osd_memory_target on smithi178 to 4316M 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.205177+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.208981+0000 mon.a (mon.0) 657 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:44:37.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.210539+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:44:37.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.219619+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:44:37.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:37 smithi178 bash[23441]: audit 2024-04-19T22:44:36.362349+0000 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.113:0/3718916551' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-19T22:44:38.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:38 smithi113 bash[21528]: cluster 2024-04-19T22:44:36.365872+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:44:38.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:38 smithi113 bash[28910]: cluster 2024-04-19T22:44:36.365872+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:44:38.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:38 smithi178 bash[23441]: cluster 2024-04-19T22:44:36.365872+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-19T22:44:40.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:40 smithi113 bash[21528]: cluster 2024-04-19T22:44:38.366453+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-19T22:44:40.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:40 smithi113 bash[28910]: cluster 2024-04-19T22:44:38.366453+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-19T22:44:40.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:40 smithi178 bash[23441]: cluster 2024-04-19T22:44:38.366453+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-19T22:44:41.964 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:44:42.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:42 smithi113 bash[21528]: cluster 2024-04-19T22:44:40.367061+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-04-19T22:44:42.293 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:42 smithi113 bash[28910]: cluster 2024-04-19T22:44:40.367061+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-04-19T22:44:42.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:42 smithi178 bash[23441]: cluster 2024-04-19T22:44:40.367061+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-04-19T22:44:44.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:44 smithi113 bash[21528]: cluster 2024-04-19T22:44:42.367699+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:44:44.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:44 smithi113 bash[28910]: cluster 2024-04-19T22:44:42.367699+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:44:44.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:44 smithi178 bash[23441]: cluster 2024-04-19T22:44:42.367699+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- 172.21.15.113:0/2431336229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc2581023b0 msgr2=0x7fc258102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- 172.21.15.113:0/2431336229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc2581023b0 0x7fc258102830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2400098f0 tx=0x7fc240009c00 comp rx=0 tx=0).stop 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- 172.21.15.113:0/2431336229 shutdown_connections 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- 172.21.15.113:0/2431336229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258102d70 0x7fc25810f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- 172.21.15.113:0/2431336229 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc258108350 0x7fc258108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- 172.21.15.113:0/2431336229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc2581023b0 0x7fc258102830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- 172.21.15.113:0/2431336229 >> 172.21.15.113:0/2431336229 conn(0x7fc258079390 msgr2=0x7fc2580797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- 172.21.15.113:0/2431336229 shutdown_connections 2024-04-19T22:44:45.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- 172.21.15.113:0/2431336229 wait complete. 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 Processor -- start 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- start start 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 0x7fc258198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258108350 0x7fc25819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc258111cb0 con 0x7fc2581023b0 2024-04-19T22:44:45.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc258111b30 con 0x7fc258108350 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc25e427700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fc258111e30 con 0x7fc258102d70 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc2577fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:34860/0 (socket says 172.21.15.113:34860) 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc257fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 0x7fc258198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.115+0000 7fc2577fe700 1 -- 172.21.15.113:0/3507183359 learned_addr learned my addr 172.21.15.113:0/3507183359 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc25c9c4700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258108350 0x7fc25819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 -- 172.21.15.113:0/3507183359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258108350 msgr2=0x7fc25819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258108350 0x7fc25819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 -- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 msgr2=0x7fc258198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 0x7fc258198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 -- 172.21.15.113:0/3507183359 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25819d100 con 0x7fc258102d70 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc257fff700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 0x7fc258198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2577fe700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc240009230 tx=0x7fc240005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:45.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240005260 con 0x7fc258102d70 2024-04-19T22:44:45.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25819d390 con 0x7fc258102d70 2024-04-19T22:44:45.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc24000ba10 con 0x7fc258102d70 2024-04-19T22:44:45.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240003c10 con 0x7fc258102d70 2024-04-19T22:44:45.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2581a4c70 con 0x7fc258102d70 2024-04-19T22:44:45.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258103990 con 0x7fc258102d70 2024-04-19T22:44:45.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7fc24000b560 con 0x7fc258102d70 2024-04-19T22:44:45.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 --2- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 0x7fc244070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:45.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 4081+0+0 (secure 0 0 0) 0x7fc24008e930 con 0x7fc258102d70 2024-04-19T22:44:45.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc257fff700 1 --2- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 0x7fc244070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:45.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.119+0000 7fc257fff700 1 --2- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 0x7fc244070470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc250009750 tx=0x7fc250009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:45.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.123+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc240013030 con 0x7fc258102d70 2024-04-19T22:44:45.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.335+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc258199450 con 0x7fc258102d70 2024-04-19T22:44:45.336 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc2557fa700 1 -- 172.21.15.113:0/3507183359 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+11545 (secure 0 0 0) 0x7fc24005ca30 con 0x7fc258102d70 2024-04-19T22:44:45.337 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:44:45.337 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":59,"fsid":"dd3df874-fe9c-11ee-bc92-c7b262605968","created":"2024-04-19T22:34:47.152859+0000","modified":"2024-04-19T22:44:29.385658+0000","last_up_change":"2024-04-19T22:44:26.046461+0000","last_in_change":"2024-04-19T22:44:00.330026+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T22:40:10.861972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf68f079-0f8d-4dca-8791-8e3fe35c1d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":947963826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":947963826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":947963826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6803","nonce":947963826}]},"public_addr":"172.21.15.113:6801/947963826","cluster_addr":"172.21.15.113:6802/947963826","heartbeat_back_addr":"172.21.15.113:6804/947963826","heartbeat_front_addr":"172.21.15.113:6803/947963826","state":["exists","up"]},{"osd":1,"uuid":"88cfae52-7613-4c00-91bc-ffb48af3915d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3290228916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3290228916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":3290228916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6807","nonce":3290228916}]},"public_addr":"172.21.15.113:6805/3290228916","cluster_addr":"172.21.15.113:6806/3290228916","heartbeat_back_addr":"172.21.15.113:6808/3290228916","heartbeat_front_addr":"172.21.15.113:6807/3290228916","state":["exists","up"]},{"osd":2,"uuid":"2cb5d205-e57e-41c2-ad9d-1963cd39ad8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":2132568950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":2132568950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2132568950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":2132568950}]},"public_addr":"172.21.15.113:6809/2132568950","cluster_addr":"172.21.15.113:6810/2132568950","heartbeat_back_addr":"172.21.15.113:6812/2132568950","heartbeat_front_addr":"172.21.15.113:6811/2132568950","state":["exists","up"]},{"osd":3,"uuid":"f37fb43e-3da1-49da-a486-e4e4ec9328fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":1760998485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1760998485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1760998485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":1760998485}]},"public_addr":"172.21.15.113:6813/1760998485","cluster_addr":"172.21.15.113:6814/1760998485","heartbeat_back_addr":"172.21.15.113:6816/1760998485","heartbeat_front_addr":"172.21.15.113:6815/1760998485","state":["exists","up"]},{"osd":4,"uuid":"fb1d832c-ddaf-4a8e-943f-b6af469c3102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2100817193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6801","nonce":2100817193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2100817193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2100817193}]},"public_addr":"172.21.15.178:6800/2100817193","cluster_addr":"172.21.15.178:6801/2100817193","heartbeat_back_addr":"172.21.15.178:6803/2100817193","heartbeat_front_addr":"172.21.15.178:6802/2100817193","state":["exists","up"]},{"osd":5,"uuid":"1cb4fd11-e8ba-4531-8f77-cad3a865b53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2719719766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2719719766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2719719766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2719719766}]},"public_addr":"172.21.15.178:6804/2719719766","cluster_addr":"172.21.15.178:6805/2719719766","heartbeat_back_addr":"172.21.15.178:6807/2719719766","heartbeat_front_addr":"172.21.15.178:6806/2719719766","state":["exists","up"]},{"osd":6,"uuid":"4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2545851179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2545851179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2545851179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":2545851179}]},"public_addr":"172.21.15.178:6808/2545851179","cluster_addr":"172.21.15.178:6809/2545851179","heartbeat_back_addr":"172.21.15.178:6811/2545851179","heartbeat_front_addr":"172.21.15.178:6810/2545851179","state":["exists","up"]},{"osd":7,"uuid":"95319baf-3d59-43e3-820c-decd5a03bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1965706255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":1965706255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":1965706255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1965706255}]},"public_addr":"172.21.15.178:6812/1965706255","cluster_addr":"172.21.15.178:6813/1965706255","heartbeat_back_addr":"172.21.15.178:6815/1965706255","heartbeat_front_addr":"172.21.15.178:6814/1965706255","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:38:20.395451+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:39:13.872631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:40:06.914513+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:01.835109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:52.051583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:42:42.788939+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:43:32.712514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:44:24.151921+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:6800/2227053540":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/3152323235":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/1796898942":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/2646177015":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3413585980":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/138586898":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3535526494":"2024-04-20T22:35:54.228397+0000","172.21.15.113:6800/2885784740":"2024-04-20T22:35:19.772443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T22:44:45.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 msgr2=0x7fc244070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 0x7fc244070470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc250009750 tx=0x7fc250009310 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 msgr2=0x7fc258198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc240009230 tx=0x7fc240005040 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 shutdown_connections 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> v2:172.21.15.113:6800/467518466 conn(0x7fc24406dfb0 0x7fc244070470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258108350 0x7fc25819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc2581023b0 0x7fc258198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 --2- 172.21.15.113:0/3507183359 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc258102d70 0x7fc258198680 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 >> 172.21.15.113:0/3507183359 conn(0x7fc258079390 msgr2=0x7fc258105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 shutdown_connections 2024-04-19T22:44:45.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:45.339+0000 7fc25e427700 1 -- 172.21.15.113:0/3507183359 wait complete. 2024-04-19T22:44:46.175 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T22:40:10.861972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T22:44:46.176 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-19T22:44:46.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:46 smithi113 bash[21528]: cluster 2024-04-19T22:44:44.368313+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:46.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:46 smithi113 bash[21528]: audit 2024-04-19T22:44:45.342079+0000 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.113:0/3507183359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:44:46.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:46 smithi113 bash[28910]: cluster 2024-04-19T22:44:44.368313+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:46.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:46 smithi113 bash[28910]: audit 2024-04-19T22:44:45.342079+0000 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.113:0/3507183359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:44:46.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:46 smithi178 bash[23441]: cluster 2024-04-19T22:44:44.368313+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:46.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:46 smithi178 bash[23441]: audit 2024-04-19T22:44:45.342079+0000 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.113:0/3507183359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:44:48.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:48 smithi113 bash[21528]: cluster 2024-04-19T22:44:46.368738+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:48.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:48 smithi113 bash[28910]: cluster 2024-04-19T22:44:46.368738+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:48.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:48 smithi178 bash[23441]: cluster 2024-04-19T22:44:46.368738+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:50.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:50 smithi113 bash[21528]: cluster 2024-04-19T22:44:48.369293+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:50.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:50 smithi113 bash[28910]: cluster 2024-04-19T22:44:48.369293+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:50.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:50 smithi178 bash[23441]: cluster 2024-04-19T22:44:48.369293+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:50.939 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:44:52.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:52 smithi113 bash[21528]: cluster 2024-04-19T22:44:50.369893+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:52.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:52 smithi113 bash[28910]: cluster 2024-04-19T22:44:50.369893+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:52.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:52 smithi178 bash[23441]: cluster 2024-04-19T22:44:50.369893+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:53.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/2141481764 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c1023b0 msgr2=0x7fb91c102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:53.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- 172.21.15.113:0/2141481764 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c1023b0 0x7fb91c102830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098f0 tx=0x7fb90c009c00 comp rx=0 tx=0).stop 2024-04-19T22:44:53.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/2141481764 shutdown_connections 2024-04-19T22:44:53.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- 172.21.15.113:0/2141481764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c102d70 0x7fb91c10f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- 172.21.15.113:0/2141481764 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- 172.21.15.113:0/2141481764 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c1023b0 0x7fb91c102830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/2141481764 >> 172.21.15.113:0/2141481764 conn(0x7fb91c079390 msgr2=0x7fb91c0797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/2141481764 shutdown_connections 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/2141481764 wait complete. 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 Processor -- start 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- start start 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c1023b0 0x7fb91c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c111c60 con 0x7fb91c108350 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c111ae0 con 0x7fb91c1023b0 2024-04-19T22:44:53.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c111de0 con 0x7fb91c102d70 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:35238/0 (socket says 172.21.15.113:35238) 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 -- 172.21.15.113:0/3663510229 learned_addr learned my addr 172.21.15.113:0/3663510229 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52338/0 (socket says 172.21.15.113:52338) 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91b7fe700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c1023b0 0x7fb91c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 -- 172.21.15.113:0/3663510229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c1023b0 msgr2=0x7fb91c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c1023b0 0x7fb91c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 -- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 msgr2=0x7fb91c19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 -- 172.21.15.113:0/3663510229 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c19d0e0 con 0x7fb91c102d70 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91bfff700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb91affd700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00fb40 tx=0x7fb90c00fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:53.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c027070 con 0x7fb91c102d70 2024-04-19T22:44:53.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c19d370 con 0x7fb91c102d70 2024-04-19T22:44:53.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fb90c00b560 con 0x7fb91c102d70 2024-04-19T22:44:53.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004ac0 con 0x7fb91c102d70 2024-04-19T22:44:53.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.903+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c1a4c50 con 0x7fb91c102d70 2024-04-19T22:44:53.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91c103990 con 0x7fb91c102d70 2024-04-19T22:44:53.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7fb90c02a070 con 0x7fb91c102d70 2024-04-19T22:44:53.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb918ff9700 1 --2- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 0x7fb8fc070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:44:53.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb91b7fe700 1 --2- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 0x7fb8fc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:44:53.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(59..59 src has 1..59) ==== 4081+0+0 (secure 0 0 0) 0x7fb90c08e2e0 con 0x7fb91c102d70 2024-04-19T22:44:53.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.907+0000 7fb91b7fe700 1 --2- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 0x7fb8fc070470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb904009fd0 tx=0x7fb90400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:44:53.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:53.911+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb90c013030 con 0x7fb91c102d70 2024-04-19T22:44:54.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.111+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb91c199430 con 0x7fb91c102d70 2024-04-19T22:44:54.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb918ff9700 1 -- 172.21.15.113:0/3663510229 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7fb90c05c500 con 0x7fb91c102d70 2024-04-19T22:44:54.113 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 msgr2=0x7fb8fc070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 0x7fb8fc070470 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb904009fd0 tx=0x7fb90400b040 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 msgr2=0x7fb91c198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00fb40 tx=0x7fb90c00fb70 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 shutdown_connections 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> v2:172.21.15.113:6800/467518466 conn(0x7fb8fc06dfb0 0x7fb8fc070470 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb91c108350 0x7fb91c19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb91c1023b0 0x7fb91c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 --2- 172.21.15.113:0/3663510229 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb91c102d70 0x7fb91c198660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:44:54.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 >> 172.21.15.113:0/3663510229 conn(0x7fb91c079390 msgr2=0x7fb91c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:44:54.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 shutdown_connections 2024-04-19T22:44:54.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:44:54.115+0000 7fb922011700 1 -- 172.21.15.113:0/3663510229 wait complete. 2024-04-19T22:44:54.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:54 smithi113 bash[21528]: cluster 2024-04-19T22:44:52.370539+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:54.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:54 smithi113 bash[21528]: audit 2024-04-19T22:44:54.118713+0000 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.113:0/3663510229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-19T22:44:54.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:54 smithi113 bash[28910]: cluster 2024-04-19T22:44:52.370539+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:54.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:54 smithi113 bash[28910]: audit 2024-04-19T22:44:54.118713+0000 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.113:0/3663510229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-19T22:44:54.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:54 smithi178 bash[23441]: cluster 2024-04-19T22:44:52.370539+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:54.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:54 smithi178 bash[23441]: audit 2024-04-19T22:44:54.118713+0000 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.113:0/3663510229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-19T22:44:54.935 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi113 2024-04-19T22:44:54.936 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi113=foo.a' 2024-04-19T22:44:56.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:56 smithi113 bash[21528]: cluster 2024-04-19T22:44:54.371055+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:56.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:56 smithi113 bash[28910]: cluster 2024-04-19T22:44:54.371055+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:56.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:56 smithi178 bash[23441]: cluster 2024-04-19T22:44:54.371055+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:58.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:44:58 smithi113 bash[21528]: cluster 2024-04-19T22:44:56.371932+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:58.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:44:58 smithi113 bash[28910]: cluster 2024-04-19T22:44:56.371932+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:58.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:44:58 smithi178 bash[23441]: cluster 2024-04-19T22:44:56.371932+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:44:59.689 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:00.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:00 smithi113 bash[21528]: cluster 2024-04-19T22:44:58.372532+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:00.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:00 smithi113 bash[28910]: cluster 2024-04-19T22:44:58.372532+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:00.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:00 smithi178 bash[23441]: cluster 2024-04-19T22:44:58.372532+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:02.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 -- 172.21.15.178:0/932874129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c102d80 msgr2=0x7f463c105170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:02.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 --2- 172.21.15.178:0/932874129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c102d80 0x7f463c105170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4630009990 tx=0x7f4630009ca0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 -- 172.21.15.178:0/932874129 shutdown_connections 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 --2- 172.21.15.178:0/932874129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c107fe0 0x7f463c10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 --2- 172.21.15.178:0/932874129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c102d80 0x7f463c105170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.073+0000 7f46440fa700 1 --2- 172.21.15.178:0/932874129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c1056b0 0x7f463c107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/932874129 >> 172.21.15.178:0/932874129 conn(0x7f463c0fc790 msgr2=0x7f463c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/932874129 shutdown_connections 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/932874129 wait complete. 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 Processor -- start 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- start start 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c102d80 0x7f463c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 0x7f463c101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10d5d0 con 0x7f463c102d80 2024-04-19T22:45:02.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10d450 con 0x7f463c1056b0 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f463c10d750 con 0x7f463c107fe0 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41088/0 (socket says 172.21.15.178:41088) 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 -- 172.21.15.178:0/2207283205 learned_addr learned my addr 172.21.15.178:0/2207283205 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641e96700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c102d80 0x7f463c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:02.077 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4642697700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 0x7f463c101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:02.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 -- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 msgr2=0x7f463c101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:02.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 0x7f463c101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 -- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c102d80 msgr2=0x7f463c1026e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c102d80 0x7f463c1026e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 -- 172.21.15.178:0/2207283205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c101b20 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4642697700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 0x7f463c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f4641695700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4638007e20 tx=0x7f463800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638016020 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f463800ad40 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46380115e0 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463c1a1d10 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463c1a21c0 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463c04ff50 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.077+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f4638019020 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.081+0000 7f462effd700 1 --2- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 0x7f4628070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.081+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4081+0+0 (secure 0 0 0) 0x7f463808d560 con 0x7f463c1056b0 2024-04-19T22:45:02.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.081+0000 7f4641e96700 1 --2- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 0x7f4628070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:02.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.081+0000 7f4641e96700 1 --2- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 0x7f4628070470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f463000b5c0 tx=0x7f4630003840 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:02.083 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.085+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f463805b660 con 0x7f463c1056b0 2024-04-19T22:45:02.300 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.301+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi113=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f463c109b60 con 0x7f462806dfb0 2024-04-19T22:45:02.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f462effd700 1 -- 172.21.15.178:0/2207283205 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f463c109b60 con 0x7f462806dfb0 2024-04-19T22:45:02.315 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled rgw.foo.a update... 2024-04-19T22:45:02.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 msgr2=0x7f4628070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:02.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 0x7f4628070470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f463000b5c0 tx=0x7f4630003840 comp rx=0 tx=0).stop 2024-04-19T22:45:02.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 msgr2=0x7f463c100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:02.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4638007e20 tx=0x7f463800a340 comp rx=0 tx=0).stop 2024-04-19T22:45:02.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 shutdown_connections 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> v2:172.21.15.113:6800/467518466 conn(0x7f462806dfb0 0x7f4628070470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f463c107fe0 0x7f463c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f463c102d80 0x7f463c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 --2- 172.21.15.178:0/2207283205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f463c1056b0 0x7f463c100d30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 >> 172.21.15.178:0/2207283205 conn(0x7f463c0fc790 msgr2=0x7f463c108440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 shutdown_connections 2024-04-19T22:45:02.318 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:02.317+0000 7f46440fa700 1 -- 172.21.15.178:0/2207283205 wait complete. 2024-04-19T22:45:02.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:02 smithi113 bash[21528]: cluster 2024-04-19T22:45:00.373059+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:02.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:02 smithi113 bash[28910]: cluster 2024-04-19T22:45:00.373059+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:02.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:02 smithi178 bash[23441]: cluster 2024-04-19T22:45:00.373059+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:02.887 DEBUG:teuthology.orchestra.run.smithi113:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@rgw.foo.a.service 2024-04-19T22:45:02.890 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi178 2024-04-19T22:45:02.890 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.308198+0000 mgr.y (mgr.14152) 337 : audit 0 from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi113=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.319726+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.323294+0000 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.951541+0000 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.953332+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.962873+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.968367+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.973472+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.986842+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[21528]: audit 2024-04-19T22:45:02.991216+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.308198+0000 mgr.y (mgr.14152) 337 : audit 0 from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi113=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.319726+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.323294+0000 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.951541+0000 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.953332+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.962873+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.968367+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.973472+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.986842+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:03 smithi113 bash[28910]: audit 2024-04-19T22:45:02.991216+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.308198+0000 mgr.y (mgr.14152) 337 : audit 0 from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi113=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.319726+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.323294+0000 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.951541+0000 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.953332+0000 mon.a (mon.0) 663 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.962873+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.968367+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-04-19T22:45:03.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.973472+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-04-19T22:45:03.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.986842+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:03.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:03 smithi178 bash[23441]: audit 2024-04-19T22:45:02.991216+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[21528]: cephadm 2024-04-19T22:45:02.312459+0000 mgr.y (mgr.14152) 338 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[21528]: cluster 2024-04-19T22:45:02.373624+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:04.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[21528]: cephadm 2024-04-19T22:45:02.993160+0000 mgr.y (mgr.14152) 340 : cephadm 1 Deploying daemon rgw.foo.a on smithi113 2024-04-19T22:45:04.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[28910]: cephadm 2024-04-19T22:45:02.312459+0000 mgr.y (mgr.14152) 338 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[28910]: cluster 2024-04-19T22:45:02.373624+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:04.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:04 smithi113 bash[28910]: cephadm 2024-04-19T22:45:02.993160+0000 mgr.y (mgr.14152) 340 : cephadm 1 Deploying daemon rgw.foo.a on smithi113 2024-04-19T22:45:04.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:04 smithi178 bash[23441]: cephadm 2024-04-19T22:45:02.312459+0000 mgr.y (mgr.14152) 338 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:04.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:04 smithi178 bash[23441]: cluster 2024-04-19T22:45:02.373624+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:04.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:04 smithi178 bash[23441]: cephadm 2024-04-19T22:45:02.993160+0000 mgr.y (mgr.14152) 340 : cephadm 1 Deploying daemon rgw.foo.a on smithi113 2024-04-19T22:45:05.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.794 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.794 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.794 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.795 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:05.795 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.271 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.271 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.272 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.272 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.272 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.273 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.273 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:06.273 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:45:05 smithi113 systemd[1]: Started Ceph rgw.foo.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: cluster 2024-04-19T22:45:04.374275+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.014319+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.021521+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.068672+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.073678+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.077954+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[21528]: audit 2024-04-19T22:45:06.126496+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: cluster 2024-04-19T22:45:04.374275+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.014319+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.021521+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.068672+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.073678+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.077954+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:06 smithi113 bash[28910]: audit 2024-04-19T22:45:06.126496+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:06.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: cluster 2024-04-19T22:45:04.374275+0000 mgr.y (mgr.14152) 341 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:06.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.014319+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.021521+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.068672+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.073678+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.077954+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:06.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:06 smithi178 bash[23441]: audit 2024-04-19T22:45:06.126496+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:07.624 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:07.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:07 smithi113 bash[28910]: cephadm 2024-04-19T22:45:06.069522+0000 mgr.y (mgr.14152) 342 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:07.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:07 smithi113 bash[21528]: cephadm 2024-04-19T22:45:06.069522+0000 mgr.y (mgr.14152) 342 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:07.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:07 smithi178 bash[23441]: cephadm 2024-04-19T22:45:06.069522+0000 mgr.y (mgr.14152) 342 : cephadm 1 Saving service rgw.foo.a spec with placement smithi113=foo.a;count:1 2024-04-19T22:45:08.702 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:08 smithi178 bash[23441]: cluster 2024-04-19T22:45:06.374837+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:08.702 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:08 smithi178 bash[23441]: cluster 2024-04-19T22:45:07.553160+0000 mon.a (mon.0) 675 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-04-19T22:45:08.702 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:08 smithi178 bash[23441]: audit 2024-04-19T22:45:07.557093+0000 mon.a (mon.0) 676 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-19T22:45:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[21528]: cluster 2024-04-19T22:45:06.374837+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[21528]: cluster 2024-04-19T22:45:07.553160+0000 mon.a (mon.0) 675 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-04-19T22:45:08.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[21528]: audit 2024-04-19T22:45:07.557093+0000 mon.a (mon.0) 676 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-19T22:45:08.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[28910]: cluster 2024-04-19T22:45:06.374837+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:08.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[28910]: cluster 2024-04-19T22:45:07.553160+0000 mon.a (mon.0) 675 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-04-19T22:45:08.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:08 smithi113 bash[28910]: audit 2024-04-19T22:45:07.557093+0000 mon.a (mon.0) 676 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-04-19T22:45:09.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[21528]: cluster 2024-04-19T22:45:08.375491+0000 mgr.y (mgr.14152) 344 : cluster 0 pgmap v327: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:09.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[21528]: cluster 2024-04-19T22:45:08.546841+0000 mon.a (mon.0) 677 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:09.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[21528]: audit 2024-04-19T22:45:08.558335+0000 mon.a (mon.0) 678 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[21528]: cluster 2024-04-19T22:45:08.563155+0000 mon.a (mon.0) 679 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[21528]: audit 2024-04-19T22:45:09.277116+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[28910]: cluster 2024-04-19T22:45:08.375491+0000 mgr.y (mgr.14152) 344 : cluster 0 pgmap v327: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[28910]: cluster 2024-04-19T22:45:08.546841+0000 mon.a (mon.0) 677 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[28910]: audit 2024-04-19T22:45:08.558335+0000 mon.a (mon.0) 678 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[28910]: cluster 2024-04-19T22:45:08.563155+0000 mon.a (mon.0) 679 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-04-19T22:45:09.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:09 smithi113 bash[28910]: audit 2024-04-19T22:45:09.277116+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:09.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:09 smithi178 bash[23441]: cluster 2024-04-19T22:45:08.375491+0000 mgr.y (mgr.14152) 344 : cluster 0 pgmap v327: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:45:09.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:09 smithi178 bash[23441]: cluster 2024-04-19T22:45:08.546841+0000 mon.a (mon.0) 677 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:09.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:09 smithi178 bash[23441]: audit 2024-04-19T22:45:08.558335+0000 mon.a (mon.0) 678 : audit 1 from='client.? 172.21.15.113:0/1114030151' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-04-19T22:45:09.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:09 smithi178 bash[23441]: cluster 2024-04-19T22:45:08.563155+0000 mon.a (mon.0) 679 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-04-19T22:45:09.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:09 smithi178 bash[23441]: audit 2024-04-19T22:45:09.277116+0000 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/4191579261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 msgr2=0x7f1680105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- 172.21.15.178:0/4191579261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f1680105b80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f167000b0d0 tx=0x7f167000b3e0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/4191579261 shutdown_connections 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- 172.21.15.178:0/4191579261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16801060c0 0x7f168010c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- 172.21.15.178:0/4191579261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1680104520 0x7f1680104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- 172.21.15.178:0/4191579261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f1680105b80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/4191579261 >> 172.21.15.178:0/4191579261 conn(0x7f16800ffac0 msgr2=0x7f1680101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/4191579261 shutdown_connections 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/4191579261 wait complete. 2024-04-19T22:45:10.093 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 Processor -- start 2024-04-19T22:45:10.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- start start 2024-04-19T22:45:10.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1680104520 0x7f1680199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:10.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:10.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16801060c0 0x7f16801a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f168010f8b0 con 0x7f16801060c0 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f168010f730 con 0x7f1680105720 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f168010fa30 con 0x7f1680104520 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:32926/0 (socket says 172.21.15.178:32926) 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 -- 172.21.15.178:0/2032937743 learned_addr learned my addr 172.21.15.178:0/2032937743 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f1684ee9700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1680104520 0x7f1680199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f16856ea700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16801060c0 0x7f16801a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 -- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1680104520 msgr2=0x7f1680199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1680104520 0x7f1680199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 -- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16801060c0 msgr2=0x7f16801a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16801060c0 0x7f16801a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 -- 172.21.15.178:0/2032937743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16801a1b10 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167ffff700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1670007d90 tx=0x7f167000bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167001f070 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1670003e10 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167001bad0 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16801a1da0 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.093+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16801a2270 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168004ff50 con 0x7f1680105720 2024-04-19T22:45:10.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f1670022070 con 0x7f1680105720 2024-04-19T22:45:10.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f167dffb700 1 --2- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 0x7f1660070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:10.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4794+0+0 (secure 0 0 0) 0x7f167000f020 con 0x7f1680105720 2024-04-19T22:45:10.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f1684ee9700 1 --2- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 0x7f1660070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:10.098 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.097+0000 7f1684ee9700 1 --2- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 0x7f1660070470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1668006fd0 tx=0x7f1668008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:10.101 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.101+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1670029020 con 0x7f1680105720 2024-04-19T22:45:10.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.313+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7f1680062e40 con 0x7f1680105720 2024-04-19T22:45:10.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.769+0000 7f167dffb700 1 -- 172.21.15.178:0/2032937743 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v63) ==== 160+0+0 (secure 0 0 0) 0x7f167005ce80 con 0x7f1680105720 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 msgr2=0x7f1660070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 0x7f1660070470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1668006fd0 tx=0x7f1668008040 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 msgr2=0x7f168019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1670007d90 tx=0x7f167000bdd0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 shutdown_connections 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> v2:172.21.15.113:6800/467518466 conn(0x7f166006dfb0 0x7f1660070470 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1668006fd0 tx=0x7f1668008040 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16801060c0 0x7f16801a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1680104520 0x7f1680199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 --2- 172.21.15.178:0/2032937743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1680105720 0x7f168019a3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:10.774 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.773+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 >> 172.21.15.178:0/2032937743 conn(0x7f16800ffac0 msgr2=0x7f16801015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:10.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.785+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 shutdown_connections 2024-04-19T22:45:10.786 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:10.789+0000 7f168714d700 1 -- 172.21.15.178:0/2032937743 wait complete. 2024-04-19T22:45:10.790 INFO:teuthology.orchestra.run.smithi178.stderr:pool 'datapool' created 2024-04-19T22:45:11.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:10 smithi113 bash[21528]: cluster 2024-04-19T22:45:09.570905+0000 mon.a (mon.0) 681 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-04-19T22:45:11.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:10 smithi113 bash[21528]: audit 2024-04-19T22:45:09.589112+0000 mon.a (mon.0) 682 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-19T22:45:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:10 smithi113 bash[28910]: cluster 2024-04-19T22:45:09.570905+0000 mon.a (mon.0) 681 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-04-19T22:45:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:10 smithi113 bash[28910]: audit 2024-04-19T22:45:09.589112+0000 mon.a (mon.0) 682 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-19T22:45:11.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:10 smithi178 bash[23441]: cluster 2024-04-19T22:45:09.570905+0000 mon.a (mon.0) 681 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-04-19T22:45:11.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:10 smithi178 bash[23441]: audit 2024-04-19T22:45:09.589112+0000 mon.a (mon.0) 682 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-04-19T22:45:11.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- rbd pool init datapool 2024-04-19T22:45:12.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:10.320749+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.178:0/2032937743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:10.321827+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: cluster 2024-04-19T22:45:10.376220+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v330: 65 pgs: 7 creating+peering, 19 active+clean, 39 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 853 B/s wr, 2 op/s 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:10.764781+0000 mon.a (mon.0) 684 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:10.764946+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: cluster 2024-04-19T22:45:10.775304+0000 mon.a (mon.0) 686 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:11.515585+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:11.523880+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:11.524835+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[28910]: audit 2024-04-19T22:45:11.525571+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:12.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:10.320749+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.178:0/2032937743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:10.321827+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: cluster 2024-04-19T22:45:10.376220+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v330: 65 pgs: 7 creating+peering, 19 active+clean, 39 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 853 B/s wr, 2 op/s 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:10.764781+0000 mon.a (mon.0) 684 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:10.764946+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: cluster 2024-04-19T22:45:10.775304+0000 mon.a (mon.0) 686 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:11.515585+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:11.523880+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:11.524835+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:12.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:12 smithi113 bash[21528]: audit 2024-04-19T22:45:11.525571+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:10.320749+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.178:0/2032937743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:10.321827+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: cluster 2024-04-19T22:45:10.376220+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v330: 65 pgs: 7 creating+peering, 19 active+clean, 39 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 853 B/s wr, 2 op/s 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:10.764781+0000 mon.a (mon.0) 684 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:10.764946+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: cluster 2024-04-19T22:45:10.775304+0000 mon.a (mon.0) 686 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:11.515585+0000 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:11.523880+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:12.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:11.524835+0000 mon.a (mon.0) 689 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:12.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:12 smithi178 bash[23441]: audit 2024-04-19T22:45:11.525571+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:13.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: cephadm 2024-04-19T22:45:11.529721+0000 mgr.y (mgr.14152) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:13.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: cluster 2024-04-19T22:45:12.149728+0000 mon.a (mon.0) 691 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: audit 2024-04-19T22:45:12.151498+0000 mon.c (mon.2) 13 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: audit 2024-04-19T22:45:12.159583+0000 mon.a (mon.0) 692 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: audit 2024-04-19T22:45:12.159869+0000 mon.a (mon.0) 693 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: audit 2024-04-19T22:45:13.139056+0000 mon.a (mon.0) 694 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: audit 2024-04-19T22:45:13.139173+0000 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[28910]: cluster 2024-04-19T22:45:13.148913+0000 mon.a (mon.0) 696 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: cephadm 2024-04-19T22:45:11.529721+0000 mgr.y (mgr.14152) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: cluster 2024-04-19T22:45:12.149728+0000 mon.a (mon.0) 691 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: audit 2024-04-19T22:45:12.151498+0000 mon.c (mon.2) 13 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: audit 2024-04-19T22:45:12.159583+0000 mon.a (mon.0) 692 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: audit 2024-04-19T22:45:12.159869+0000 mon.a (mon.0) 693 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: audit 2024-04-19T22:45:13.139056+0000 mon.a (mon.0) 694 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: audit 2024-04-19T22:45:13.139173+0000 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:13 smithi113 bash[21528]: cluster 2024-04-19T22:45:13.148913+0000 mon.a (mon.0) 696 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: cephadm 2024-04-19T22:45:11.529721+0000 mgr.y (mgr.14152) 346 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: cluster 2024-04-19T22:45:12.149728+0000 mon.a (mon.0) 691 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: audit 2024-04-19T22:45:12.151498+0000 mon.c (mon.2) 13 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: audit 2024-04-19T22:45:12.159583+0000 mon.a (mon.0) 692 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: audit 2024-04-19T22:45:12.159869+0000 mon.a (mon.0) 693 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: audit 2024-04-19T22:45:13.139056+0000 mon.a (mon.0) 694 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: audit 2024-04-19T22:45:13.139173+0000 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-04-19T22:45:13.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:13 smithi178 bash[23441]: cluster 2024-04-19T22:45:13.148913+0000 mon.a (mon.0) 696 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-04-19T22:45:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[21528]: cluster 2024-04-19T22:45:12.377085+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v333: 100 pgs: 8 creating+peering, 40 active+clean, 52 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.5 KiB/s wr, 3 op/s 2024-04-19T22:45:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[21528]: cluster 2024-04-19T22:45:13.724528+0000 mon.a (mon.0) 697 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:14.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[21528]: audit 2024-04-19T22:45:14.171116+0000 mon.c (mon.2) 14 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:14.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[28910]: cluster 2024-04-19T22:45:12.377085+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v333: 100 pgs: 8 creating+peering, 40 active+clean, 52 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.5 KiB/s wr, 3 op/s 2024-04-19T22:45:14.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[28910]: cluster 2024-04-19T22:45:13.724528+0000 mon.a (mon.0) 697 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:14.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:14 smithi113 bash[28910]: audit 2024-04-19T22:45:14.171116+0000 mon.c (mon.2) 14 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:14.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:14 smithi178 bash[23441]: cluster 2024-04-19T22:45:12.377085+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v333: 100 pgs: 8 creating+peering, 40 active+clean, 52 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.5 KiB/s wr, 3 op/s 2024-04-19T22:45:14.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:14 smithi178 bash[23441]: cluster 2024-04-19T22:45:13.724528+0000 mon.a (mon.0) 697 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:14.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:14 smithi178 bash[23441]: audit 2024-04-19T22:45:14.171116+0000 mon.c (mon.2) 14 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[21528]: cluster 2024-04-19T22:45:14.168682+0000 mon.a (mon.0) 698 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-04-19T22:45:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[21528]: audit 2024-04-19T22:45:14.170414+0000 mon.a (mon.0) 699 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[21528]: audit 2024-04-19T22:45:14.171662+0000 mon.a (mon.0) 700 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[21528]: audit 2024-04-19T22:45:15.167329+0000 mon.a (mon.0) 701 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[28910]: cluster 2024-04-19T22:45:14.168682+0000 mon.a (mon.0) 698 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-04-19T22:45:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[28910]: audit 2024-04-19T22:45:14.170414+0000 mon.a (mon.0) 699 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[28910]: audit 2024-04-19T22:45:14.171662+0000 mon.a (mon.0) 700 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:15 smithi113 bash[28910]: audit 2024-04-19T22:45:15.167329+0000 mon.a (mon.0) 701 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:15 smithi178 bash[23441]: cluster 2024-04-19T22:45:14.168682+0000 mon.a (mon.0) 698 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-04-19T22:45:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:15 smithi178 bash[23441]: audit 2024-04-19T22:45:14.170414+0000 mon.a (mon.0) 699 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:15 smithi178 bash[23441]: audit 2024-04-19T22:45:14.171662+0000 mon.a (mon.0) 700 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-04-19T22:45:15.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:15 smithi178 bash[23441]: audit 2024-04-19T22:45:15.167329+0000 mon.a (mon.0) 701 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:16.192 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:16.543 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[52810]: debug 2024-04-19T22:45:16.251+0000 7f0af9dfeac0 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-19T22:45:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: cluster 2024-04-19T22:45:14.378046+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 13 creating+peering, 76 active+clean, 43 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:45:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:15.167495+0000 mon.a (mon.0) 702 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: cluster 2024-04-19T22:45:15.178538+0000 mon.a (mon.0) 703 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-04-19T22:45:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:15.193740+0000 mon.c (mon.2) 15 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:15.196138+0000 mon.a (mon.0) 704 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:15.216821+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:16.169621+0000 mon.a (mon.0) 706 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: audit 2024-04-19T22:45:16.169803+0000 mon.a (mon.0) 707 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[28910]: cluster 2024-04-19T22:45:16.176967+0000 mon.a (mon.0) 708 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: cluster 2024-04-19T22:45:14.378046+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 13 creating+peering, 76 active+clean, 43 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:15.167495+0000 mon.a (mon.0) 702 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: cluster 2024-04-19T22:45:15.178538+0000 mon.a (mon.0) 703 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:15.193740+0000 mon.c (mon.2) 15 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:15.196138+0000 mon.a (mon.0) 704 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:15.216821+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:16.169621+0000 mon.a (mon.0) 706 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: audit 2024-04-19T22:45:16.169803+0000 mon.a (mon.0) 707 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:16 smithi113 bash[21528]: cluster 2024-04-19T22:45:16.176967+0000 mon.a (mon.0) 708 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: cluster 2024-04-19T22:45:14.378046+0000 mgr.y (mgr.14152) 348 : cluster 0 pgmap v336: 132 pgs: 13 creating+peering, 76 active+clean, 43 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:15.167495+0000 mon.a (mon.0) 702 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: cluster 2024-04-19T22:45:15.178538+0000 mon.a (mon.0) 703 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:15.193740+0000 mon.c (mon.2) 15 : audit 1 from='client.? 172.21.15.113:0/2966895410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:15.196138+0000 mon.a (mon.0) 704 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:15.216821+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:16.169621+0000 mon.a (mon.0) 706 : audit 1 from='client.? 172.21.15.113:0/3308940826' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: audit 2024-04-19T22:45:16.169803+0000 mon.a (mon.0) 707 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-04-19T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:16 smithi178 bash[23441]: cluster 2024-04-19T22:45:16.176967+0000 mon.a (mon.0) 708 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: cluster 2024-04-19T22:45:16.379150+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v339: 132 pgs: 13 creating+peering, 99 active+clean, 20 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.446370+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.451761+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.460314+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.540180+0000 mon.a (mon.0) 712 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.542255+0000 mon.a (mon.0) 713 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.543187+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: cephadm 2024-04-19T22:45:16.547754+0000 mgr.y (mgr.14152) 350 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:17.542 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:17 smithi178 bash[23441]: audit 2024-04-19T22:45:16.826936+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: cluster 2024-04-19T22:45:16.379150+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v339: 132 pgs: 13 creating+peering, 99 active+clean, 20 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-04-19T22:45:17.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.446370+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.451761+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.460314+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.540180+0000 mon.a (mon.0) 712 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.542255+0000 mon.a (mon.0) 713 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.543187+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: cephadm 2024-04-19T22:45:16.547754+0000 mgr.y (mgr.14152) 350 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[21528]: audit 2024-04-19T22:45:16.826936+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: cluster 2024-04-19T22:45:16.379150+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v339: 132 pgs: 13 creating+peering, 99 active+clean, 20 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 18 op/s 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.446370+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.451761+0000 mon.a (mon.0) 710 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.460314+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:17.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.540180+0000 mon.a (mon.0) 712 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.542255+0000 mon.a (mon.0) 713 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.543187+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: cephadm 2024-04-19T22:45:16.547754+0000 mgr.y (mgr.14152) 350 : cephadm 1 Checking dashboard <-> RGW credentials 2024-04-19T22:45:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:17 smithi113 bash[28910]: audit 2024-04-19T22:45:16.826936+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:19.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[28910]: cluster 2024-04-19T22:45:18.380538+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 13 creating+peering, 109 active+clean, 10 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.9 KiB/s wr, 55 op/s 2024-04-19T22:45:19.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[28910]: cluster 2024-04-19T22:45:18.725332+0000 mon.a (mon.0) 716 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:19.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[28910]: audit 2024-04-19T22:45:18.778843+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.178:0/871143804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:19.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[28910]: audit 2024-04-19T22:45:18.779754+0000 mon.a (mon.0) 717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[21528]: cluster 2024-04-19T22:45:18.380538+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 13 creating+peering, 109 active+clean, 10 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.9 KiB/s wr, 55 op/s 2024-04-19T22:45:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[21528]: cluster 2024-04-19T22:45:18.725332+0000 mon.a (mon.0) 716 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[21528]: audit 2024-04-19T22:45:18.778843+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.178:0/871143804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:19.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:19 smithi113 bash[21528]: audit 2024-04-19T22:45:18.779754+0000 mon.a (mon.0) 717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:19 smithi178 bash[23441]: cluster 2024-04-19T22:45:18.380538+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 13 creating+peering, 109 active+clean, 10 unknown; 580 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 2.9 KiB/s wr, 55 op/s 2024-04-19T22:45:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:19 smithi178 bash[23441]: cluster 2024-04-19T22:45:18.725332+0000 mon.a (mon.0) 716 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:45:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:19 smithi178 bash[23441]: audit 2024-04-19T22:45:18.778843+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.178:0/871143804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:19 smithi178 bash[23441]: audit 2024-04-19T22:45:18.779754+0000 mon.a (mon.0) 717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-04-19T22:45:20.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:20 smithi113 bash[21528]: audit 2024-04-19T22:45:19.450879+0000 mon.a (mon.0) 718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-19T22:45:20.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:20 smithi113 bash[21528]: cluster 2024-04-19T22:45:19.458331+0000 mon.a (mon.0) 719 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-04-19T22:45:20.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:20 smithi113 bash[28910]: audit 2024-04-19T22:45:19.450879+0000 mon.a (mon.0) 718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-19T22:45:20.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:20 smithi113 bash[28910]: cluster 2024-04-19T22:45:19.458331+0000 mon.a (mon.0) 719 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-04-19T22:45:20.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:20 smithi178 bash[23441]: audit 2024-04-19T22:45:19.450879+0000 mon.a (mon.0) 718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-04-19T22:45:20.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:20 smithi178 bash[23441]: cluster 2024-04-19T22:45:19.458331+0000 mon.a (mon.0) 719 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-04-19T22:45:21.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[28910]: cluster 2024-04-19T22:45:20.381524+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 6.0 KiB/s wr, 171 op/s 2024-04-19T22:45:21.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[28910]: cluster 2024-04-19T22:45:20.460817+0000 mon.a (mon.0) 720 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[28910]: cluster 2024-04-19T22:45:20.460888+0000 mon.a (mon.0) 721 : cluster 1 Cluster is now healthy 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[28910]: cluster 2024-04-19T22:45:20.479699+0000 mon.a (mon.0) 722 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[21528]: cluster 2024-04-19T22:45:20.381524+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 6.0 KiB/s wr, 171 op/s 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[21528]: cluster 2024-04-19T22:45:20.460817+0000 mon.a (mon.0) 720 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[21528]: cluster 2024-04-19T22:45:20.460888+0000 mon.a (mon.0) 721 : cluster 1 Cluster is now healthy 2024-04-19T22:45:21.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:21 smithi113 bash[21528]: cluster 2024-04-19T22:45:20.479699+0000 mon.a (mon.0) 722 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-04-19T22:45:21.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:21 smithi178 bash[23441]: cluster 2024-04-19T22:45:20.381524+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 6.0 KiB/s wr, 171 op/s 2024-04-19T22:45:21.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:21 smithi178 bash[23441]: cluster 2024-04-19T22:45:20.460817+0000 mon.a (mon.0) 720 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-19T22:45:21.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:21 smithi178 bash[23441]: cluster 2024-04-19T22:45:20.460888+0000 mon.a (mon.0) 721 : cluster 1 Cluster is now healthy 2024-04-19T22:45:21.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:21 smithi178 bash[23441]: cluster 2024-04-19T22:45:20.479699+0000 mon.a (mon.0) 722 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-04-19T22:45:22.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.178 --placement '1;smithi178=iscsi.a' 2024-04-19T22:45:22.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:22 smithi113 bash[21528]: cluster 2024-04-19T22:45:21.488858+0000 mon.a (mon.0) 723 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-04-19T22:45:22.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:22 smithi113 bash[28910]: cluster 2024-04-19T22:45:21.488858+0000 mon.a (mon.0) 723 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-04-19T22:45:22.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:22 smithi178 bash[23441]: cluster 2024-04-19T22:45:21.488858+0000 mon.a (mon.0) 723 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-04-19T22:45:23.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:23 smithi113 bash[21528]: cluster 2024-04-19T22:45:22.382466+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 4.8 KiB/s wr, 180 op/s 2024-04-19T22:45:23.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:23 smithi113 bash[28910]: cluster 2024-04-19T22:45:22.382466+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 4.8 KiB/s wr, 180 op/s 2024-04-19T22:45:23.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:23 smithi178 bash[23441]: cluster 2024-04-19T22:45:22.382466+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 4.8 KiB/s wr, 180 op/s 2024-04-19T22:45:25.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:25 smithi113 bash[28910]: cluster 2024-04-19T22:45:24.383539+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 144 op/s 2024-04-19T22:45:25.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:25 smithi113 bash[21528]: cluster 2024-04-19T22:45:24.383539+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 144 op/s 2024-04-19T22:45:25.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:25 smithi178 bash[23441]: cluster 2024-04-19T22:45:24.383539+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 144 op/s 2024-04-19T22:45:26.863 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:27.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:27 smithi113 bash[21528]: cluster 2024-04-19T22:45:26.384946+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 886 B/s wr, 42 op/s 2024-04-19T22:45:27.793 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:27 smithi113 bash[28910]: cluster 2024-04-19T22:45:26.384946+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 886 B/s wr, 42 op/s 2024-04-19T22:45:27.799 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:27 smithi178 bash[23441]: cluster 2024-04-19T22:45:26.384946+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 886 B/s wr, 42 op/s 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- 172.21.15.178:0/26532259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102da0 msgr2=0x7f1f40109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/26532259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102da0 0x7f1f40109650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800b0d0 tx=0x7f1f3800b3e0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- 172.21.15.178:0/26532259 shutdown_connections 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/26532259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102da0 0x7f1f40109650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/26532259 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 0x7f1f40101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/26532259 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102400 0x7f1f40102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- 172.21.15.178:0/26532259 >> 172.21.15.178:0/26532259 conn(0x7f1f400fc7c0 msgr2=0x7f1f400febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- 172.21.15.178:0/26532259 shutdown_connections 2024-04-19T22:45:29.205 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- 172.21.15.178:0/26532259 wait complete. 2024-04-19T22:45:29.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 Processor -- start 2024-04-19T22:45:29.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- start start 2024-04-19T22:45:29.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 0x7f1f40105190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102da0 0x7f1f40103d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4010c5e0 con 0x7f1f40102da0 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4010c460 con 0x7f1f40102400 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f47cb4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4010c760 con 0x7f1f40101200 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:43554/0 (socket says 172.21.15.178:43554) 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 -- 172.21.15.178:0/3385776713 learned_addr learned my addr 172.21.15.178:0/3385776713 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f46251700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102da0 0x7f1f40103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f45a50700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 0x7f1f40105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 -- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 msgr2=0x7f1f40105190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 0x7f1f40105190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 -- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102da0 msgr2=0x7f1f40103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102da0 0x7f1f40103d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.205+0000 7f1f4524f700 1 -- 172.21.15.178:0/3385776713 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f401045d0 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f4524f700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00b530 tx=0x7f1f3c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c015020 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f1f3c011ce0 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f401a1e00 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c010d30 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f401a22e0 con 0x7f1f40102400 2024-04-19T22:45:29.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4004ff50 con 0x7f1f40102400 2024-04-19T22:45:29.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 92082+0+0 (secure 0 0 0) 0x7f1f3c018020 con 0x7f1f40102400 2024-04-19T22:45:29.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 --2- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 0x7f1f2c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:29.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5942+0+0 (secure 0 0 0) 0x7f1f3c08d6d0 con 0x7f1f40102400 2024-04-19T22:45:29.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f45a50700 1 --2- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 0x7f1f2c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:29.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.209+0000 7f1f45a50700 1 --2- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 0x7f1f2c070470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006fd0 tx=0x7f1f34008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:29.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.213+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1f3c01f020 con 0x7f1f40102400 2024-04-19T22:45:29.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.437+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.178", "placement": "1;smithi178=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f1f40062670 con 0x7f1f2c06dfb0 2024-04-19T22:45:29.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.453+0000 7f1f32ffd700 1 -- 172.21.15.178:0/3385776713 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7f1f40062670 con 0x7f1f2c06dfb0 2024-04-19T22:45:29.453 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled iscsi.datapool update... 2024-04-19T22:45:29.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 msgr2=0x7f1f2c070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:29.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 0x7f1f2c070470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006fd0 tx=0x7f1f34008040 comp rx=0 tx=0).stop 2024-04-19T22:45:29.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 msgr2=0x7f1f401037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:29.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00b530 tx=0x7f1f3c00b8f0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 shutdown_connections 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> v2:172.21.15.113:6800/467518466 conn(0x7f1f2c06dfb0 0x7f1f2c070470 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f40102da0 0x7f1f40103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f40101200 0x7f1f40105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 --2- 172.21.15.178:0/3385776713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f40102400 0x7f1f401037e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 >> 172.21.15.178:0/3385776713 conn(0x7f1f400fc7c0 msgr2=0x7f1f400fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 shutdown_connections 2024-04-19T22:45:29.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:29.457+0000 7f1f47cb4700 1 -- 172.21.15.178:0/3385776713 wait complete. 2024-04-19T22:45:30.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[21528]: cluster 2024-04-19T22:45:28.385862+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-19T22:45:30.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[21528]: cluster 2024-04-19T22:45:28.737271+0000 mon.a (mon.0) 724 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-04-19T22:45:30.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[21528]: audit 2024-04-19T22:45:29.457963+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:30.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[21528]: audit 2024-04-19T22:45:29.460304+0000 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:30.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[28910]: cluster 2024-04-19T22:45:28.385862+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-19T22:45:30.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[28910]: cluster 2024-04-19T22:45:28.737271+0000 mon.a (mon.0) 724 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-04-19T22:45:30.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[28910]: audit 2024-04-19T22:45:29.457963+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:30.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:29 smithi113 bash[28910]: audit 2024-04-19T22:45:29.460304+0000 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:30.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:29 smithi178 bash[23441]: cluster 2024-04-19T22:45:28.385862+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-19T22:45:30.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:29 smithi178 bash[23441]: cluster 2024-04-19T22:45:28.737271+0000 mon.a (mon.0) 724 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-04-19T22:45:30.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:29 smithi178 bash[23441]: audit 2024-04-19T22:45:29.457963+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:30.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:29 smithi178 bash[23441]: audit 2024-04-19T22:45:29.460304+0000 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:30.139 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-04-19T22:45:30.139 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:45:30.139 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-04-19T22:45:30.153 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:45:30.153 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-04-19T22:45:30.166 DEBUG:teuthology.orchestra.run.smithi178:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@iscsi.iscsi.a.service 2024-04-19T22:45:30.208 INFO:tasks.cephadm:Adding prometheus.a on smithi178 2024-04-19T22:45:30.208 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply prometheus '1;smithi178=a' 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:29.444447+0000 mgr.y (mgr.14152) 357 : audit 0 from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.178", "placement": "1;smithi178=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: cephadm 2024-04-19T22:45:29.450614+0000 mgr.y (mgr.14152) 358 : cephadm 1 Saving service iscsi.datapool spec with placement smithi178=iscsi.a;count:1 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.082616+0000 mon.a (mon.0) 727 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.084730+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.095462+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.103257+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.107411+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-19T22:45:30.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: audit 2024-04-19T22:45:30.135980+0000 mon.a (mon.0) 732 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:30.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:30 smithi178 bash[23441]: cephadm 2024-04-19T22:45:30.137821+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi178 2024-04-19T22:45:31.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:29.444447+0000 mgr.y (mgr.14152) 357 : audit 0 from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.178", "placement": "1;smithi178=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: cephadm 2024-04-19T22:45:29.450614+0000 mgr.y (mgr.14152) 358 : cephadm 1 Saving service iscsi.datapool spec with placement smithi178=iscsi.a;count:1 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.082616+0000 mon.a (mon.0) 727 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.084730+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.095462+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.103257+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.107411+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: audit 2024-04-19T22:45:30.135980+0000 mon.a (mon.0) 732 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[21528]: cephadm 2024-04-19T22:45:30.137821+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi178 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:29.444447+0000 mgr.y (mgr.14152) 357 : audit 0 from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.178", "placement": "1;smithi178=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: cephadm 2024-04-19T22:45:29.450614+0000 mgr.y (mgr.14152) 358 : cephadm 1 Saving service iscsi.datapool spec with placement smithi178=iscsi.a;count:1 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.082616+0000 mon.a (mon.0) 727 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:31.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.084730+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.095462+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.103257+0000 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-04-19T22:45:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.107411+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-04-19T22:45:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: audit 2024-04-19T22:45:30.135980+0000 mon.a (mon.0) 732 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:30 smithi113 bash[28910]: cephadm 2024-04-19T22:45:30.137821+0000 mgr.y (mgr.14152) 359 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi178 2024-04-19T22:45:32.417 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:32 smithi178 bash[23441]: cluster 2024-04-19T22:45:30.387087+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 115 B/s wr, 0 op/s 2024-04-19T22:45:32.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:32 smithi113 bash[21528]: cluster 2024-04-19T22:45:30.387087+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 115 B/s wr, 0 op/s 2024-04-19T22:45:32.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:32 smithi113 bash[28910]: cluster 2024-04-19T22:45:30.387087+0000 mgr.y (mgr.14152) 360 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 115 B/s wr, 0 op/s 2024-04-19T22:45:32.772 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.772 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.772 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.773 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.773 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.773 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.773 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.773 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.774 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.774 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.774 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:32.774 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:45:32 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:34.082 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: cluster 2024-04-19T22:45:32.388101+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: audit 2024-04-19T22:45:32.834679+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: audit 2024-04-19T22:45:32.845165+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: audit 2024-04-19T22:45:32.866400+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: cephadm 2024-04-19T22:45:32.868274+0000 mgr.y (mgr.14152) 362 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: audit 2024-04-19T22:45:32.884545+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:33 smithi178 bash[23441]: audit 2024-04-19T22:45:32.917305+0000 mon.a (mon.0) 737 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:34.293 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: cluster 2024-04-19T22:45:32.388101+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: audit 2024-04-19T22:45:32.834679+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: audit 2024-04-19T22:45:32.845165+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: audit 2024-04-19T22:45:32.866400+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: cephadm 2024-04-19T22:45:32.868274+0000 mgr.y (mgr.14152) 362 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: audit 2024-04-19T22:45:32.884545+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[21528]: audit 2024-04-19T22:45:32.917305+0000 mon.a (mon.0) 737 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: cluster 2024-04-19T22:45:32.388101+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-04-19T22:45:34.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: audit 2024-04-19T22:45:32.834679+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: audit 2024-04-19T22:45:32.845165+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: audit 2024-04-19T22:45:32.866400+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: cephadm 2024-04-19T22:45:32.868274+0000 mgr.y (mgr.14152) 362 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-04-19T22:45:34.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: audit 2024-04-19T22:45:32.884545+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:34.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:33 smithi113 bash[28910]: audit 2024-04-19T22:45:32.917305+0000 mon.a (mon.0) 737 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:34.550 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:34 smithi178 bash[47837]: debug Processing osd blocklist entries for this node 2024-04-19T22:45:35.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:34 smithi178 bash[47837]: debug Reading the configuration object to update local LIO configuration 2024-04-19T22:45:35.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:34 smithi178 bash[47837]: debug Configuration does not have an entry for this host(smithi178.front.sepia.ceph.com) - nothing to define to LIO 2024-04-19T22:45:35.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:34 smithi178 bash[47837]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-04-19T22:45:35.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[21528]: cluster 2024-04-19T22:45:34.135904+0000 mon.a (mon.0) 738 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-04-19T22:45:35.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[21528]: audit 2024-04-19T22:45:34.286614+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:35.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[21528]: audit 2024-04-19T22:45:34.641997+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.178:0/4096663348' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-19T22:45:35.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[28910]: cluster 2024-04-19T22:45:34.135904+0000 mon.a (mon.0) 738 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-04-19T22:45:35.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[28910]: audit 2024-04-19T22:45:34.286614+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:35.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:35 smithi113 bash[28910]: audit 2024-04-19T22:45:34.641997+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.178:0/4096663348' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-19T22:45:35.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:35 smithi178 bash[23441]: cluster 2024-04-19T22:45:34.135904+0000 mon.a (mon.0) 738 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-04-19T22:45:35.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:35 smithi178 bash[23441]: audit 2024-04-19T22:45:34.286614+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:35.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:35 smithi178 bash[23441]: audit 2024-04-19T22:45:34.641997+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.178:0/4096663348' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-19T22:45:35.986 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:36.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:36 smithi113 bash[21528]: cluster 2024-04-19T22:45:34.389309+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 102 B/s wr, 0 op/s 2024-04-19T22:45:36.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:36 smithi113 bash[28910]: cluster 2024-04-19T22:45:34.389309+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 102 B/s wr, 0 op/s 2024-04-19T22:45:36.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:36 smithi178 bash[23441]: cluster 2024-04-19T22:45:34.389309+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 102 B/s wr, 0 op/s 2024-04-19T22:45:38.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:38 smithi113 bash[21528]: cluster 2024-04-19T22:45:36.390372+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:38.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:38 smithi113 bash[28910]: cluster 2024-04-19T22:45:36.390372+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:38.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:38 smithi178 bash[23441]: cluster 2024-04-19T22:45:36.390372+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3469260769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff53410a210 msgr2=0x7ff53410c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3469260769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff53410a210 0x7ff53410c680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00b0a0 tx=0x7ff52c00b3b0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3469260769 shutdown_connections 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3469260769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff53410a210 0x7ff53410c680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3469260769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff534074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3469260769 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff534074c10 0x7ff534075090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3469260769 >> 172.21.15.178:0/3469260769 conn(0x7ff5340fd8b0 msgr2=0x7ff5340ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3469260769 shutdown_connections 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3469260769 wait complete. 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 Processor -- start 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- start start 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff53419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:38.553 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53410a210 0x7ff5341a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410f7e0 con 0x7ff53410a210 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410f660 con 0x7ff534074c10 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7ff53410f960 con 0x7ff5340761e0 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:38184/0 (socket says 172.21.15.178:38184) 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 -- 172.21.15.178:0/3803277725 learned_addr learned my addr 172.21.15.178:0/3803277725 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff533fff700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff53419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53906c700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53410a210 0x7ff5341a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 -- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 msgr2=0x7ff53419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff53419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 -- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53410a210 msgr2=0x7ff5341a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53410a210 0x7ff5341a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 -- 172.21.15.178:0/3803277725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341a1910 con 0x7ff534074c10 2024-04-19T22:45:38.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff533fff700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff53419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:45:38.555 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53886b700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c9b0 tx=0x7ff52000cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520007b00 con 0x7ff534074c10 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ff520007ca0 con 0x7ff534074c10 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520018640 con 0x7ff534074c10 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a1c00 con 0x7ff534074c10 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.552+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a20f0 con 0x7ff534074c10 2024-04-19T22:45:38.556 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 92133+0+0 (secure 0 0 0) 0x7ff52000f450 con 0x7ff534074c10 2024-04-19T22:45:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53404ff50 con 0x7ff534074c10 2024-04-19T22:45:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff531ffb700 1 --2- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 0x7ff524070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5942+0+0 (secure 0 0 0) 0x7ff52008e0b0 con 0x7ff534074c10 2024-04-19T22:45:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff533fff700 1 --2- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 0x7ff524070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:38.557 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.556+0000 7ff533fff700 1 --2- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 0x7ff524070500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff53419b1a0 tx=0x7ff528005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:38.564 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.564+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff520014030 con 0x7ff534074c10 2024-04-19T22:45:38.782 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.780+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}) -- 0x7ff534062670 con 0x7ff52406e040 2024-04-19T22:45:38.804 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff531ffb700 1 -- 172.21.15.178:0/3803277725 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7ff534062670 con 0x7ff52406e040 2024-04-19T22:45:38.804 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled prometheus update... 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 msgr2=0x7ff524070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 0x7ff524070500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff53419b1a0 tx=0x7ff528005f50 comp rx=0 tx=0).stop 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 msgr2=0x7ff534199ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c9b0 tx=0x7ff52000cd70 comp rx=0 tx=0).stop 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 shutdown_connections 2024-04-19T22:45:38.806 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> v2:172.21.15.113:6800/467518466 conn(0x7ff52406e040 0x7ff524070500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff53410a210 0x7ff5341a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff534074c10 0x7ff534199ce0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 --2- 172.21.15.178:0/3803277725 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5340761e0 0x7ff53419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 >> 172.21.15.178:0/3803277725 conn(0x7ff5340fd8b0 msgr2=0x7ff5340ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 shutdown_connections 2024-04-19T22:45:38.807 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:38.804+0000 7ff53aacf700 1 -- 172.21.15.178:0/3803277725 wait complete. 2024-04-19T22:45:39.478 DEBUG:teuthology.orchestra.run.smithi178:prometheus.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@prometheus.a.service 2024-04-19T22:45:39.481 INFO:tasks.cephadm:Adding node-exporter.a on smithi113 2024-04-19T22:45:39.481 INFO:tasks.cephadm:Adding node-exporter.b on smithi178 2024-04-19T22:45:39.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply node-exporter '2;smithi113=a;smithi178=b' 2024-04-19T22:45:39.752 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:39 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: cluster 2024-04-19T22:45:38.391243+0000 mgr.y (mgr.14152) 365 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.760638+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.773069+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.775711+0000 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.777881+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.788832+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.790966+0000 mgr.y (mgr.14152) 366 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: cephadm 2024-04-19T22:45:38.795353+0000 mgr.y (mgr.14152) 367 : cephadm 1 Saving service prometheus spec with placement smithi178=a;count:1 2024-04-19T22:45:40.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.807484+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.871871+0000 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.873142+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: cephadm 2024-04-19T22:45:38.875244+0000 mgr.y (mgr.14152) 369 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.178:5000 to Dashboard 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.875701+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.876548+0000 mgr.y (mgr.14152) 370 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.881735+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.898084+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.899338+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.910994+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.917965+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: cluster 2024-04-19T22:45:38.391243+0000 mgr.y (mgr.14152) 365 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.760638+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.773069+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.775711+0000 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.777881+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.788832+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.790966+0000 mgr.y (mgr.14152) 366 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: cephadm 2024-04-19T22:45:38.795353+0000 mgr.y (mgr.14152) 367 : cephadm 1 Saving service prometheus spec with placement smithi178=a;count:1 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.807484+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.871871+0000 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.873142+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: cephadm 2024-04-19T22:45:38.875244+0000 mgr.y (mgr.14152) 369 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.178:5000 to Dashboard 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.875701+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.876548+0000 mgr.y (mgr.14152) 370 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.881735+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.898084+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.899338+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.910994+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.917965+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.921261+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.922741+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: audit 2024-04-19T22:45:38.931371+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[21528]: cephadm 2024-04-19T22:45:39.217088+0000 mgr.y (mgr.14152) 372 : cephadm 1 Deploying daemon prometheus.a on smithi178 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.921261+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.922741+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: audit 2024-04-19T22:45:38.931371+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:39 smithi113 bash[28910]: cephadm 2024-04-19T22:45:39.217088+0000 mgr.y (mgr.14152) 372 : cephadm 1 Deploying daemon prometheus.a on smithi178 2024-04-19T22:45:40.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: cluster 2024-04-19T22:45:38.391243+0000 mgr.y (mgr.14152) 365 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:45:40.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.760638+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.773069+0000 mon.a (mon.0) 741 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.775711+0000 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.777881+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.788832+0000 mon.a (mon.0) 744 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.790966+0000 mgr.y (mgr.14152) 366 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: cephadm 2024-04-19T22:45:38.795353+0000 mgr.y (mgr.14152) 367 : cephadm 1 Saving service prometheus spec with placement smithi178=a;count:1 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.807484+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.871871+0000 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.873142+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: cephadm 2024-04-19T22:45:38.875244+0000 mgr.y (mgr.14152) 369 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.178:5000 to Dashboard 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.875701+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.876548+0000 mgr.y (mgr.14152) 370 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.881735+0000 mon.a (mon.0) 748 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.898084+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.899338+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi178"}]: dispatch 2024-04-19T22:45:40.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.910994+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.917965+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:45:40.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.921261+0000 mon.a (mon.0) 752 : audit 0 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:45:40.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.922741+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:45:40.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: audit 2024-04-19T22:45:38.931371+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:40.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:39 smithi178 bash[23441]: cephadm 2024-04-19T22:45:39.217088+0000 mgr.y (mgr.14152) 372 : cephadm 1 Deploying daemon prometheus.a on smithi178 2024-04-19T22:45:42.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:41 smithi113 bash[21528]: cluster 2024-04-19T22:45:40.392470+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 439 B/s rd, 87 B/s wr, 1 op/s 2024-04-19T22:45:42.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:41 smithi113 bash[28910]: cluster 2024-04-19T22:45:40.392470+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 439 B/s rd, 87 B/s wr, 1 op/s 2024-04-19T22:45:42.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:41 smithi178 bash[23441]: cluster 2024-04-19T22:45:40.392470+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 439 B/s rd, 87 B/s wr, 1 op/s 2024-04-19T22:45:44.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:43 smithi113 bash[28910]: cluster 2024-04-19T22:45:42.393471+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:44.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:43 smithi113 bash[21528]: cluster 2024-04-19T22:45:42.393471+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:44.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:43 smithi178 bash[23441]: cluster 2024-04-19T22:45:42.393471+0000 mgr.y (mgr.14152) 374 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:44.273 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:44.550 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:45:46.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:45 smithi113 bash[21528]: audit 2024-04-19T22:45:44.325495+0000 mgr.y (mgr.14152) 375 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:46.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:45 smithi113 bash[21528]: cluster 2024-04-19T22:45:44.394565+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:46.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:45 smithi113 bash[28910]: audit 2024-04-19T22:45:44.325495+0000 mgr.y (mgr.14152) 375 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:46.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:45 smithi113 bash[28910]: cluster 2024-04-19T22:45:44.394565+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:46.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:45 smithi178 bash[23441]: audit 2024-04-19T22:45:44.325495+0000 mgr.y (mgr.14152) 375 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:46.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:45 smithi178 bash[23441]: cluster 2024-04-19T22:45:44.394565+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:48.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:47 smithi113 bash[28910]: cluster 2024-04-19T22:45:46.395561+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:48.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:47 smithi113 bash[21528]: cluster 2024-04-19T22:45:46.395561+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:48.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:47 smithi178 bash[23441]: cluster 2024-04-19T22:45:46.395561+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/4176779736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 msgr2=0x7f3c98102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/4176779736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c98102580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b0a0 tx=0x7f3c9000b3b0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/4176779736 shutdown_connections 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/4176779736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c98102580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/4176779736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c981005d0 0x7f3c981009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/4176779736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c98101340 0x7f3c981017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/4176779736 >> 172.21.15.178:0/4176779736 conn(0x7f3c980fbf30 msgr2=0x7f3c980fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:49.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/4176779736 shutdown_connections 2024-04-19T22:45:49.853 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/4176779736 wait complete. 2024-04-19T22:45:49.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 Processor -- start 2024-04-19T22:45:49.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- start start 2024-04-19T22:45:49.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c981005d0 0x7f3c98199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:49.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c98101340 0x7f3c9819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:49.854 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9810f860 con 0x7f3c98101340 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9810f6e0 con 0x7f3c98101d00 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9810f9e0 con 0x7f3c981005d0 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:56220/0 (socket says 172.21.15.178:56220) 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 -- 172.21.15.178:0/1913729755 learned_addr learned my addr 172.21.15.178:0/1913729755 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c97fff700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c98101340 0x7f3c9819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9c8d2700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c981005d0 0x7f3c98199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 -- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c981005d0 msgr2=0x7f3c98199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c981005d0 0x7f3c98199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 -- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c98101340 msgr2=0x7f3c9819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c98101340 0x7f3c9819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 -- 172.21.15.178:0/1913729755 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c981a19c0 con 0x7f3c98101d00 2024-04-19T22:45:49.855 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9d0d3700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c900062a0 tx=0x7f3c90009c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:49.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90003c00 con 0x7f3c98101d00 2024-04-19T22:45:49.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981a1c50 con 0x7f3c98101d00 2024-04-19T22:45:49.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f3c90003da0 con 0x7f3c98101d00 2024-04-19T22:45:49.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900055e0 con 0x7f3c98101d00 2024-04-19T22:45:49.856 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.852+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a20a0 con 0x7f3c98101d00 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9804ff50 con 0x7f3c98101d00 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 92133+0+0 (secure 0 0 0) 0x7f3c9001d680 con 0x7f3c98101d00 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c95ffb700 1 --2- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 0x7f3c88070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5942+0+0 (secure 0 0 0) 0x7f3c9008f1e0 con 0x7f3c98101d00 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c9c8d2700 1 --2- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 0x7f3c88070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:49.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.856+0000 7f3c9c8d2700 1 --2- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 0x7f3c88070500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c005950 tx=0x7f3c8c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:49.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:49.860+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3c9005caa0 con 0x7f3c98101d00 2024-04-19T22:45:50.021 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:49 smithi178 bash[23441]: cluster 2024-04-19T22:45:48.396482+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:50.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:49 smithi113 bash[28910]: cluster 2024-04-19T22:45:48.396482+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:50.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:49 smithi113 bash[21528]: cluster 2024-04-19T22:45:48.396482+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:50.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.080+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi113=a;smithi178=b", "target": ["mon-mgr", ""]}) -- 0x7f3c98062670 con 0x7f3c8806e040 2024-04-19T22:45:50.094 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.092+0000 7f3c95ffb700 1 -- 172.21.15.178:0/1913729755 <== mgr.14152 v2:172.21.15.113:6800/467518466 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f3c98062670 con 0x7f3c8806e040 2024-04-19T22:45:50.094 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled node-exporter update... 2024-04-19T22:45:50.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 msgr2=0x7f3c88070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:50.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 0x7f3c88070500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c005950 tx=0x7f3c8c0058e0 comp rx=0 tx=0).stop 2024-04-19T22:45:50.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 msgr2=0x7f3c981a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:50.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c900062a0 tx=0x7f3c90009c10 comp rx=0 tx=0).stop 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 shutdown_connections 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> v2:172.21.15.113:6800/467518466 conn(0x7f3c8806e040 0x7f3c88070500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98101d00 0x7f3c981a1320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3c981005d0 0x7f3c98199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 --2- 172.21.15.178:0/1913729755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3c98101340 0x7f3c9819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 >> 172.21.15.178:0/1913729755 conn(0x7f3c980fbf30 msgr2=0x7f3c980fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 shutdown_connections 2024-04-19T22:45:50.097 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:50.096+0000 7f3c9eb36700 1 -- 172.21.15.178:0/1913729755 wait complete. 2024-04-19T22:45:51.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:51 smithi178 bash[23441]: audit 2024-04-19T22:45:50.088090+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi113=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:51.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:51 smithi178 bash[23441]: cephadm 2024-04-19T22:45:50.091822+0000 mgr.y (mgr.14152) 380 : cephadm 1 Saving service node-exporter spec with placement smithi113=a;smithi178=b;count:2 2024-04-19T22:45:51.184 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:51 smithi178 bash[23441]: audit 2024-04-19T22:45:50.098999+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:51.185 DEBUG:teuthology.orchestra.run.smithi113:node-exporter.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.a.service 2024-04-19T22:45:51.188 DEBUG:teuthology.orchestra.run.smithi178:node-exporter.b> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.b.service 2024-04-19T22:45:51.190 INFO:tasks.cephadm:Adding alertmanager.a on smithi113 2024-04-19T22:45:51.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply alertmanager '1;smithi113=a' 2024-04-19T22:45:51.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[21528]: audit 2024-04-19T22:45:50.088090+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi113=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:51.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[21528]: cephadm 2024-04-19T22:45:50.091822+0000 mgr.y (mgr.14152) 380 : cephadm 1 Saving service node-exporter spec with placement smithi113=a;smithi178=b;count:2 2024-04-19T22:45:51.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[21528]: audit 2024-04-19T22:45:50.098999+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:51.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[28910]: audit 2024-04-19T22:45:50.088090+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi113=a;smithi178=b", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:45:51.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[28910]: cephadm 2024-04-19T22:45:50.091822+0000 mgr.y (mgr.14152) 380 : cephadm 1 Saving service node-exporter spec with placement smithi113=a;smithi178=b;count:2 2024-04-19T22:45:51.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:51 smithi113 bash[28910]: audit 2024-04-19T22:45:50.098999+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:52.525 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:52 smithi178 bash[23441]: cluster 2024-04-19T22:45:50.397797+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:52.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:52 smithi113 bash[21528]: cluster 2024-04-19T22:45:50.397797+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:52.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:52 smithi113 bash[28910]: cluster 2024-04-19T22:45:50.397797+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-04-19T22:45:54.009 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.010 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.010 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.010 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.011 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.011 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.011 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:53 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.278 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.278 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.279 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.280 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.280 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.280 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:54 smithi178 bash[23441]: cluster 2024-04-19T22:45:52.398749+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:45:54.280 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:45:54.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:54 smithi113 bash[21528]: cluster 2024-04-19T22:45:52.398749+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:45:54.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:54 smithi113 bash[28910]: cluster 2024-04-19T22:45:52.398749+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:45:54.550 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:54 smithi178 systemd[1]: Started Ceph prometheus.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:45:54.550 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:45:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:45:55.439 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[28910]: audit 2024-04-19T22:45:54.318306+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-04-19T22:45:55.439 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[28910]: audit 2024-04-19T22:45:54.332728+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.439 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[28910]: audit 2024-04-19T22:45:54.347648+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.439 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[28910]: audit 2024-04-19T22:45:54.396291+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.439 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[28910]: audit 2024-04-19T22:45:54.404439+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-19T22:45:55.440 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21528]: audit 2024-04-19T22:45:54.318306+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-04-19T22:45:55.440 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21528]: audit 2024-04-19T22:45:54.332728+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.440 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21528]: audit 2024-04-19T22:45:54.347648+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.440 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21528]: audit 2024-04-19T22:45:54.396291+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.440 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21528]: audit 2024-04-19T22:45:54.404439+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-19T22:45:55.440 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.197Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-04-19T22:45:55.440 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.197Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.197Z caller=main.go:570 level=info host_details="(Linux 5.15.0-105-generic #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 x86_64 smithi178 (none))" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.197Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.197Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.199Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.199Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.200Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.201Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.203Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.203Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.717µs 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.203Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.204Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.204Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=54.915µs wal_replay_duration=409.565µs wbl_replay_duration=100ns total_replay_duration=495.142µs 2024-04-19T22:45:55.441 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.205Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-04-19T22:45:55.442 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.205Z caller=main.go:1029 level=info msg="TSDB started" 2024-04-19T22:45:55.442 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.205Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-04-19T22:45:55.442 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.227Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=22.384247ms db_storage=1.278µs remote_storage=1.189µs web_handler=364ns query_engine=690ns scrape=248.499µs scrape_sd=84.591µs notify=773ns notify_sd=1.383µs rules=21.819334ms tracing=6.691µs 2024-04-19T22:45:55.442 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.227Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-04-19T22:45:55.442 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[48961]: ts=2024-04-19T22:45:55.227Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-04-19T22:45:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[23441]: audit 2024-04-19T22:45:54.318306+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-04-19T22:45:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[23441]: audit 2024-04-19T22:45:54.332728+0000 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[23441]: audit 2024-04-19T22:45:54.347648+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[23441]: audit 2024-04-19T22:45:54.396291+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' 2024-04-19T22:45:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[23441]: audit 2024-04-19T22:45:54.404439+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-19T22:45:55.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21785]: ignoring --setuser ceph since I am not root 2024-04-19T22:45:55.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21785]: ignoring --setgroup ceph since I am not root 2024-04-19T22:45:55.794 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:55 smithi113 bash[21785]: debug 2024-04-19T22:45:55.615+0000 7fdef1c69200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:45:55.800 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[24363]: ignoring --setuser ceph since I am not root 2024-04-19T22:45:55.800 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[24363]: ignoring --setgroup ceph since I am not root 2024-04-19T22:45:55.800 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[24363]: debug 2024-04-19T22:45:55.460+0000 7f83c9560700 1 -- 172.21.15.178:0/2612424509 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba34f0a5a0 con 0x55ba35c88c00 2024-04-19T22:45:55.800 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:55 smithi178 bash[24363]: debug 2024-04-19T22:45:55.608+0000 7f83d3349200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T22:45:56.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: audit 2024-04-19T22:45:54.333170+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:56.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: cluster 2024-04-19T22:45:54.404633+0000 mgr.y (mgr.14152) 384 : cluster 0 pgmap v362: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: audit 2024-04-19T22:45:55.119165+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]': finished 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: cluster 2024-04-19T22:45:55.126125+0000 mon.a (mon.0) 762 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: audit 2024-04-19T22:45:55.402615+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[28910]: cluster 2024-04-19T22:45:55.418239+0000 mon.a (mon.0) 764 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: audit 2024-04-19T22:45:54.333170+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: cluster 2024-04-19T22:45:54.404633+0000 mgr.y (mgr.14152) 384 : cluster 0 pgmap v362: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: audit 2024-04-19T22:45:55.119165+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]': finished 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: cluster 2024-04-19T22:45:55.126125+0000 mon.a (mon.0) 762 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: audit 2024-04-19T22:45:55.402615+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-19T22:45:56.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:56 smithi113 bash[21528]: cluster 2024-04-19T22:45:55.418239+0000 mon.a (mon.0) 764 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-04-19T22:45:56.549 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: audit 2024-04-19T22:45:54.333170+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:45:56.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: cluster 2024-04-19T22:45:54.404633+0000 mgr.y (mgr.14152) 384 : cluster 0 pgmap v362: 132 pgs: 132 active+clean; 583 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:45:56.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: audit 2024-04-19T22:45:55.119165+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]': finished 2024-04-19T22:45:56.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: cluster 2024-04-19T22:45:55.126125+0000 mon.a (mon.0) 762 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-04-19T22:45:56.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: audit 2024-04-19T22:45:55.402615+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.113:0/3405656679' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-19T22:45:56.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:56 smithi178 bash[23441]: cluster 2024-04-19T22:45:55.418239+0000 mon.a (mon.0) 764 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-04-19T22:45:56.986 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:45:57.299 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:57 smithi178 bash[24363]: debug 2024-04-19T22:45:57.216+0000 7f83d3349200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:45:57.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:45:57 smithi178 bash[23441]: cluster 2024-04-19T22:45:56.124917+0000 mon.a (mon.0) 765 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-04-19T22:45:57.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:57 smithi113 bash[21785]: debug 2024-04-19T22:45:57.211+0000 7fdef1c69200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T22:45:57.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:57 smithi113 bash[21785]: debug 2024-04-19T22:45:57.307+0000 7fdef1c69200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:45:57.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:45:57 smithi113 bash[28910]: cluster 2024-04-19T22:45:56.124917+0000 mon.a (mon.0) 765 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-04-19T22:45:57.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:45:57 smithi113 bash[21528]: cluster 2024-04-19T22:45:56.124917+0000 mon.a (mon.0) 765 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-04-19T22:45:57.566 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:57 smithi178 bash[24363]: debug 2024-04-19T22:45:57.316+0000 7f83d3349200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T22:45:57.923 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:57 smithi178 bash[24363]: debug 2024-04-19T22:45:57.564+0000 7f83d3349200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:45:58.043 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:57 smithi113 bash[21785]: debug 2024-04-19T22:45:57.555+0000 7fdef1c69200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T22:45:58.497 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:58 smithi178 bash[24363]: debug 2024-04-19T22:45:58.384+0000 7f83d3349200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:45:58.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:58 smithi113 bash[21785]: debug 2024-04-19T22:45:58.347+0000 7fdef1c69200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T22:45:58.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:58 smithi113 bash[21785]: debug 2024-04-19T22:45:58.459+0000 7fdef1c69200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:45:58.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:58 smithi113 bash[21785]: debug 2024-04-19T22:45:58.567+0000 7fdef1c69200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:45:58.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:58 smithi178 bash[24363]: debug 2024-04-19T22:45:58.496+0000 7f83d3349200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T22:45:58.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:58 smithi178 bash[24363]: debug 2024-04-19T22:45:58.604+0000 7f83d3349200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T22:45:59.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:58 smithi113 bash[21785]: debug 2024-04-19T22:45:58.927+0000 7fdef1c69200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:45:59.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:59 smithi113 bash[21785]: debug 2024-04-19T22:45:59.039+0000 7fdef1c69200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:45:59.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:59 smithi113 bash[21785]: debug 2024-04-19T22:45:59.143+0000 7fdef1c69200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:45:59.299 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:58 smithi178 bash[24363]: debug 2024-04-19T22:45:58.980+0000 7f83d3349200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T22:45:59.299 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:59 smithi178 bash[24363]: debug 2024-04-19T22:45:59.104+0000 7f83d3349200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T22:45:59.299 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:59 smithi178 bash[24363]: debug 2024-04-19T22:45:59.212+0000 7f83d3349200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 -- 172.21.15.178:0/3308245141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef81056a0 msgr2=0x7faef8107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 --2- 172.21.15.178:0/3308245141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef81056a0 0x7faef8107a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faee8009990 tx=0x7faee8009ca0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 -- 172.21.15.178:0/3308245141 shutdown_connections 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 --2- 172.21.15.178:0/3308245141 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faef8107fd0 0x7faef810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 --2- 172.21.15.178:0/3308245141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8102d70 0x7faef8105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 --2- 172.21.15.178:0/3308245141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef81056a0 0x7faef8107a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.472+0000 7faeffadb700 1 -- 172.21.15.178:0/3308245141 >> 172.21.15.178:0/3308245141 conn(0x7faef80fc780 msgr2=0x7faef80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- 172.21.15.178:0/3308245141 shutdown_connections 2024-04-19T22:45:59.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- 172.21.15.178:0/3308245141 wait complete. 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 Processor -- start 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- start start 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8102d70 0x7faef8197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faef81056a0 0x7faef81981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 0x7faef819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7faef810d5c0 con 0x7faef8102d70 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faef810d440 con 0x7faef8107fd0 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7faef810d740 con 0x7faef81056a0 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 0x7faef819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 0x7faef819f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:55408/0 (socket says 172.21.15.178:55408) 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 -- 172.21.15.178:0/2955411825 learned_addr learned my addr 172.21.15.178:0/2955411825 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:45:59.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefd076700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faef81056a0 0x7faef81981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8102d70 0x7faef8197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 -- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faef81056a0 msgr2=0x7faef81981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faef81056a0 0x7faef81981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 -- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8102d70 msgr2=0x7faef8197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8102d70 0x7faef8197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 -- 172.21.15.178:0/2955411825 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef819f860 con 0x7faef8107fd0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faefe078700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 0x7faef819f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faef00094f0 tx=0x7faef000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0004db0 con 0x7faef8107fd0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7faef0009e20 con 0x7faef8107fd0 2024-04-19T22:45:59.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef819fb50 con 0x7faef8107fd0 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0015400 con 0x7faef8107fd0 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef81a0090 con 0x7faef8107fd0 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 92147+0+0 (secure 0 0 0) 0x7faef0015620 con 0x7faef8107fd0 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.476+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef804ff50 con 0x7faef8107fd0 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.480+0000 7faeeeffd700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.480+0000 7faefd877700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/467518466 2024-04-19T22:45:59.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.480+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5943+0+0 (secure 0 0 0) 0x7faef0091380 con 0x7faef8107fd0 2024-04-19T22:45:59.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.480+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T22:45:59.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.484+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7faef0010070 con 0x7faef8107fd0 2024-04-19T22:45:59.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.684+0000 7faefd877700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/467518466 2024-04-19T22:45:59.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.684+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-19T22:45:59.704 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:45:59.704+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 --> v2:172.21.15.113:6800/467518466 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi113=a", "target": ["mon-mgr", ""]}) -- 0x7faef802df90 con 0x7faee406df70 2024-04-19T22:45:59.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:59 smithi113 bash[21785]: debug 2024-04-19T22:45:59.503+0000 7fdef1c69200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:45:59.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:45:59 smithi113 bash[21785]: debug 2024-04-19T22:45:59.747+0000 7fdef1c69200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:46:00.050 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:59 smithi178 bash[24363]: debug 2024-04-19T22:45:59.580+0000 7f83d3349200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T22:46:00.050 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:45:59 smithi178 bash[24363]: debug 2024-04-19T22:45:59.824+0000 7f83d3349200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T22:46:00.086 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:00.088+0000 7faefd877700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/467518466 2024-04-19T22:46:00.087 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:00.088+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-19T22:46:00.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:00 smithi113 bash[21785]: debug 2024-04-19T22:46:00.010+0000 7fdef1c69200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:46:00.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:00 smithi113 bash[21785]: debug 2024-04-19T22:46:00.122+0000 7fdef1c69200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:46:00.477 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:00 smithi178 bash[24363]: debug 2024-04-19T22:46:00.088+0000 7f83d3349200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T22:46:00.477 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:00 smithi178 bash[24363]: debug 2024-04-19T22:46:00.204+0000 7f83d3349200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T22:46:00.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:00 smithi113 bash[21785]: debug 2024-04-19T22:46:00.402+0000 7fdef1c69200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:46:00.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:00 smithi178 bash[24363]: debug 2024-04-19T22:46:00.476+0000 7f83d3349200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T22:46:00.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:00.892+0000 7faefd877700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/467518466 2024-04-19T22:46:00.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:00.892+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-19T22:46:01.177 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:00 smithi113 bash[21785]: debug 2024-04-19T22:46:00.814+0000 7fdef1c69200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:46:01.177 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:01 smithi113 bash[21785]: debug 2024-04-19T22:46:01.054+0000 7fdef1c69200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:46:01.256 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:00 smithi178 bash[24363]: debug 2024-04-19T22:46:00.892+0000 7f83d3349200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:46:01.257 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:01 smithi178 bash[24363]: debug 2024-04-19T22:46:01.132+0000 7f83d3349200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T22:46:01.431 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:01 smithi113 bash[21785]: debug 2024-04-19T22:46:01.178+0000 7fdef1c69200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:46:01.550 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:01 smithi178 bash[24363]: debug 2024-04-19T22:46:01.260+0000 7f83d3349200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T22:46:01.550 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:01 smithi178 bash[24363]: debug 2024-04-19T22:46:01.508+0000 7f83d3349200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:46:01.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:01 smithi113 bash[21785]: debug 2024-04-19T22:46:01.430+0000 7fdef1c69200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T22:46:02.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:02.496+0000 7faefd877700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6800/467518466 2024-04-19T22:46:02.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:02.496+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-19T22:46:02.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:02 smithi113 bash[21785]: debug 2024-04-19T22:46:02.442+0000 7fdef1c69200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:46:02.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:02 smithi113 bash[21785]: debug 2024-04-19T22:46:02.558+0000 7fdef1c69200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:46:02.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:02 smithi178 bash[24363]: debug 2024-04-19T22:46:02.512+0000 7f83d3349200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T22:46:02.799 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:02 smithi178 bash[24363]: debug 2024-04-19T22:46:02.628+0000 7f83d3349200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T22:46:03.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:02 smithi113 bash[21785]: debug 2024-04-19T22:46:02.854+0000 7fdef1c69200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:46:03.293 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:02 smithi113 bash[21785]: debug 2024-04-19T22:46:02.970+0000 7fdef1c69200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:46:03.299 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:02 smithi178 bash[24363]: debug 2024-04-19T22:46:02.924+0000 7f83d3349200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T22:46:03.300 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: debug 2024-04-19T22:46:03.036+0000 7f83d3349200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T22:46:03.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:03.596+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mgrmap(e 18) ==== 91798+0+0 (secure 0 0 0) 0x7faef0056970 con 0x7faef8107fd0 2024-04-19T22:46:03.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:03.596+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 msgr2=0x7faee4070430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-19T22:46:03.593 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:03.596+0000 7faeeeffd700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/467518466 conn(0x7faee406df70 0x7faee4070430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.581477+0000 mon.a (mon.0) 766 : cluster 1 Active manager daemon y restarted 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.581766+0000 mon.a (mon.0) 767 : cluster 1 Activating manager daemon y 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.599291+0000 mon.a (mon.0) 768 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.600157+0000 mon.a (mon.0) 769 : cluster 0 mgrmap e18: y(active, starting, since 0.0184643s), standbys: x 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.602058+0000 mon.a (mon.0) 770 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:46:03.699 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.602259+0000 mon.a (mon.0) 771 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.602489+0000 mon.a (mon.0) 772 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.605303+0000 mon.a (mon.0) 773 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.605463+0000 mon.a (mon.0) 774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.605746+0000 mon.a (mon.0) 775 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.605918+0000 mon.a (mon.0) 776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.606095+0000 mon.a (mon.0) 777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.606359+0000 mon.a (mon.0) 778 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.606632+0000 mon.a (mon.0) 779 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.606881+0000 mon.a (mon.0) 780 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.607070+0000 mon.a (mon.0) 781 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.607335+0000 mon.a (mon.0) 782 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.607527+0000 mon.a (mon.0) 783 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.607723+0000 mon.a (mon.0) 784 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:46:03.700 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: audit 2024-04-19T22:46:03.608138+0000 mon.a (mon.0) 785 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.632520+0000 mon.a (mon.0) 786 : cluster 1 Manager daemon y is now available 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: debug 2024-04-19T22:46:03.426+0000 7fdef1c69200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: debug 2024-04-19T22:46:03.554+0000 7fdef1c69200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: [19/Apr/2024:22:46:03] ENGINE Bus STARTING 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.581477+0000 mon.a (mon.0) 766 : cluster 1 Active manager daemon y restarted 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.581766+0000 mon.a (mon.0) 767 : cluster 1 Activating manager daemon y 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.599291+0000 mon.a (mon.0) 768 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-04-19T22:46:03.701 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.600157+0000 mon.a (mon.0) 769 : cluster 0 mgrmap e18: y(active, starting, since 0.0184643s), standbys: x 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.602058+0000 mon.a (mon.0) 770 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.602259+0000 mon.a (mon.0) 771 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.602489+0000 mon.a (mon.0) 772 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.605303+0000 mon.a (mon.0) 773 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.605463+0000 mon.a (mon.0) 774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.605746+0000 mon.a (mon.0) 775 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.605918+0000 mon.a (mon.0) 776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.606095+0000 mon.a (mon.0) 777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.606359+0000 mon.a (mon.0) 778 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.606632+0000 mon.a (mon.0) 779 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.606881+0000 mon.a (mon.0) 780 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.607070+0000 mon.a (mon.0) 781 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:46:03.702 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.607335+0000 mon.a (mon.0) 782 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:46:03.703 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.607527+0000 mon.a (mon.0) 783 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:46:03.703 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.607723+0000 mon.a (mon.0) 784 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:46:03.703 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: audit 2024-04-19T22:46:03.608138+0000 mon.a (mon.0) 785 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:46:03.703 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.632520+0000 mon.a (mon.0) 786 : cluster 1 Manager daemon y is now available 2024-04-19T22:46:03.739 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: debug 2024-04-19T22:46:03.488+0000 7f83d3349200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: debug 2024-04-19T22:46:03.616+0000 7f83d3349200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: [19/Apr/2024:22:46:03] ENGINE Bus STARTING 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: CherryPy Checker: 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: The Application mounted at '' has an empty config. 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: [19/Apr/2024:22:46:03] ENGINE Serving on http://:::9283 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.581477+0000 mon.a (mon.0) 766 : cluster 1 Active manager daemon y restarted 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.581766+0000 mon.a (mon.0) 767 : cluster 1 Activating manager daemon y 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.599291+0000 mon.a (mon.0) 768 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.600157+0000 mon.a (mon.0) 769 : cluster 0 mgrmap e18: y(active, starting, since 0.0184643s), standbys: x 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.602058+0000 mon.a (mon.0) 770 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-19T22:46:03.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.602259+0000 mon.a (mon.0) 771 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.602489+0000 mon.a (mon.0) 772 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.605303+0000 mon.a (mon.0) 773 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.605463+0000 mon.a (mon.0) 774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.605746+0000 mon.a (mon.0) 775 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.605918+0000 mon.a (mon.0) 776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.606095+0000 mon.a (mon.0) 777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.606359+0000 mon.a (mon.0) 778 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.606632+0000 mon.a (mon.0) 779 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.606881+0000 mon.a (mon.0) 780 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.607070+0000 mon.a (mon.0) 781 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.607335+0000 mon.a (mon.0) 782 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.607527+0000 mon.a (mon.0) 783 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.607723+0000 mon.a (mon.0) 784 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: audit 2024-04-19T22:46:03.608138+0000 mon.a (mon.0) 785 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-19T22:46:03.741 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.632520+0000 mon.a (mon.0) 786 : cluster 1 Manager daemon y is now available 2024-04-19T22:46:04.043 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: CherryPy Checker: 2024-04-19T22:46:04.043 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: The Application mounted at '' has an empty config. 2024-04-19T22:46:04.043 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: [19/Apr/2024:22:46:03] ENGINE Serving on http://:::9283 2024-04-19T22:46:04.043 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:03 smithi113 bash[21785]: [19/Apr/2024:22:46:03] ENGINE Bus STARTED 2024-04-19T22:46:04.050 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:03 smithi178 bash[24363]: [19/Apr/2024:22:46:03] ENGINE Bus STARTED 2024-04-19T22:46:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.596+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mon.1 v2:172.21.15.178:3300/0 8 ==== mgrmap(e 19) ==== 91890+0+0 (secure 0 0 0) 0x7faef00051d0 con 0x7faef8107fd0 2024-04-19T22:46:04.591 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.596+0000 7faeeeffd700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/3719359025 conn(0x7faee4077210 0x7faee4079600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:04.592 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.596+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 --> v2:172.21.15.113:6800/3719359025 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi113=a", "target": ["mon-mgr", ""]}) -- 0x7faef0094e80 con 0x7faee4077210 2024-04-19T22:46:04.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.600+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/3719359025 conn(0x7faee4077210 0x7faee4079600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:04.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.600+0000 7faefd877700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/3719359025 conn(0x7faee4077210 0x7faee4079600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faef81990f0 tx=0x7faef400b410 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.608+0000 7faeeeffd700 1 -- 172.21.15.178:0/2955411825 <== mgr.24389 v2:172.21.15.113:6800/3719359025 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7faef0094e80 con 0x7faee4077210 2024-04-19T22:46:04.605 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled alertmanager update... 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/3719359025 conn(0x7faee4077210 msgr2=0x7faee4079600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 --2- 172.21.15.178:0/2955411825 >> v2:172.21.15.113:6800/3719359025 conn(0x7faee4077210 0x7faee4079600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faef81990f0 tx=0x7faef400b410 comp rx=0 tx=0).stop 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 msgr2=0x7faef819f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 --2- 172.21.15.178:0/2955411825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faef8107fd0 0x7faef819f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faef00094f0 tx=0x7faef000d3b0 comp rx=0 tx=0).stop 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faefe078700 1 -- 172.21.15.178:0/2955411825 reap_dead start 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 shutdown_connections 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 >> 172.21.15.178:0/2955411825 conn(0x7faef80fc780 msgr2=0x7faef81039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 shutdown_connections 2024-04-19T22:46:04.608 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:04.612+0000 7faeffadb700 1 -- 172.21.15.178:0/2955411825 wait complete. 2024-04-19T22:46:05.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.641866+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:46:05.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.642163+0000 mon.a (mon.0) 787 : cluster 0 Standby manager daemon x restarted 2024-04-19T22:46:05.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: cluster 2024-04-19T22:46:03.642267+0000 mon.a (mon.0) 788 : cluster 0 Standby manager daemon x started 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.642654+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.645399+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.645865+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.671069+0000 mon.a (mon.0) 789 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.698357+0000 mon.a (mon.0) 790 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.703937+0000 mon.a (mon.0) 791 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.708999+0000 mon.a (mon.0) 792 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:03.731916+0000 mon.a (mon.0) 793 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:04.533672+0000 mon.a (mon.0) 794 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:04.538438+0000 mon.a (mon.0) 795 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: cluster 2024-04-19T22:46:04.597838+0000 mon.a (mon.0) 796 : cluster 0 mgrmap e19: y(active, since 1.01616s), standbys: x 2024-04-19T22:46:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[21528]: audit 2024-04-19T22:46:04.610799+0000 mon.a (mon.0) 797 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.641866+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:46:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.642163+0000 mon.a (mon.0) 787 : cluster 0 Standby manager daemon x restarted 2024-04-19T22:46:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: cluster 2024-04-19T22:46:03.642267+0000 mon.a (mon.0) 788 : cluster 0 Standby manager daemon x started 2024-04-19T22:46:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.642654+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:46:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.645399+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:46:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.645865+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:46:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.671069+0000 mon.a (mon.0) 789 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.698357+0000 mon.a (mon.0) 790 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.703937+0000 mon.a (mon.0) 791 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.708999+0000 mon.a (mon.0) 792 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:46:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:03.731916+0000 mon.a (mon.0) 793 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:46:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:04.533672+0000 mon.a (mon.0) 794 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:04.538438+0000 mon.a (mon.0) 795 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: cluster 2024-04-19T22:46:04.597838+0000 mon.a (mon.0) 796 : cluster 0 mgrmap e19: y(active, since 1.01616s), standbys: x 2024-04-19T22:46:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:04 smithi113 bash[28910]: audit 2024-04-19T22:46:04.610799+0000 mon.a (mon.0) 797 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.641866+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-04-19T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.642163+0000 mon.a (mon.0) 787 : cluster 0 Standby manager daemon x restarted 2024-04-19T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: cluster 2024-04-19T22:46:03.642267+0000 mon.a (mon.0) 788 : cluster 0 Standby manager daemon x started 2024-04-19T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.642654+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-19T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.645399+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.645865+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.178:0/691351949' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.671069+0000 mon.a (mon.0) 789 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.698357+0000 mon.a (mon.0) 790 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.703937+0000 mon.a (mon.0) 791 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.708999+0000 mon.a (mon.0) 792 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:03.731916+0000 mon.a (mon.0) 793 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:04.533672+0000 mon.a (mon.0) 794 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:04.538438+0000 mon.a (mon.0) 795 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: cluster 2024-04-19T22:46:04.597838+0000 mon.a (mon.0) 796 : cluster 0 mgrmap e19: y(active, since 1.01616s), standbys: x 2024-04-19T22:46:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:04 smithi178 bash[23441]: audit 2024-04-19T22:46:04.610799+0000 mon.a (mon.0) 797 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:05.328 DEBUG:teuthology.orchestra.run.smithi113:alertmanager.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@alertmanager.a.service 2024-04-19T22:46:05.331 INFO:tasks.cephadm:Adding grafana.a on smithi178 2024-04-19T22:46:05.332 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph orch apply grafana '1;smithi178=a' 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cephadm 2024-04-19T22:46:04.484706+0000 mgr.y (mgr.24389) 1 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTING 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cephadm 2024-04-19T22:46:04.586583+0000 mgr.y (mgr.24389) 2 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on http://172.21.15.113:8765 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: audit 2024-04-19T22:46:04.604029+0000 mgr.y (mgr.24389) 3 : audit 0 from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi113=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: audit 2024-04-19T22:46:04.604099+0000 mgr.y (mgr.24389) 4 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cephadm 2024-04-19T22:46:04.606776+0000 mgr.y (mgr.24389) 5 : cephadm 1 Saving service alertmanager spec with placement smithi113=a;count:1 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cluster 2024-04-19T22:46:04.607097+0000 mgr.y (mgr.24389) 6 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cephadm 2024-04-19T22:46:04.712400+0000 mgr.y (mgr.24389) 7 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on https://172.21.15.113:7150 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[21528]: cephadm 2024-04-19T22:46:04.712566+0000 mgr.y (mgr.24389) 8 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTED 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cephadm 2024-04-19T22:46:04.484706+0000 mgr.y (mgr.24389) 1 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTING 2024-04-19T22:46:06.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cephadm 2024-04-19T22:46:04.586583+0000 mgr.y (mgr.24389) 2 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on http://172.21.15.113:8765 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: audit 2024-04-19T22:46:04.604029+0000 mgr.y (mgr.24389) 3 : audit 0 from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi113=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: audit 2024-04-19T22:46:04.604099+0000 mgr.y (mgr.24389) 4 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cephadm 2024-04-19T22:46:04.606776+0000 mgr.y (mgr.24389) 5 : cephadm 1 Saving service alertmanager spec with placement smithi113=a;count:1 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cluster 2024-04-19T22:46:04.607097+0000 mgr.y (mgr.24389) 6 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cephadm 2024-04-19T22:46:04.712400+0000 mgr.y (mgr.24389) 7 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on https://172.21.15.113:7150 2024-04-19T22:46:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:05 smithi113 bash[28910]: cephadm 2024-04-19T22:46:04.712566+0000 mgr.y (mgr.24389) 8 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTED 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cephadm 2024-04-19T22:46:04.484706+0000 mgr.y (mgr.24389) 1 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTING 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cephadm 2024-04-19T22:46:04.586583+0000 mgr.y (mgr.24389) 2 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on http://172.21.15.113:8765 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: audit 2024-04-19T22:46:04.604029+0000 mgr.y (mgr.24389) 3 : audit 0 from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi113=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: audit 2024-04-19T22:46:04.604099+0000 mgr.y (mgr.24389) 4 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cephadm 2024-04-19T22:46:04.606776+0000 mgr.y (mgr.24389) 5 : cephadm 1 Saving service alertmanager spec with placement smithi113=a;count:1 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cluster 2024-04-19T22:46:04.607097+0000 mgr.y (mgr.24389) 6 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cephadm 2024-04-19T22:46:04.712400+0000 mgr.y (mgr.24389) 7 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Serving on https://172.21.15.113:7150 2024-04-19T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:05 smithi178 bash[23441]: cephadm 2024-04-19T22:46:04.712566+0000 mgr.y (mgr.24389) 8 : cephadm 1 [19/Apr/2024:22:46:04] ENGINE Bus STARTED 2024-04-19T22:46:07.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:06 smithi113 bash[28910]: cluster 2024-04-19T22:46:05.607528+0000 mgr.y (mgr.24389) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:07.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:06 smithi113 bash[28910]: cluster 2024-04-19T22:46:06.617219+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-04-19T22:46:07.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:06 smithi113 bash[21528]: cluster 2024-04-19T22:46:05.607528+0000 mgr.y (mgr.24389) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:07.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:06 smithi113 bash[21528]: cluster 2024-04-19T22:46:06.617219+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-04-19T22:46:07.049 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:06 smithi178 bash[23441]: cluster 2024-04-19T22:46:05.607528+0000 mgr.y (mgr.24389) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:07.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:06 smithi178 bash[23441]: cluster 2024-04-19T22:46:06.617219+0000 mon.a (mon.0) 798 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-04-19T22:46:07.793 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:09.043 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:08 smithi113 bash[28910]: cluster 2024-04-19T22:46:07.608355+0000 mgr.y (mgr.24389) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:09.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:08 smithi113 bash[28910]: cluster 2024-04-19T22:46:07.666173+0000 mon.a (mon.0) 799 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-04-19T22:46:09.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:08 smithi113 bash[21528]: cluster 2024-04-19T22:46:07.608355+0000 mgr.y (mgr.24389) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:09.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:08 smithi113 bash[21528]: cluster 2024-04-19T22:46:07.666173+0000 mon.a (mon.0) 799 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-04-19T22:46:09.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:08 smithi178 bash[23441]: cluster 2024-04-19T22:46:07.608355+0000 mgr.y (mgr.24389) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:46:09.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:08 smithi178 bash[23441]: cluster 2024-04-19T22:46:07.666173+0000 mon.a (mon.0) 799 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-04-19T22:46:10.090 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:46:11.043 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[21528]: cluster 2024-04-19T22:46:09.609084+0000 mgr.y (mgr.24389) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[21528]: audit 2024-04-19T22:46:09.787548+0000 mon.a (mon.0) 800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[21528]: audit 2024-04-19T22:46:09.792687+0000 mon.a (mon.0) 801 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[21528]: audit 2024-04-19T22:46:09.923342+0000 mon.a (mon.0) 802 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[21528]: audit 2024-04-19T22:46:09.928406+0000 mon.a (mon.0) 803 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[28910]: cluster 2024-04-19T22:46:09.609084+0000 mgr.y (mgr.24389) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[28910]: audit 2024-04-19T22:46:09.787548+0000 mon.a (mon.0) 800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[28910]: audit 2024-04-19T22:46:09.792687+0000 mon.a (mon.0) 801 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[28910]: audit 2024-04-19T22:46:09.923342+0000 mon.a (mon.0) 802 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:10 smithi113 bash[28910]: audit 2024-04-19T22:46:09.928406+0000 mon.a (mon.0) 803 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:10 smithi178 bash[23441]: cluster 2024-04-19T22:46:09.609084+0000 mgr.y (mgr.24389) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-04-19T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:10 smithi178 bash[23441]: audit 2024-04-19T22:46:09.787548+0000 mon.a (mon.0) 800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:10 smithi178 bash[23441]: audit 2024-04-19T22:46:09.792687+0000 mon.a (mon.0) 801 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:10 smithi178 bash[23441]: audit 2024-04-19T22:46:09.923342+0000 mon.a (mon.0) 802 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:10 smithi178 bash[23441]: audit 2024-04-19T22:46:09.928406+0000 mon.a (mon.0) 803 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.869762+0000 mon.a (mon.0) 804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.879891+0000 mon.a (mon.0) 805 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.882295+0000 mon.a (mon.0) 806 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.883410+0000 mon.a (mon.0) 807 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.884382+0000 mon.a (mon.0) 808 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.885362+0000 mon.a (mon.0) 809 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: cephadm 2024-04-19T22:46:10.886175+0000 mgr.y (mgr.24389) 12 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3804M 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:10.893363+0000 mon.a (mon.0) 810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.311731+0000 mon.a (mon.0) 811 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.321951+0000 mon.a (mon.0) 812 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.324798+0000 mon.a (mon.0) 813 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.326510+0000 mon.a (mon.0) 814 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.328085+0000 mon.a (mon.0) 815 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.329696+0000 mon.a (mon.0) 816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.330975+0000 mgr.y (mgr.24389) 13 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3804M 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.336833+0000 mon.a (mon.0) 817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.341432+0000 mon.a (mon.0) 818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: audit 2024-04-19T22:46:11.342800+0000 mon.a (mon.0) 819 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.344723+0000 mgr.y (mgr.24389) 14 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.345546+0000 mgr.y (mgr.24389) 15 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.869762+0000 mon.a (mon.0) 804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.879891+0000 mon.a (mon.0) 805 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.882295+0000 mon.a (mon.0) 806 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.883410+0000 mon.a (mon.0) 807 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.884382+0000 mon.a (mon.0) 808 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.885362+0000 mon.a (mon.0) 809 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: cephadm 2024-04-19T22:46:10.886175+0000 mgr.y (mgr.24389) 12 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3804M 2024-04-19T22:46:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:10.893363+0000 mon.a (mon.0) 810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.311731+0000 mon.a (mon.0) 811 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.321951+0000 mon.a (mon.0) 812 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.324798+0000 mon.a (mon.0) 813 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.326510+0000 mon.a (mon.0) 814 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.328085+0000 mon.a (mon.0) 815 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.329696+0000 mon.a (mon.0) 816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.330975+0000 mgr.y (mgr.24389) 13 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3804M 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.336833+0000 mon.a (mon.0) 817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.341432+0000 mon.a (mon.0) 818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: audit 2024-04-19T22:46:11.342800+0000 mon.a (mon.0) 819 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.344723+0000 mgr.y (mgr.24389) 14 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:46:12.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:11 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.345546+0000 mgr.y (mgr.24389) 15 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:46:12.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.869762+0000 mon.a (mon.0) 804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.879891+0000 mon.a (mon.0) 805 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.882295+0000 mon.a (mon.0) 806 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.300 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.883410+0000 mon.a (mon.0) 807 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.884382+0000 mon.a (mon.0) 808 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.885362+0000 mon.a (mon.0) 809 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: cephadm 2024-04-19T22:46:10.886175+0000 mgr.y (mgr.24389) 12 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3804M 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:10.893363+0000 mon.a (mon.0) 810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.311731+0000 mon.a (mon.0) 811 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.321951+0000 mon.a (mon.0) 812 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.324798+0000 mon.a (mon.0) 813 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.326510+0000 mon.a (mon.0) 814 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.328085+0000 mon.a (mon.0) 815 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.329696+0000 mon.a (mon.0) 816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.330975+0000 mgr.y (mgr.24389) 13 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3804M 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.336833+0000 mon.a (mon.0) 817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:12.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.341432+0000 mon.a (mon.0) 818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:12.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: audit 2024-04-19T22:46:11.342800+0000 mon.a (mon.0) 819 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:12.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.344723+0000 mgr.y (mgr.24389) 14 : cephadm 1 Updating smithi113:/etc/ceph/ceph.conf 2024-04-19T22:46:12.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:11 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.345546+0000 mgr.y (mgr.24389) 15 : cephadm 1 Updating smithi178:/etc/ceph/ceph.conf 2024-04-19T22:46:12.454 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 -- 172.21.15.178:0/1732833209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 msgr2=0x7fd3bc1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1732833209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc1017c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009990 tx=0x7fd3a4009ca0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 -- 172.21.15.178:0/1732833209 shutdown_connections 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1732833209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1732833209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc1017c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1732833209 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 0x7fd3bc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 -- 172.21.15.178:0/1732833209 >> 172.21.15.178:0/1732833209 conn(0x7fd3bc078180 msgr2=0x7fd3bc078590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 -- 172.21.15.178:0/1732833209 shutdown_connections 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.456+0000 7fd3c17da700 1 -- 172.21.15.178:0/1732833209 wait complete. 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 Processor -- start 2024-04-19T22:46:12.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- start start 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 0x7fd3bc197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc110b60 con 0x7fd3bc1064b0 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1109e0 con 0x7fd3bc1013e0 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc110ce0 con 0x7fd3bc101d90 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:45782/0 (socket says 172.21.15.178:45782) 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 -- 172.21.15.178:0/1327625601 learned_addr learned my addr 172.21.15.178:0/1327625601 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:46:12.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3ba7fc700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 0x7fd3bc197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3bb7fe700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 -- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 msgr2=0x7fd3bc197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 0x7fd3bc197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 -- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 msgr2=0x7fd3bc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 -- 172.21.15.178:0/1327625601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc19bff0 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3bb7fe700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3baffd700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4027070 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc19c280 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd3a4004040 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4022d70 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc1a3b60 con 0x7fd3bc1013e0 2024-04-19T22:46:12.458 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc1028b0 con 0x7fd3bc1013e0 2024-04-19T22:46:12.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fd3a402a070 con 0x7fd3bc1013e0 2024-04-19T22:46:12.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 --2- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 0x7fd3a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:12.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fd3a408efe0 con 0x7fd3bc1013e0 2024-04-19T22:46:12.459 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.460+0000 7fd3ba7fc700 1 --2- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 0x7fd3a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:12.460 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.464+0000 7fd3ba7fc700 1 --2- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 0x7fd3a8070560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005950 tx=0x7fd3ac0058e0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:12.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.468+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd3a4013070 con 0x7fd3bc1013e0 2024-04-19T22:46:12.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.696+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 --> v2:172.21.15.113:6800/3719359025 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}) -- 0x7fd3bc0ff6a0 con 0x7fd3a806e0a0 2024-04-19T22:46:12.709 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.712+0000 7fd3b3fff700 1 -- 172.21.15.178:0/1327625601 <== mgr.24389 v2:172.21.15.113:6800/3719359025 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fd3bc0ff6a0 con 0x7fd3a806e0a0 2024-04-19T22:46:12.709 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled grafana update... 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 msgr2=0x7fd3a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 0x7fd3a8070560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005950 tx=0x7fd3ac0058e0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 msgr2=0x7fd3bc196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a40047b0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 shutdown_connections 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd3a806e0a0 0x7fd3a8070560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3bc1064b0 0x7fd3bc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc1013e0 0x7fd3bc196fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 --2- 172.21.15.178:0/1327625601 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd3bc101d90 0x7fd3bc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 >> 172.21.15.178:0/1327625601 conn(0x7fd3bc078180 msgr2=0x7fd3bc0fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 shutdown_connections 2024-04-19T22:46:12.712 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:12.716+0000 7fd3c17da700 1 -- 172.21.15.178:0/1327625601 wait complete. 2024-04-19T22:46:12.891 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.891 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.891 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.892 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.892 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.892 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.893 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.893 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:12.893 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.149 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.149 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.560693+0000 mgr.y (mgr.24389) 16 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.149 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.561869+0000 mgr.y (mgr.24389) 17 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.149 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cluster 2024-04-19T22:46:11.609753+0000 mgr.y (mgr.24389) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-19T22:46:13.149 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.725533+0000 mgr.y (mgr.24389) 19 : cephadm 1 Updating smithi113:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.727189+0000 mgr.y (mgr.24389) 20 : cephadm 1 Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.890619+0000 mgr.y (mgr.24389) 21 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:11.892477+0000 mgr.y (mgr.24389) 22 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.061250+0000 mon.a (mon.0) 820 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.066592+0000 mon.a (mon.0) 821 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.116323+0000 mon.a (mon.0) 822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.126607+0000 mon.a (mon.0) 823 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.135742+0000 mon.a (mon.0) 824 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: cephadm 2024-04-19T22:46:12.143241+0000 mgr.y (mgr.24389) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi113 2024-04-19T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[28910]: audit 2024-04-19T22:46:12.713723+0000 mon.a (mon.0) 825 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.151 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.151 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.151 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:12 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: Started Ceph node-exporter.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:46:13.152 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.153 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.560693+0000 mgr.y (mgr.24389) 16 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.561869+0000 mgr.y (mgr.24389) 17 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cluster 2024-04-19T22:46:11.609753+0000 mgr.y (mgr.24389) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.725533+0000 mgr.y (mgr.24389) 19 : cephadm 1 Updating smithi113:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.727189+0000 mgr.y (mgr.24389) 20 : cephadm 1 Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.153 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.890619+0000 mgr.y (mgr.24389) 21 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:11.892477+0000 mgr.y (mgr.24389) 22 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.061250+0000 mon.a (mon.0) 820 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.066592+0000 mon.a (mon.0) 821 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.116323+0000 mon.a (mon.0) 822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.126607+0000 mon.a (mon.0) 823 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.135742+0000 mon.a (mon.0) 824 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: cephadm 2024-04-19T22:46:12.143241+0000 mgr.y (mgr.24389) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi113 2024-04-19T22:46:13.154 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[21528]: audit 2024-04-19T22:46:12.713723+0000 mon.a (mon.0) 825 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.560693+0000 mgr.y (mgr.24389) 16 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.561869+0000 mgr.y (mgr.24389) 17 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cluster 2024-04-19T22:46:11.609753+0000 mgr.y (mgr.24389) 18 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.725533+0000 mgr.y (mgr.24389) 19 : cephadm 1 Updating smithi113:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.727189+0000 mgr.y (mgr.24389) 20 : cephadm 1 Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.890619+0000 mgr.y (mgr.24389) 21 : cephadm 1 Updating smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:11.892477+0000 mgr.y (mgr.24389) 22 : cephadm 1 Updating smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.061250+0000 mon.a (mon.0) 820 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.066592+0000 mon.a (mon.0) 821 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.338 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.116323+0000 mon.a (mon.0) 822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.126607+0000 mon.a (mon.0) 823 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.135742+0000 mon.a (mon.0) 824 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: cephadm 2024-04-19T22:46:12.143241+0000 mgr.y (mgr.24389) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi113 2024-04-19T22:46:13.339 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 bash[23441]: audit 2024-04-19T22:46:12.713723+0000 mon.a (mon.0) 825 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:13.340 DEBUG:teuthology.orchestra.run.smithi178:grafana.a> sudo journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@grafana.a.service 2024-04-19T22:46:13.342 INFO:tasks.cephadm:Setting up client nodes... 2024-04-19T22:46:13.342 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-19T22:46:13.543 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:13 smithi113 bash[57322]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-04-19T22:46:14.190 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.191 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.191 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.191 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.191 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.191 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.192 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.192 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.192 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.192 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:13 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:14.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: audit 2024-04-19T22:46:12.702563+0000 mgr.y (mgr.24389) 24 : audit 0 from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:14.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: cephadm 2024-04-19T22:46:12.707025+0000 mgr.y (mgr.24389) 25 : cephadm 1 Saving service grafana spec with placement smithi178=a;count:1 2024-04-19T22:46:14.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: audit 2024-04-19T22:46:13.195212+0000 mon.a (mon.0) 826 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: audit 2024-04-19T22:46:13.202274+0000 mon.a (mon.0) 827 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: audit 2024-04-19T22:46:13.212940+0000 mon.a (mon.0) 828 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[23441]: cephadm 2024-04-19T22:46:13.213787+0000 mgr.y (mgr.24389) 26 : cephadm 1 Deploying daemon node-exporter.b on smithi178 2024-04-19T22:46:14.361 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: audit 2024-04-19T22:46:12.702563+0000 mgr.y (mgr.24389) 24 : audit 0 from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:14.361 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: cephadm 2024-04-19T22:46:12.707025+0000 mgr.y (mgr.24389) 25 : cephadm 1 Saving service grafana spec with placement smithi178=a;count:1 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: audit 2024-04-19T22:46:13.195212+0000 mon.a (mon.0) 826 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: audit 2024-04-19T22:46:13.202274+0000 mon.a (mon.0) 827 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: audit 2024-04-19T22:46:13.212940+0000 mon.a (mon.0) 828 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[28910]: cephadm 2024-04-19T22:46:13.213787+0000 mgr.y (mgr.24389) 26 : cephadm 1 Deploying daemon node-exporter.b on smithi178 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: audit 2024-04-19T22:46:12.702563+0000 mgr.y (mgr.24389) 24 : audit 0 from='client.24466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi178=a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: cephadm 2024-04-19T22:46:12.707025+0000 mgr.y (mgr.24389) 25 : cephadm 1 Saving service grafana spec with placement smithi178=a;count:1 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: audit 2024-04-19T22:46:13.195212+0000 mon.a (mon.0) 826 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: audit 2024-04-19T22:46:13.202274+0000 mon.a (mon.0) 827 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: audit 2024-04-19T22:46:13.212940+0000 mon.a (mon.0) 828 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:14.362 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[21528]: cephadm 2024-04-19T22:46:13.213787+0000 mgr.y (mgr.24389) 26 : cephadm 1 Deploying daemon node-exporter.b on smithi178 2024-04-19T22:46:14.363 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: v1.5.0: Pulling from prometheus/node-exporter 2024-04-19T22:46:14.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:14 smithi178 systemd[1]: Started Ceph node-exporter.b for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:46:14.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[49975]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-04-19T22:46:14.646 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 22b70bddd3ac: Pulling fs layer 2024-04-19T22:46:14.647 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 5c12815fee55: Pulling fs layer 2024-04-19T22:46:14.647 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: c0e87333d380: Pulling fs layer 2024-04-19T22:46:14.647 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 5c12815fee55: Verifying Checksum 2024-04-19T22:46:14.930 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:15.043 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 5c12815fee55: Download complete 2024-04-19T22:46:15.043 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 22b70bddd3ac: Download complete 2024-04-19T22:46:15.043 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: 22b70bddd3ac: Pull complete 2024-04-19T22:46:15.043 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:14 smithi113 bash[57322]: c0e87333d380: Download complete 2024-04-19T22:46:15.044 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:14 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:15.287 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:14 smithi178 bash[49975]: v1.5.0: Pulling from prometheus/node-exporter 2024-04-19T22:46:15.287 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 22b70bddd3ac: Pulling fs layer 2024-04-19T22:46:15.287 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 5c12815fee55: Pulling fs layer 2024-04-19T22:46:15.288 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: c0e87333d380: Pulling fs layer 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: cluster 2024-04-19T22:46:13.610562+0000 mgr.y (mgr.24389) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: audit 2024-04-19T22:46:14.294240+0000 mon.a (mon.0) 829 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: audit 2024-04-19T22:46:14.306032+0000 mon.a (mon.0) 830 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: audit 2024-04-19T22:46:14.337494+0000 mon.a (mon.0) 831 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: audit 2024-04-19T22:46:14.346904+0000 mon.a (mon.0) 832 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: audit 2024-04-19T22:46:14.364160+0000 mon.a (mon.0) 833 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[21528]: cephadm 2024-04-19T22:46:14.403957+0000 mgr.y (mgr.24389) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi113 2024-04-19T22:46:15.544 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[57322]: 5c12815fee55: Pull complete 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: cluster 2024-04-19T22:46:13.610562+0000 mgr.y (mgr.24389) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: audit 2024-04-19T22:46:14.294240+0000 mon.a (mon.0) 829 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: audit 2024-04-19T22:46:14.306032+0000 mon.a (mon.0) 830 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: audit 2024-04-19T22:46:14.337494+0000 mon.a (mon.0) 831 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: audit 2024-04-19T22:46:14.346904+0000 mon.a (mon.0) 832 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: audit 2024-04-19T22:46:14.364160+0000 mon.a (mon.0) 833 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[28910]: cephadm 2024-04-19T22:46:14.403957+0000 mgr.y (mgr.24389) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi113 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 5c12815fee55: Verifying Checksum 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 5c12815fee55: Download complete 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 22b70bddd3ac: Verifying Checksum 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 22b70bddd3ac: Download complete 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: c0e87333d380: Verifying Checksum 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: c0e87333d380: Download complete 2024-04-19T22:46:15.550 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 22b70bddd3ac: Pull complete 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: cluster 2024-04-19T22:46:13.610562+0000 mgr.y (mgr.24389) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: audit 2024-04-19T22:46:14.294240+0000 mon.a (mon.0) 829 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: audit 2024-04-19T22:46:14.306032+0000 mon.a (mon.0) 830 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: audit 2024-04-19T22:46:14.337494+0000 mon.a (mon.0) 831 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: audit 2024-04-19T22:46:14.346904+0000 mon.a (mon.0) 832 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: audit 2024-04-19T22:46:14.364160+0000 mon.a (mon.0) 833 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:15.551 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[23441]: cephadm 2024-04-19T22:46:14.403957+0000 mgr.y (mgr.24389) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi113 2024-04-19T22:46:16.096 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:15 smithi113 bash[57322]: c0e87333d380: Pull complete 2024-04-19T22:46:16.096 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:16 smithi113 bash[57322]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-04-19T22:46:16.268 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:15 smithi178 bash[49975]: 5c12815fee55: Pull complete 2024-04-19T22:46:16.519 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:16 smithi178 bash[49975]: c0e87333d380: Pull complete 2024-04-19T22:46:16.519 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:16 smithi178 bash[49975]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-04-19T22:46:16.519 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:16 smithi178 bash[23441]: audit 2024-04-19T22:46:14.613242+0000 mgr.y (mgr.24389) 29 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:16.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:16 smithi113 bash[28910]: audit 2024-04-19T22:46:14.613242+0000 mgr.y (mgr.24389) 29 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:16.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:16 smithi113 bash[21528]: audit 2024-04-19T22:46:14.613242+0000 mgr.y (mgr.24389) 29 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:16.544 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:16 smithi113 bash[57322]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-04-19T22:46:16.800 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:16 smithi178 bash[49975]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-04-19T22:46:17.550 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[23441]: cluster 2024-04-19T22:46:15.611921+0000 mgr.y (mgr.24389) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-19T22:46:17.806 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:17.807 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:17 smithi113 bash[28910]: cluster 2024-04-19T22:46:15.611921+0000 mgr.y (mgr.24389) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-19T22:46:17.807 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:17 smithi113 bash[21528]: cluster 2024-04-19T22:46:15.611921+0000 mgr.y (mgr.24389) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.795Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.795Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.796Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.796Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-04-19T22:46:18.051 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=arp 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=bcache 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=bonding 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=btrfs 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=conntrack 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=cpu 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=diskstats 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=dmi 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=edac 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=entropy 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=filefd 2024-04-19T22:46:18.052 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=filesystem 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=hwmon 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=infiniband 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=ipvs 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=loadavg 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=mdadm 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=meminfo 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=netclass 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=netdev 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=netstat 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=nfs 2024-04-19T22:46:18.053 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=nfsd 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=nvme 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=os 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=pressure 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=rapl 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=schedstat 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=selinux 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=sockstat 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=softnet 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=stat 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=tapestats 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=textfile 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=time 2024-04-19T22:46:18.054 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=uname 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=vmstat 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=xfs 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.797Z caller=node_exporter.go:117 level=info collector=zfs 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.798Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-04-19T22:46:18.055 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:17 smithi178 bash[49975]: ts=2024-04-19T22:46:17.798Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-04-19T22:46:18.111 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:46:19.759 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[28910]: cluster 2024-04-19T22:46:17.612623+0000 mgr.y (mgr.24389) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:19.759 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[28910]: audit 2024-04-19T22:46:18.704932+0000 mon.a (mon.0) 834 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:19.759 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[28910]: audit 2024-04-19T22:46:18.749902+0000 mon.a (mon.0) 835 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:19.759 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[21528]: cluster 2024-04-19T22:46:17.612623+0000 mgr.y (mgr.24389) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:19.759 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[21528]: audit 2024-04-19T22:46:18.704932+0000 mon.a (mon.0) 834 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:19.760 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[21528]: audit 2024-04-19T22:46:18.749902+0000 mon.a (mon.0) 835 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.473Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.473Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.473Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.473Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-04-19T22:46:19.760 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=arp 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=bcache 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=bonding 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=btrfs 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=conntrack 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=cpu 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=diskstats 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=dmi 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=edac 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=entropy 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=filefd 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=filesystem 2024-04-19T22:46:19.761 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=hwmon 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=infiniband 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=ipvs 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=loadavg 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=mdadm 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=meminfo 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=netclass 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=netdev 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=netstat 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=nfs 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=nfsd 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.474Z caller=node_exporter.go:117 level=info collector=nvme 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=os 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-04-19T22:46:19.762 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=pressure 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=rapl 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=schedstat 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=selinux 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=sockstat 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=softnet 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=stat 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=tapestats 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=textfile 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=time 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=uname 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=vmstat 2024-04-19T22:46:19.763 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=xfs 2024-04-19T22:46:19.764 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=node_exporter.go:117 level=info collector=zfs 2024-04-19T22:46:19.764 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-04-19T22:46:19.764 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:19 smithi113 bash[57322]: ts=2024-04-19T22:46:19.475Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-04-19T22:46:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:19 smithi178 bash[23441]: cluster 2024-04-19T22:46:17.612623+0000 mgr.y (mgr.24389) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:19 smithi178 bash[23441]: audit 2024-04-19T22:46:18.704932+0000 mon.a (mon.0) 834 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:19.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:19 smithi178 bash[23441]: audit 2024-04-19T22:46:18.749902+0000 mon.a (mon.0) 835 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:21.793 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:21 smithi113 bash[21528]: cluster 2024-04-19T22:46:19.614045+0000 mgr.y (mgr.24389) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:21.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:21 smithi113 bash[28910]: cluster 2024-04-19T22:46:19.614045+0000 mgr.y (mgr.24389) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:21.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:21 smithi178 bash[23441]: cluster 2024-04-19T22:46:19.614045+0000 mgr.y (mgr.24389) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-19T22:46:23.466 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:23 smithi113 bash[28910]: cluster 2024-04-19T22:46:21.614773+0000 mgr.y (mgr.24389) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:23.467 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:23 smithi113 bash[21528]: cluster 2024-04-19T22:46:21.614773+0000 mgr.y (mgr.24389) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:23.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:23 smithi178 bash[23441]: cluster 2024-04-19T22:46:21.614773+0000 mgr.y (mgr.24389) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:24.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- 172.21.15.113:0/590305212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe4104e80 msgr2=0x7f6fe4111340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:24.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- 172.21.15.113:0/590305212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe4104e80 0x7f6fe4111340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00b0d0 tx=0x7f6fdc00b3e0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- 172.21.15.113:0/590305212 shutdown_connections 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- 172.21.15.113:0/590305212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe4104e80 0x7f6fe4111340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- 172.21.15.113:0/590305212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe410a570 0x7f6fe410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- 172.21.15.113:0/590305212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe41044c0 0x7f6fe4104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- 172.21.15.113:0/590305212 >> 172.21.15.113:0/590305212 conn(0x7f6fe40fff90 msgr2=0x7f6fe41023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- 172.21.15.113:0/590305212 shutdown_connections 2024-04-19T22:46:24.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- 172.21.15.113:0/590305212 wait complete. 2024-04-19T22:46:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 Processor -- start 2024-04-19T22:46:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- start start 2024-04-19T22:46:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe4104e80 0x7f6fe419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe410a570 0x7f6fe419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4113e90 con 0x7f6fe410a570 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4113d10 con 0x7f6fe4104e80 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.106+0000 7f6fe915f700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe4114010 con 0x7f6fe41044c0 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:47188/0 (socket says 172.21.15.113:47188) 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 -- 172.21.15.113:0/752938204 learned_addr learned my addr 172.21.15.113:0/752938204 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe359e700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe410a570 0x7f6fe419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe259c700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe4104e80 0x7f6fe419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 -- 172.21.15.113:0/752938204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe4104e80 msgr2=0x7f6fe419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe4104e80 0x7f6fe419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 -- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe410a570 msgr2=0x7f6fe419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe410a570 0x7f6fe419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 -- 172.21.15.113:0/752938204 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe419f200 con 0x7f6fe41044c0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe2d9d700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400eb30 tx=0x7f6fd400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400cc90 con 0x7f6fe41044c0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6fd40044d0 con 0x7f6fe41044c0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4010430 con 0x7f6fe41044c0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe915f700 1 -- 172.21.15.113:0/752938204 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe419f4f0 con 0x7f6fe41044c0 2024-04-19T22:46:24.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fe915f700 1 -- 172.21.15.113:0/752938204 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe41a6d70 con 0x7f6fe41044c0 2024-04-19T22:46:24.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc4005120 con 0x7f6fe41044c0 2024-04-19T22:46:24.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f6fd4003f30 con 0x7f6fe41044c0 2024-04-19T22:46:24.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.110+0000 7f6fcbfff700 1 --2- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 0x7f6fcc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:24.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.114+0000 7f6fe259c700 1 --2- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 0x7f6fcc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:24.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.114+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f6fd408e2a0 con 0x7f6fe41044c0 2024-04-19T22:46:24.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.114+0000 7f6fe259c700 1 --2- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 0x7f6fcc070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4114830 tx=0x7f6fd8005cf0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:24.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.118+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6fd405bbe0 con 0x7f6fe41044c0 2024-04-19T22:46:24.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.410+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6fc4005410 con 0x7f6fe41044c0 2024-04-19T22:46:24.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.418+0000 7f6fcbfff700 1 -- 172.21.15.113:0/752938204 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f6fd405f890 con 0x7f6fe41044c0 2024-04-19T22:46:24.415 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2024-04-19T22:46:24.415 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQBA9CJmIcGkGBAANYbCfylGy44sq4QY3AdEtg== 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 msgr2=0x7f6fcc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 0x7f6fcc070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4114830 tx=0x7f6fd8005cf0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 msgr2=0x7f6fe419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400eb30 tx=0x7f6fd400ee40 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 shutdown_connections 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6fcc06e0a0 0x7f6fcc070560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fe410a570 0x7f6fe419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6fe41044c0 0x7f6fe419a1f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 --2- 172.21.15.113:0/752938204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fe4104e80 0x7f6fe419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 >> 172.21.15.113:0/752938204 conn(0x7f6fe40fff90 msgr2=0x7f6fe4108070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:24.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 shutdown_connections 2024-04-19T22:46:24.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:24.422+0000 7f6fc9ffb700 1 -- 172.21.15.113:0/752938204 wait complete. 2024-04-19T22:46:25.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[21528]: cluster 2024-04-19T22:46:23.615572+0000 mgr.y (mgr.24389) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[21528]: audit 2024-04-19T22:46:24.412924+0000 mon.c (mon.2) 16 : audit 1 from='client.? 172.21.15.113:0/752938204' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[21528]: audit 2024-04-19T22:46:24.413281+0000 mon.a (mon.0) 836 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[21528]: audit 2024-04-19T22:46:24.417380+0000 mon.a (mon.0) 837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[28910]: cluster 2024-04-19T22:46:23.615572+0000 mgr.y (mgr.24389) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[28910]: audit 2024-04-19T22:46:24.412924+0000 mon.c (mon.2) 16 : audit 1 from='client.? 172.21.15.113:0/752938204' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[28910]: audit 2024-04-19T22:46:24.413281+0000 mon.a (mon.0) 836 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:25 smithi113 bash[28910]: audit 2024-04-19T22:46:24.417380+0000 mon.a (mon.0) 837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:25.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:25 smithi178 bash[23441]: cluster 2024-04-19T22:46:23.615572+0000 mgr.y (mgr.24389) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:25.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:25 smithi178 bash[23441]: audit 2024-04-19T22:46:24.412924+0000 mon.c (mon.2) 16 : audit 1 from='client.? 172.21.15.113:0/752938204' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:25 smithi178 bash[23441]: audit 2024-04-19T22:46:24.413281+0000 mon.a (mon.0) 836 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:25.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:25 smithi178 bash[23441]: audit 2024-04-19T22:46:24.417380+0000 mon.a (mon.0) 837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:25.984 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:46:25.984 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-19T22:46:25.984 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T22:46:26.008 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-19T22:46:26.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:26 smithi113 bash[21528]: audit 2024-04-19T22:46:24.624452+0000 mgr.y (mgr.24389) 35 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:26.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:26 smithi113 bash[28910]: audit 2024-04-19T22:46:24.624452+0000 mgr.y (mgr.24389) 35 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:26.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:26 smithi178 bash[23441]: audit 2024-04-19T22:46:24.624452+0000 mgr.y (mgr.24389) 35 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:27.688 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:27 smithi113 bash[21528]: cluster 2024-04-19T22:46:25.617126+0000 mgr.y (mgr.24389) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:27.688 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:27.688 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:27 smithi113 bash[28910]: cluster 2024-04-19T22:46:25.617126+0000 mgr.y (mgr.24389) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:27.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:27 smithi178 bash[23441]: cluster 2024-04-19T22:46:25.617126+0000 mgr.y (mgr.24389) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:28.602 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.603 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.603 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.604 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.604 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.604 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.604 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.605 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.605 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.890 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.891 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.891 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.891 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.892 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.892 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.892 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:28.893 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:28 smithi113 systemd[1]: Started Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: cluster 2024-04-19T22:46:27.617743+0000 mgr.y (mgr.24389) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: audit 2024-04-19T22:46:28.897521+0000 mon.a (mon.0) 838 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: audit 2024-04-19T22:46:28.904866+0000 mon.a (mon.0) 839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: audit 2024-04-19T22:46:28.956822+0000 mon.a (mon.0) 840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: audit 2024-04-19T22:46:28.962940+0000 mon.a (mon.0) 841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[21528]: audit 2024-04-19T22:46:29.011486+0000 mon.a (mon.0) 842 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: cluster 2024-04-19T22:46:27.617743+0000 mgr.y (mgr.24389) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: audit 2024-04-19T22:46:28.897521+0000 mon.a (mon.0) 838 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: audit 2024-04-19T22:46:28.904866+0000 mon.a (mon.0) 839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: audit 2024-04-19T22:46:28.956822+0000 mon.a (mon.0) 840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: audit 2024-04-19T22:46:28.962940+0000 mon.a (mon.0) 841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:29 smithi113 bash[28910]: audit 2024-04-19T22:46:29.011486+0000 mon.a (mon.0) 842 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:29.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: cluster 2024-04-19T22:46:27.617743+0000 mgr.y (mgr.24389) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:29.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: audit 2024-04-19T22:46:28.897521+0000 mon.a (mon.0) 838 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: audit 2024-04-19T22:46:28.904866+0000 mon.a (mon.0) 839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: audit 2024-04-19T22:46:28.956822+0000 mon.a (mon.0) 840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: audit 2024-04-19T22:46:28.962940+0000 mon.a (mon.0) 841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:29.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:29 smithi178 bash[23441]: audit 2024-04-19T22:46:29.011486+0000 mon.a (mon.0) 842 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.323Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.323Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.325Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.113 port=9094 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.326Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.357Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.358Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-19T22:46:30.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.361Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-04-19T22:46:30.545 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:30 smithi113 bash[57875]: ts=2024-04-19T22:46:30.361Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-04-19T22:46:30.791 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.b/config 2024-04-19T22:46:31.588 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:31 smithi178 bash[23441]: cluster 2024-04-19T22:46:29.619110+0000 mgr.y (mgr.24389) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:31.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:31 smithi113 bash[28910]: cluster 2024-04-19T22:46:29.619110+0000 mgr.y (mgr.24389) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:31.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:31 smithi113 bash[21528]: cluster 2024-04-19T22:46:29.619110+0000 mgr.y (mgr.24389) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:32.794 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:32 smithi113 bash[57875]: ts=2024-04-19T22:46:32.327Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001076788s 2024-04-19T22:46:33.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1915584825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb4102e90 msgr2=0x7efcb4106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:33.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1915584825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb4102e90 0x7efcb4106ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009990 tx=0x7efc9c009ca0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1915584825 shutdown_connections 2024-04-19T22:46:33.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1915584825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41075c0 0x7efcb410f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1915584825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb41024e0 0x7efcb41028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1915584825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb4102e90 0x7efcb4106ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1915584825 >> 172.21.15.178:0/1915584825 conn(0x7efcb40fdd70 msgr2=0x7efcb4100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:33.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1915584825 shutdown_connections 2024-04-19T22:46:33.104 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1915584825 wait complete. 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 Processor -- start 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- start start 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41024e0 0x7efcb419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 0x7efcb419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4111c80 con 0x7efcb4102e90 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4111b00 con 0x7efcb41075c0 2024-04-19T22:46:33.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4111e00 con 0x7efcb41024e0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:34750/0 (socket says 172.21.15.178:34750) 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 -- 172.21.15.178:0/1329776366 learned_addr learned my addr 172.21.15.178:0/1329776366 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb37fe700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41024e0 0x7efcb419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb2ffd700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 0x7efcb419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 -- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41024e0 msgr2=0x7efcb419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41024e0 0x7efcb419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 -- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 msgr2=0x7efcb419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 0x7efcb419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 -- 172.21.15.178:0/1329776366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb419f390 con 0x7efcb41075c0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb2ffd700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 0x7efcb419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb3fff700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcac007ee0 tx=0x7efcac00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:33.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac00dbd0 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7efcac00dd70 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb419f680 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0059e0 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41a6f00 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb404ff50 con 0x7efcb41075c0 2024-04-19T22:46:33.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.107+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7efcac01a020 con 0x7efcb41075c0 2024-04-19T22:46:33.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.111+0000 7efcb0ff9700 1 --2- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 0x7efca0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:33.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.111+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7efcac08d8d0 con 0x7efcb41075c0 2024-04-19T22:46:33.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.111+0000 7efcb37fe700 1 --2- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 0x7efca0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:33.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.111+0000 7efcb37fe700 1 --2- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 0x7efca0070560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efca4005fd0 tx=0x7efca400a560 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:33.112 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.115+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7efcac010070 con 0x7efcb41075c0 2024-04-19T22:46:33.403 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.403+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7efcb41a70d0 con 0x7efcb41075c0 2024-04-19T22:46:33.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.415+0000 7efcb0ff9700 1 -- 172.21.15.178:0/1329776366 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (secure 0 0 0) 0x7efcac05b190 con 0x7efcb41075c0 2024-04-19T22:46:33.413 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2024-04-19T22:46:33.413 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBJ9CJmaVF2GBAAMMGl1BliXrf5VnAB7odjPQ== 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 msgr2=0x7efca0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 0x7efca0070560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efca4005fd0 tx=0x7efca400a560 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 msgr2=0x7efcb419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcac007ee0 tx=0x7efcac00d3b0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 shutdown_connections 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> v2:172.21.15.113:6800/3719359025 conn(0x7efca006e0a0 0x7efca0070560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcb41075c0 0x7efcb419ec50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcb41024e0 0x7efcb419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 --2- 172.21.15.178:0/1329776366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcb4102e90 0x7efcb419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 >> 172.21.15.178:0/1329776366 conn(0x7efcb40fdd70 msgr2=0x7efcb4074900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:33.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 shutdown_connections 2024-04-19T22:46:33.416 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-19T22:46:33.419+0000 7efcb9fab700 1 -- 172.21.15.178:0/1329776366 wait complete. 2024-04-19T22:46:33.604 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:33 smithi178 bash[23441]: cluster 2024-04-19T22:46:31.619872+0000 mgr.y (mgr.24389) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:33.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:33 smithi113 bash[21528]: cluster 2024-04-19T22:46:31.619872+0000 mgr.y (mgr.24389) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:33.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:33 smithi113 bash[28910]: cluster 2024-04-19T22:46:31.619872+0000 mgr.y (mgr.24389) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:34.068 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-19T22:46:34.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-19T22:46:34.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-19T22:46:34.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T22:46:34.092 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-19T22:46:34.093 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph mgr dump --format=json 2024-04-19T22:46:34.543 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[28910]: audit 2024-04-19T22:46:33.409132+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.178:0/1329776366' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[28910]: audit 2024-04-19T22:46:33.410086+0000 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[28910]: audit 2024-04-19T22:46:33.415452+0000 mon.a (mon.0) 844 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[28910]: audit 2024-04-19T22:46:33.718362+0000 mon.a (mon.0) 845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[28910]: audit 2024-04-19T22:46:33.780167+0000 mon.a (mon.0) 846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[21528]: audit 2024-04-19T22:46:33.409132+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.178:0/1329776366' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[21528]: audit 2024-04-19T22:46:33.410086+0000 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[21528]: audit 2024-04-19T22:46:33.415452+0000 mon.a (mon.0) 844 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:34.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[21528]: audit 2024-04-19T22:46:33.718362+0000 mon.a (mon.0) 845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:34.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:34 smithi113 bash[21528]: audit 2024-04-19T22:46:33.780167+0000 mon.a (mon.0) 846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:34.628 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[23441]: audit 2024-04-19T22:46:33.409132+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.178:0/1329776366' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.628 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[23441]: audit 2024-04-19T22:46:33.410086+0000 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-19T22:46:34.628 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[23441]: audit 2024-04-19T22:46:33.415452+0000 mon.a (mon.0) 844 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-19T22:46:34.628 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[23441]: audit 2024-04-19T22:46:33.718362+0000 mon.a (mon.0) 845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:34.629 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[23441]: audit 2024-04-19T22:46:33.780167+0000 mon.a (mon.0) 846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:35.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: cluster 2024-04-19T22:46:33.620641+0000 mgr.y (mgr.24389) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:34.654489+0000 mon.a (mon.0) 847 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:34.659330+0000 mon.a (mon.0) 848 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.261875+0000 mon.a (mon.0) 849 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.273808+0000 mon.a (mon.0) 850 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.276298+0000 mon.a (mon.0) 851 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.278170+0000 mon.a (mon.0) 852 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.290107+0000 mon.a (mon.0) 853 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21528]: audit 2024-04-19T22:46:35.416828+0000 mon.a (mon.0) 854 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE Bus STOPPING 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE Bus STOPPED 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE Bus STARTING 2024-04-19T22:46:35.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE Serving on http://:::9283 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[21785]: [19/Apr/2024:22:46:35] ENGINE Bus STARTED 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: cluster 2024-04-19T22:46:33.620641+0000 mgr.y (mgr.24389) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:34.654489+0000 mon.a (mon.0) 847 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:34.659330+0000 mon.a (mon.0) 848 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.261875+0000 mon.a (mon.0) 849 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.273808+0000 mon.a (mon.0) 850 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.276298+0000 mon.a (mon.0) 851 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.278170+0000 mon.a (mon.0) 852 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.290107+0000 mon.a (mon.0) 853 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:35 smithi113 bash[28910]: audit 2024-04-19T22:46:35.416828+0000 mon.a (mon.0) 854 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: cluster 2024-04-19T22:46:33.620641+0000 mgr.y (mgr.24389) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:34.654489+0000 mon.a (mon.0) 847 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:34.659330+0000 mon.a (mon.0) 848 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.261875+0000 mon.a (mon.0) 849 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.273808+0000 mon.a (mon.0) 850 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.276298+0000 mon.a (mon.0) 851 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.278170+0000 mon.a (mon.0) 852 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.290107+0000 mon.a (mon.0) 853 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:35 smithi178 bash[23441]: audit 2024-04-19T22:46:35.416828+0000 mon.a (mon.0) 854 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.428 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:36 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: audit 2024-04-19T22:46:34.633235+0000 mgr.y (mgr.24389) 41 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: cephadm 2024-04-19T22:46:35.331537+0000 mgr.y (mgr.24389) 42 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: audit 2024-04-19T22:46:35.425905+0000 mon.a (mon.0) 855 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: audit 2024-04-19T22:46:35.436904+0000 mon.a (mon.0) 856 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: audit 2024-04-19T22:46:35.437993+0000 mgr.y (mgr.24389) 43 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: audit 2024-04-19T22:46:35.444130+0000 mon.a (mon.0) 857 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.428 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:36 smithi178 bash[23441]: cephadm 2024-04-19T22:46:35.475562+0000 mgr.y (mgr.24389) 44 : cephadm 1 Deploying daemon grafana.a on smithi178 2024-04-19T22:46:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: audit 2024-04-19T22:46:34.633235+0000 mgr.y (mgr.24389) 41 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: cephadm 2024-04-19T22:46:35.331537+0000 mgr.y (mgr.24389) 42 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-04-19T22:46:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: audit 2024-04-19T22:46:35.425905+0000 mon.a (mon.0) 855 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: audit 2024-04-19T22:46:35.436904+0000 mon.a (mon.0) 856 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: audit 2024-04-19T22:46:35.437993+0000 mgr.y (mgr.24389) 43 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: audit 2024-04-19T22:46:35.444130+0000 mon.a (mon.0) 857 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[28910]: cephadm 2024-04-19T22:46:35.475562+0000 mgr.y (mgr.24389) 44 : cephadm 1 Deploying daemon grafana.a on smithi178 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: audit 2024-04-19T22:46:34.633235+0000 mgr.y (mgr.24389) 41 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: cephadm 2024-04-19T22:46:35.331537+0000 mgr.y (mgr.24389) 42 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: audit 2024-04-19T22:46:35.425905+0000 mon.a (mon.0) 855 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: audit 2024-04-19T22:46:35.436904+0000 mon.a (mon.0) 856 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: audit 2024-04-19T22:46:35.437993+0000 mgr.y (mgr.24389) 43 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: audit 2024-04-19T22:46:35.444130+0000 mon.a (mon.0) 857 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:36 smithi113 bash[21528]: cephadm 2024-04-19T22:46:35.475562+0000 mgr.y (mgr.24389) 44 : cephadm 1 Deploying daemon grafana.a on smithi178 2024-04-19T22:46:37.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:37 smithi113 bash[21528]: cluster 2024-04-19T22:46:35.621431+0000 mgr.y (mgr.24389) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:37.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:37 smithi113 bash[28910]: cluster 2024-04-19T22:46:35.621431+0000 mgr.y (mgr.24389) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:37.794 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:37.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:37 smithi178 bash[23441]: cluster 2024-04-19T22:46:35.621431+0000 mgr.y (mgr.24389) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:38.096 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:46:39.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:39 smithi113 bash[21528]: cluster 2024-04-19T22:46:37.622035+0000 mgr.y (mgr.24389) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:39.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:39 smithi113 bash[28910]: cluster 2024-04-19T22:46:37.622035+0000 mgr.y (mgr.24389) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:39.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:39 smithi178 bash[23441]: cluster 2024-04-19T22:46:37.622035+0000 mgr.y (mgr.24389) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:40.544 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:46:40 smithi113 bash[57875]: ts=2024-04-19T22:46:40.330Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.004592882s 2024-04-19T22:46:41.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- 172.21.15.113:0/3205084403 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc107660 msgr2=0x7f6cdc10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/3205084403 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc107660 0x7f6cdc10f210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009920 tx=0x7f6ccc009c30 comp rx=0 tx=0).stop 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- 172.21.15.113:0/3205084403 shutdown_connections 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/3205084403 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc107660 0x7f6cdc10f210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/3205084403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/3205084403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc1031b0 0x7f6cdc106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- 172.21.15.113:0/3205084403 >> 172.21.15.113:0/3205084403 conn(0x7f6cdc079110 msgr2=0x7f6cdc079520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- 172.21.15.113:0/3205084403 shutdown_connections 2024-04-19T22:46:41.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- 172.21.15.113:0/3205084403 wait complete. 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 Processor -- start 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- start start 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc1031b0 0x7f6cdc074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc107660 0x7f6cdc074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc111d50 con 0x7f6cdc102800 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc111bd0 con 0x7f6cdc107660 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6ce1faf700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc111ed0 con 0x7f6cdc1031b0 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.269+0000 7f6cdb7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:41268/0 (socket says 172.21.15.113:41268) 2024-04-19T22:46:41.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 -- 172.21.15.113:0/1507218844 learned_addr learned my addr 172.21.15.113:0/1507218844 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdaffd700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc1031b0 0x7f6cdc074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdbfff700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc107660 0x7f6cdc074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 -- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc1031b0 msgr2=0x7f6cdc074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc1031b0 0x7f6cdc074a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 -- 172.21.15.113:0/1507218844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc107660 msgr2=0x7f6cdc074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc107660 0x7f6cdc074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 -- 172.21.15.113:0/1507218844 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc1a6720 con 0x7f6cdc102800 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdb7fe700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e3c0 tx=0x7f6cd400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ee40 con 0x7f6cdc102800 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc1a69b0 con 0x7f6cdc102800 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6cd4003a00 con 0x7f6cdc102800 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004690 con 0x7f6cdc102800 2024-04-19T22:46:41.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc1a6ef0 con 0x7f6cdc102800 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc04ff50 con 0x7f6cdc102800 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f6cd401b030 con 0x7f6cdc102800 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 --2- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 0x7f6cc4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f6cd408dad0 con 0x7f6cdc102800 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdaffd700 1 --2- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 0x7f6cc4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:41.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.273+0000 7f6cdaffd700 1 --2- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 0x7f6cc4070560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc1021d0 tx=0x7f6cd0009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:41.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.281+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6cd4022060 con 0x7f6cdc102800 2024-04-19T22:46:41.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.553+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6cdc1a70c0 con 0x7f6cdc102800 2024-04-19T22:46:41.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.561+0000 7f6cd8ff9700 1 -- 172.21.15.113:0/1507218844 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+175919 (secure 0 0 0) 0x7f6cd4010040 con 0x7f6cdc102800 2024-04-19T22:46:41.563 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:46:41.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 msgr2=0x7f6cc4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:41.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 0x7f6cc4070560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc1021d0 tx=0x7f6cd0009260 comp rx=0 tx=0).stop 2024-04-19T22:46:41.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 msgr2=0x7f6cdc074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:41.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e3c0 tx=0x7f6cd400e6d0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 shutdown_connections 2024-04-19T22:46:41.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cc406e0a0 0x7f6cc4070560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cdc107660 0x7f6cdc074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6cdc102800 0x7f6cdc074530 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 --2- 172.21.15.113:0/1507218844 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6cdc1031b0 0x7f6cdc074a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 >> 172.21.15.113:0/1507218844 conn(0x7f6cdc079110 msgr2=0x7f6cdc100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 shutdown_connections 2024-04-19T22:46:41.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:41.565+0000 7f6ce1faf700 1 -- 172.21.15.113:0/1507218844 wait complete. 2024-04-19T22:46:41.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:41 smithi113 bash[21528]: cluster 2024-04-19T22:46:39.623873+0000 mgr.y (mgr.24389) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:41.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:41 smithi113 bash[28910]: cluster 2024-04-19T22:46:39.623873+0000 mgr.y (mgr.24389) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:41.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:41 smithi178 bash[23441]: cluster 2024-04-19T22:46:39.623873+0000 mgr.y (mgr.24389) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:42.354 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":21,"flags":0,"active_gid":24389,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3719359025}]},"active_addr":"172.21.15.113:6800/3719359025","active_change":"2024-04-19T22:46:03.581659+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24430,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.113:8443/","prometheus":"http://172.21.15.113:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":75,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1894936652}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1237844709}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":3759078803}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":2783951296}]}]} 2024-04-19T22:46:42.359 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-19T22:46:42.359 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-19T22:46:42.359 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-19T22:46:42.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:42 smithi113 bash[21528]: audit 2024-04-19T22:46:41.556334+0000 mon.a (mon.0) 858 : audit 0 from='client.? 172.21.15.113:0/1507218844' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-19T22:46:42.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:42 smithi113 bash[28910]: audit 2024-04-19T22:46:41.556334+0000 mon.a (mon.0) 858 : audit 0 from='client.? 172.21.15.113:0/1507218844' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-19T22:46:42.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:42 smithi178 bash[23441]: audit 2024-04-19T22:46:41.556334+0000 mon.a (mon.0) 858 : audit 0 from='client.? 172.21.15.113:0/1507218844' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-19T22:46:43.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:43 smithi113 bash[28910]: cluster 2024-04-19T22:46:41.624315+0000 mgr.y (mgr.24389) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:43.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:43 smithi113 bash[21528]: cluster 2024-04-19T22:46:41.624315+0000 mgr.y (mgr.24389) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:43.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:43 smithi178 bash[23441]: cluster 2024-04-19T22:46:41.624315+0000 mgr.y (mgr.24389) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:45.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:45.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:45 smithi113 bash[21528]: cluster 2024-04-19T22:46:43.625093+0000 mgr.y (mgr.24389) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:45.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:45 smithi113 bash[28910]: cluster 2024-04-19T22:46:43.625093+0000 mgr.y (mgr.24389) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:45.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:45 smithi178 bash[23441]: cluster 2024-04-19T22:46:43.625093+0000 mgr.y (mgr.24389) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:46.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:46 smithi113 bash[28910]: audit 2024-04-19T22:46:44.644461+0000 mgr.y (mgr.24389) 50 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:46.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:46 smithi113 bash[21528]: audit 2024-04-19T22:46:44.644461+0000 mgr.y (mgr.24389) 50 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:46.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:46 smithi178 bash[23441]: audit 2024-04-19T22:46:44.644461+0000 mgr.y (mgr.24389) 50 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:47.150 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:46:47.740 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:47 smithi178 bash[23441]: cluster 2024-04-19T22:46:45.626639+0000 mgr.y (mgr.24389) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:47 smithi113 bash[28910]: cluster 2024-04-19T22:46:45.626639+0000 mgr.y (mgr.24389) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:47.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:47 smithi113 bash[21528]: cluster 2024-04-19T22:46:45.626639+0000 mgr.y (mgr.24389) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:49.759 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:49 smithi178 bash[23441]: cluster 2024-04-19T22:46:47.627362+0000 mgr.y (mgr.24389) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:49.759 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:49 smithi178 bash[23441]: audit 2024-04-19T22:46:48.810872+0000 mon.a (mon.0) 859 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:49.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:49 smithi113 bash[21528]: cluster 2024-04-19T22:46:47.627362+0000 mgr.y (mgr.24389) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:49.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:49 smithi113 bash[21528]: audit 2024-04-19T22:46:48.810872+0000 mon.a (mon.0) 859 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:49.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:49 smithi113 bash[28910]: cluster 2024-04-19T22:46:47.627362+0000 mgr.y (mgr.24389) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:49.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:49 smithi113 bash[28910]: audit 2024-04-19T22:46:48.810872+0000 mon.a (mon.0) 859 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:46:50.042 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.043 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.043 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.043 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.044 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.044 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.044 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.045 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.045 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:49 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- 172.21.15.113:0/3073474942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 msgr2=0x7fc63c108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- 172.21.15.113:0/3073474942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c108750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc62400faf0 tx=0x7fc62400fe00 comp rx=0 tx=0).stop 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- 172.21.15.113:0/3073474942 shutdown_connections 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- 172.21.15.113:0/3073474942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c10f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- 172.21.15.113:0/3073474942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c108750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- 172.21.15.113:0/3073474942 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c06ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- 172.21.15.113:0/3073474942 >> 172.21.15.113:0/3073474942 conn(0x7fc63c0781e0 msgr2=0x7fc63c0785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- 172.21.15.113:0/3073474942 shutdown_connections 2024-04-19T22:46:50.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- 172.21.15.113:0/3073474942 wait complete. 2024-04-19T22:46:50.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 Processor -- start 2024-04-19T22:46:50.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- start start 2024-04-19T22:46:50.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:50.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c103140 con 0x7fc63c108370 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c102fc0 con 0x7fc63c06b360 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.193+0000 7fc6409c3700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c10fda0 con 0x7fc63c06a9c0 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63ad9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:38774/0 (socket says 172.21.15.113:38774) 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63ad9d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49336/0 (socket says 172.21.15.113:49336) 2024-04-19T22:46:50.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 -- 172.21.15.113:0/541633689 learned_addr learned my addr 172.21.15.113:0/541633689 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc639d9b700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 -- 172.21.15.113:0/541633689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 msgr2=0x7fc63c1964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c1964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 -- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 msgr2=0x7fc63c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 -- 172.21.15.113:0/541633689 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c19afb0 con 0x7fc63c06a9c0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63ad9d700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc639d9b700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c1964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc63a59c700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc624019040 tx=0x7fc62400f300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624025070 con 0x7fc63c06a9c0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c19b240 con 0x7fc63c06a9c0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc624021460 con 0x7fc63c06a9c0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624017680 con 0x7fc63c06a9c0 2024-04-19T22:46:50.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c1a2b20 con 0x7fc63c06a9c0 2024-04-19T22:46:50.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63c04ff50 con 0x7fc63c06a9c0 2024-04-19T22:46:50.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fc624028070 con 0x7fc63c06a9c0 2024-04-19T22:46:50.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 --2- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 0x7fc628070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:50.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fc624093120 con 0x7fc63c06a9c0 2024-04-19T22:46:50.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc639d9b700 1 --2- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 0x7fc628070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:50.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.197+0000 7fc639d9b700 1 --2- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 0x7fc628070560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc63c078850 tx=0x7fc62c009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:50.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.205+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc6240609e0 con 0x7fc63c06a9c0 2024-04-19T22:46:50.295 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.296 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.296 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.296 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.297 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.297 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.297 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.297 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.297 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.298 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.298 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.298 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: Started Ceph grafana.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:46:50.298 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.298 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 22:46:50 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T22:46:50.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.409+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc63c02db30 con 0x7fc63c06a9c0 2024-04-19T22:46:50.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6337fe700 1 -- 172.21.15.113:0/541633689 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+21003 (secure 0 0 0) 0x7fc624009e20 con 0x7fc63c06a9c0 2024-04-19T22:46:50.410 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:46:50.410 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":75,"fsid":"dd3df874-fe9c-11ee-bc92-c7b262605968","created":"2024-04-19T22:34:47.152859+0000","modified":"2024-04-19T22:46:03.581522+0000","last_up_change":"2024-04-19T22:44:26.046461+0000","last_in_change":"2024-04-19T22:44:00.330026+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T22:40:10.861972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-04-19T22:45:07.492777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-04-19T22:45:09.096820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-04-19T22:45:10.760613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-04-19T22:45:11.243435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-04-19T22:45:13.724458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf68f079-0f8d-4dca-8791-8e3fe35c1d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":947963826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":947963826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":947963826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6803","nonce":947963826}]},"public_addr":"172.21.15.113:6801/947963826","cluster_addr":"172.21.15.113:6802/947963826","heartbeat_back_addr":"172.21.15.113:6804/947963826","heartbeat_front_addr":"172.21.15.113:6803/947963826","state":["exists","up"]},{"osd":1,"uuid":"88cfae52-7613-4c00-91bc-ffb48af3915d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3290228916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3290228916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":3290228916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6807","nonce":3290228916}]},"public_addr":"172.21.15.113:6805/3290228916","cluster_addr":"172.21.15.113:6806/3290228916","heartbeat_back_addr":"172.21.15.113:6808/3290228916","heartbeat_front_addr":"172.21.15.113:6807/3290228916","state":["exists","up"]},{"osd":2,"uuid":"2cb5d205-e57e-41c2-ad9d-1963cd39ad8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":2132568950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":2132568950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2132568950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":2132568950}]},"public_addr":"172.21.15.113:6809/2132568950","cluster_addr":"172.21.15.113:6810/2132568950","heartbeat_back_addr":"172.21.15.113:6812/2132568950","heartbeat_front_addr":"172.21.15.113:6811/2132568950","state":["exists","up"]},{"osd":3,"uuid":"f37fb43e-3da1-49da-a486-e4e4ec9328fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":1760998485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1760998485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1760998485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":1760998485}]},"public_addr":"172.21.15.113:6813/1760998485","cluster_addr":"172.21.15.113:6814/1760998485","heartbeat_back_addr":"172.21.15.113:6816/1760998485","heartbeat_front_addr":"172.21.15.113:6815/1760998485","state":["exists","up"]},{"osd":4,"uuid":"fb1d832c-ddaf-4a8e-943f-b6af469c3102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2100817193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6801","nonce":2100817193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2100817193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2100817193}]},"public_addr":"172.21.15.178:6800/2100817193","cluster_addr":"172.21.15.178:6801/2100817193","heartbeat_back_addr":"172.21.15.178:6803/2100817193","heartbeat_front_addr":"172.21.15.178:6802/2100817193","state":["exists","up"]},{"osd":5,"uuid":"1cb4fd11-e8ba-4531-8f77-cad3a865b53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2719719766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2719719766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2719719766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2719719766}]},"public_addr":"172.21.15.178:6804/2719719766","cluster_addr":"172.21.15.178:6805/2719719766","heartbeat_back_addr":"172.21.15.178:6807/2719719766","heartbeat_front_addr":"172.21.15.178:6806/2719719766","state":["exists","up"]},{"osd":6,"uuid":"4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2545851179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2545851179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2545851179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":2545851179}]},"public_addr":"172.21.15.178:6808/2545851179","cluster_addr":"172.21.15.178:6809/2545851179","heartbeat_back_addr":"172.21.15.178:6811/2545851179","heartbeat_front_addr":"172.21.15.178:6810/2545851179","state":["exists","up"]},{"osd":7,"uuid":"95319baf-3d59-43e3-820c-decd5a03bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1965706255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":1965706255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":1965706255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1965706255}]},"public_addr":"172.21.15.178:6812/1965706255","cluster_addr":"172.21.15.178:6813/1965706255","heartbeat_back_addr":"172.21.15.178:6815/1965706255","heartbeat_front_addr":"172.21.15.178:6814/1965706255","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:38:20.395451+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:39:13.872631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:40:06.914513+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:01.835109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:52.051583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:42:42.788939+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:43:32.712514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:44:24.151921+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:0/2937751484":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/3327923552":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/467518466":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/2227053540":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/3152323235":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/3425154508":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/1796898942":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/4182507758":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/2646177015":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3413585980":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/138586898":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3535526494":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/1810151022":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/2885784740":"2024-04-20T22:35:19.772443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 msgr2=0x7fc628070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 0x7fc628070560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc63c078850 tx=0x7fc62c009260 comp rx=0 tx=0).stop 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 msgr2=0x7fc63c195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc624019040 tx=0x7fc62400f300 comp rx=0 tx=0).stop 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 shutdown_connections 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc62806e0a0 0x7fc628070560 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63c108370 0x7fc63c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc63c06a9c0 0x7fc63c195fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 --2- 172.21.15.113:0/541633689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c06b360 0x7fc63c1964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:50.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 >> 172.21.15.113:0/541633689 conn(0x7fc63c0781e0 msgr2=0x7fc63c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:50.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 shutdown_connections 2024-04-19T22:46:50.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:50.413+0000 7fc6409c3700 1 -- 172.21.15.113:0/541633689 wait complete. 2024-04-19T22:46:51.145 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-19T22:46:51.146 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323344211Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323539718Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323554097Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323558149Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323576025Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323581996Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323590995Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323595086Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323599386Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323605434Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-04-19T22:46:51.345 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323609926Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323614505Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323619187Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323624357Z level=info msg="Path Home" path=/usr/share/grafana 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323629704Z level=info msg="Path Data" path=/var/lib/grafana 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323635577Z level=info msg="Path Logs" path=/var/log/grafana 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323640074Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323644748Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=settings t=2024-04-19T22:46:51.323649544Z level=info msg="App mode production" 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=sqlstore t=2024-04-19T22:46:51.323713136Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=sqlstore t=2024-04-19T22:46:51.323737439Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.324759108Z level=info msg="Starting DB migrations" 2024-04-19T22:46:51.346 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.324856656Z level=info msg="Executing migration" id="create migration_log table" 2024-04-19T22:46:51.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: cluster 2024-04-19T22:46:49.628708+0000 mgr.y (mgr.24389) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:51.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.349638+0000 mon.a (mon.0) 860 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.360640+0000 mon.a (mon.0) 861 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.399579+0000 mon.a (mon.0) 862 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.406493+0000 mon.a (mon.0) 863 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.413489+0000 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.113:0/541633689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.455924+0000 mon.a (mon.0) 864 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:50.985084+0000 mon.a (mon.0) 865 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[28910]: audit 2024-04-19T22:46:51.000079+0000 mon.a (mon.0) 866 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: cluster 2024-04-19T22:46:49.628708+0000 mgr.y (mgr.24389) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.349638+0000 mon.a (mon.0) 860 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.360640+0000 mon.a (mon.0) 861 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.399579+0000 mon.a (mon.0) 862 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.406493+0000 mon.a (mon.0) 863 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.413489+0000 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.113:0/541633689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.455924+0000 mon.a (mon.0) 864 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:50.985084+0000 mon.a (mon.0) 865 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:51 smithi113 bash[21528]: audit 2024-04-19T22:46:51.000079+0000 mon.a (mon.0) 866 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.618 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.378691496Z level=info msg="Executing migration" id="create user table" 2024-04-19T22:46:51.618 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.395467196Z level=info msg="Executing migration" id="add unique index user.login" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.412628456Z level=info msg="Executing migration" id="add unique index user.email" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.454656982Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.479840449Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.505065959Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.547314782Z level=info msg="Executing migration" id="create user table v2" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.572670056Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.597812003Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.623249315Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-04-19T22:46:51.619 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: cluster 2024-04-19T22:46:49.628708+0000 mgr.y (mgr.24389) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:51.619 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.349638+0000 mon.a (mon.0) 860 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.619 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.360640+0000 mon.a (mon.0) 861 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.399579+0000 mon.a (mon.0) 862 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.406493+0000 mon.a (mon.0) 863 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.413489+0000 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.113:0/541633689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.455924+0000 mon.a (mon.0) 864 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:50.985084+0000 mon.a (mon.0) 865 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.620 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[23441]: audit 2024-04-19T22:46:51.000079+0000 mon.a (mon.0) 866 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.648376728Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.673711033Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.698873329Z level=info msg="Executing migration" id="Update user table charset" 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.724197344Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.749316309Z level=info msg="Executing migration" id="Add missing user data" 2024-04-19T22:46:51.871 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.791380771Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-04-19T22:46:51.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.808331137Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-04-19T22:46:51.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.825230054Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-04-19T22:46:51.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.842159416Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-04-19T22:46:51.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.875848468Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.892782187Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.926461402Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.968399783Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:51 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:51.993643294Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.03571064Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.060933608Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.086166877Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.111426438Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-04-19T22:46:52.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.136694342Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.161884391Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.187229614Z level=info msg="Executing migration" id="create temp_user v2" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.229155204Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.271063011Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.296627495Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.338571261Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-04-19T22:46:52.384 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.389050541Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-04-19T22:46:52.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.405790892Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.422720725Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.439613666Z level=info msg="Executing migration" id="create star table" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.456512523Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.473267707Z level=info msg="Executing migration" id="create org table v1" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.548861637Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.574047006Z level=info msg="Executing migration" id="create org_user table v1" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.616155136Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-04-19T22:46:52.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.641259377Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-04-19T22:46:52.897 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.666620149Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-04-19T22:46:52.897 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.691854844Z level=info msg="Executing migration" id="Update org table charset" 2024-04-19T22:46:52.897 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.717076492Z level=info msg="Executing migration" id="Update org_user table charset" 2024-04-19T22:46:52.897 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.742279671Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-04-19T22:46:52.897 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.767529263Z level=info msg="Executing migration" id="create dashboard table" 2024-04-19T22:46:52.898 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.809537937Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-04-19T22:46:52.898 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.851523436Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-04-19T22:46:52.898 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.876954124Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-04-19T22:46:52.898 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.902132346Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-04-19T22:46:53.149 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.927388471Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.969287312Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:52 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:52.994568552Z level=info msg="Executing migration" id="create dashboard v2" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.036518439Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.06181523Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.087092112Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.129067727Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-04-19T22:46:53.150 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.154352864Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-04-19T22:46:53.418 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[23441]: cluster 2024-04-19T22:46:51.629401+0000 mgr.y (mgr.24389) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.179472613Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.230128484Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.272082895Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.297300348Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.339293776Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.381344811Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-04-19T22:46:53.419 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.423465652Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-04-19T22:46:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.448755207Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-04-19T22:46:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.473971893Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-04-19T22:46:53.671 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.499050972Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.541205013Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.566332458Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.591706345Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.616968576Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.642216542Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.659171422Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-04-19T22:46:53.672 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.676063254Z level=info msg="Executing migration" id="Update dashboard title length" 2024-04-19T22:46:53.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:53 smithi113 bash[28910]: cluster 2024-04-19T22:46:51.629401+0000 mgr.y (mgr.24389) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:53.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:53 smithi113 bash[21528]: cluster 2024-04-19T22:46:51.629401+0000 mgr.y (mgr.24389) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:53.924 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.709691574Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-04-19T22:46:53.924 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.74344796Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-04-19T22:46:53.924 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.760423413Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-04-19T22:46:53.924 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.78563328Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-04-19T22:46:53.925 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.827632457Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-04-19T22:46:53.925 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.852909152Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-04-19T22:46:53.925 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.878116328Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-04-19T22:46:53.925 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.903298312Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-04-19T22:46:53.925 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.928576704Z level=info msg="Executing migration" id="Add check_sum column" 2024-04-19T22:46:54.176 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:53 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:53.970523782Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-04-19T22:46:54.176 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.012266668Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-04-19T22:46:54.176 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.054362007Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-04-19T22:46:54.176 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.079869738Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-04-19T22:46:54.176 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.10518054Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-04-19T22:46:54.177 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.130452087Z level=info msg="Executing migration" id="create data_source table" 2024-04-19T22:46:54.177 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.155679927Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-04-19T22:46:54.177 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.181049293Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-04-19T22:46:54.428 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.22312257Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.265088439Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.298744206Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.315776646Z level=info msg="Executing migration" id="create data_source table v2" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.34937055Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.383136915Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.408303257Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-04-19T22:46:54.429 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.43342916Z level=info msg="Executing migration" id="Add column with_credentials" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.458759578Z level=info msg="Executing migration" id="Add secure json data column" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.483977209Z level=info msg="Executing migration" id="Update data_source table charset" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.525955145Z level=info msg="Executing migration" id="Update initial version to 1" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.551232801Z level=info msg="Executing migration" id="Add read_only data column" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.593158355Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-04-19T22:46:54.681 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.635165314Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-04-19T22:46:54.682 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.66898004Z level=info msg="Executing migration" id="Add uid column" 2024-04-19T22:46:54.682 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.685860696Z level=info msg="Executing migration" id="Update uid value" 2024-04-19T22:46:54.934 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[23441]: cluster 2024-04-19T22:46:53.630094+0000 mgr.y (mgr.24389) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:54.934 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[23441]: audit 2024-04-19T22:46:53.730783+0000 mon.a (mon.0) 867 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:54.934 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.702782218Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-04-19T22:46:54.934 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.719743979Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.753408495Z level=info msg="Executing migration" id="create api_key table" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.778706838Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.820807385Z level=info msg="Executing migration" id="add index api_key.key" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.862809364Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.888141305Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.913515092Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-04-19T22:46:54.935 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.938824172Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-04-19T22:46:55.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:54 smithi113 bash[28910]: cluster 2024-04-19T22:46:53.630094+0000 mgr.y (mgr.24389) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:55.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:54 smithi113 bash[28910]: audit 2024-04-19T22:46:53.730783+0000 mon.a (mon.0) 867 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:55.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:54 smithi113 bash[21528]: cluster 2024-04-19T22:46:53.630094+0000 mgr.y (mgr.24389) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:55.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:54 smithi113 bash[21528]: audit 2024-04-19T22:46:53.730783+0000 mon.a (mon.0) 867 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:55.203 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:54 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:54.980782578Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-04-19T22:46:55.203 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.006051904Z level=info msg="Executing migration" id="create api_key table v2" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.047892548Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.073210105Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.098480198Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.123788756Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.165719018Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-04-19T22:46:55.204 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.20810139Z level=info msg="Executing migration" id="Update api_key table charset" 2024-04-19T22:46:55.426 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.233071917Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.258329488Z level=info msg="Executing migration" id="Add service account foreign key" 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.300186235Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.325408306Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.359077462Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-04-19T22:46:55.456 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.376041803Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-04-19T22:46:55.457 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.393001585Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-04-19T22:46:55.457 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.409868558Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-04-19T22:46:55.457 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.426791804Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-04-19T22:46:55.457 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.443725403Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-04-19T22:46:55.457 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.460623972Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-04-19T22:46:55.716 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.485900713Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-04-19T22:46:55.716 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.527777683Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.553070596Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.578297474Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.62030933Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.645577126Z level=info msg="Executing migration" id="create quota table v1" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.670854313Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.696009935Z level=info msg="Executing migration" id="Update quota table charset" 2024-04-19T22:46:55.717 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.721214138Z level=info msg="Executing migration" id="create plugin_setting table" 2024-04-19T22:46:55.731 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:55 smithi113 bash[21528]: audit 2024-04-19T22:46:54.646646+0000 mgr.y (mgr.24389) 56 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:55.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[23441]: audit 2024-04-19T22:46:54.646646+0000 mgr.y (mgr.24389) 56 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:55.969 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.763986433Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-04-19T22:46:55.969 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.805883756Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-04-19T22:46:55.969 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.872851157Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-04-19T22:46:55.969 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.898257569Z level=info msg="Executing migration" id="create session table" 2024-04-19T22:46:55.970 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.923602165Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-04-19T22:46:55.970 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:55 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:55.973785514Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-04-19T22:46:56.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:55 smithi113 bash[28910]: audit 2024-04-19T22:46:54.646646+0000 mgr.y (mgr.24389) 56 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.015675441Z level=info msg="Executing migration" id="create playlist table v2" 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.041137609Z level=info msg="Executing migration" id="create playlist item table v2" 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.082838348Z level=info msg="Executing migration" id="Update playlist table charset" 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.175168815Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.21703996Z level=info msg="Executing migration" id="drop preferences table v2" 2024-04-19T22:46:56.254 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.259072818Z level=info msg="Executing migration" id="drop preferences table v3" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.292726869Z level=info msg="Executing migration" id="create preferences table v3" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.309629643Z level=info msg="Executing migration" id="Update preferences table charset" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.326569248Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.343421527Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.377565308Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.394135641Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-04-19T22:46:56.510 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.436119617Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-04-19T22:46:56.511 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.461312416Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-04-19T22:46:56.511 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.486539494Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-04-19T22:46:56.511 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.511864969Z level=info msg="Executing migration" id="create alert table v1" 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.536992463Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.562299426Z level=info msg="Executing migration" id="add index alert state" 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.587562532Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.629567646Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.672016533Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-04-19T22:46:56.776 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.6971745Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-04-19T22:46:56.777 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.73919268Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-04-19T22:46:56.777 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.781245242Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.823295785Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.865491772Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.890690263Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.915903272Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.941123579Z level=info msg="Executing migration" id="Add column is_default" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:56 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:56.983322538Z level=info msg="Executing migration" id="Add column frequency" 2024-04-19T22:46:57.029 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.033608171Z level=info msg="Executing migration" id="Add column send_reminder" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.075699666Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.117613746Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.159662492Z level=info msg="Executing migration" id="Update alert table charset" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.201698092Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.226922462Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.269034159Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-04-19T22:46:57.281 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.285912009Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-04-19T22:46:57.282 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[23441]: cluster 2024-04-19T22:46:55.630819+0000 mgr.y (mgr.24389) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:57.282 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[23441]: audit 2024-04-19T22:46:56.049700+0000 mon.a (mon.0) 868 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.282 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[23441]: audit 2024-04-19T22:46:56.059486+0000 mon.a (mon.0) 869 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[21528]: cluster 2024-04-19T22:46:55.630819+0000 mgr.y (mgr.24389) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[21528]: audit 2024-04-19T22:46:56.049700+0000 mon.a (mon.0) 868 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[21528]: audit 2024-04-19T22:46:56.059486+0000 mon.a (mon.0) 869 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[28910]: cluster 2024-04-19T22:46:55.630819+0000 mgr.y (mgr.24389) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[28910]: audit 2024-04-19T22:46:56.049700+0000 mon.a (mon.0) 868 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[28910]: audit 2024-04-19T22:46:56.059486+0000 mon.a (mon.0) 869 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.302964007Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.319822999Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.336744612Z level=info msg="Executing migration" id="Add for to alert table" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.353582262Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.370524682Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.412447128Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.437752973Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.462971101Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.488178365Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.51335901Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-04-19T22:46:57.543 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.547232951Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.572470247Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.597814832Z level=info msg="Executing migration" id="create annotation table v5" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.62299681Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.6482679Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.690410128Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.715550547Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.74082515Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.766086774Z level=info msg="Executing migration" id="Update annotation table charset" 2024-04-19T22:46:57.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.791206126Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-04-19T22:46:58.011 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:46:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:46:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:46:58.080 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.833182034Z level=info msg="Executing migration" id="Drop category_id index" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.875180515Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.900423942Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.925735574Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.967644496Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:57 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:57.99287498Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.043214282Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-04-19T22:46:58.081 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.085281437Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: audit 2024-04-19T22:46:57.094980+0000 mon.a (mon.0) 870 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: audit 2024-04-19T22:46:57.106833+0000 mon.a (mon.0) 871 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: audit 2024-04-19T22:46:57.109634+0000 mon.a (mon.0) 872 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: audit 2024-04-19T22:46:57.111504+0000 mon.a (mon.0) 873 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: audit 2024-04-19T22:46:57.123649+0000 mon.a (mon.0) 874 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: cephadm 2024-04-19T22:46:57.201498+0000 mgr.y (mgr.24389) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-04-19T22:46:58.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[23441]: cephadm 2024-04-19T22:46:57.205815+0000 mgr.y (mgr.24389) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi113 2024-04-19T22:46:58.350 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.127418137Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.169267106Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.194621878Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.219905309Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.245115344Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.287036382Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.312356952Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-04-19T22:46:58.351 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.354377371Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-04-19T22:46:58.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: audit 2024-04-19T22:46:57.094980+0000 mon.a (mon.0) 870 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: audit 2024-04-19T22:46:57.106833+0000 mon.a (mon.0) 871 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: audit 2024-04-19T22:46:57.109634+0000 mon.a (mon.0) 872 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: audit 2024-04-19T22:46:57.111504+0000 mon.a (mon.0) 873 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: audit 2024-04-19T22:46:57.123649+0000 mon.a (mon.0) 874 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: cephadm 2024-04-19T22:46:57.201498+0000 mgr.y (mgr.24389) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[28910]: cephadm 2024-04-19T22:46:57.205815+0000 mgr.y (mgr.24389) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi113 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: audit 2024-04-19T22:46:57.094980+0000 mon.a (mon.0) 870 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: audit 2024-04-19T22:46:57.106833+0000 mon.a (mon.0) 871 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: audit 2024-04-19T22:46:57.109634+0000 mon.a (mon.0) 872 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:46:58.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: audit 2024-04-19T22:46:57.111504+0000 mon.a (mon.0) 873 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:46:58.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: audit 2024-04-19T22:46:57.123649+0000 mon.a (mon.0) 874 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:46:58.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: cephadm 2024-04-19T22:46:57.201498+0000 mgr.y (mgr.24389) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-04-19T22:46:58.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:58 smithi113 bash[21528]: cephadm 2024-04-19T22:46:57.205815+0000 mgr.y (mgr.24389) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi113 2024-04-19T22:46:58.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.371235376Z level=info msg="Executing migration" id="Add epoch_end column" 2024-04-19T22:46:58.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.388134275Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-04-19T22:46:58.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.421865023Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-04-19T22:46:58.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.455667359Z level=info msg="Executing migration" id="Move region to single row" 2024-04-19T22:46:58.636 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.480983056Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-04-19T22:46:58.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.506232864Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-04-19T22:46:58.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.531487081Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-04-19T22:46:58.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.573502984Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-04-19T22:46:58.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.598731642Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-04-19T22:46:58.637 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.64084256Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-04-19T22:46:58.905 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.657740578Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-04-19T22:46:58.905 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.674673099Z level=info msg="Executing migration" id="create test_data table" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.691628876Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.708452596Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.742163594Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.767318308Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.817565158Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.842936177Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-04-19T22:46:58.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.88491609Z level=info msg="Executing migration" id="create team table" 2024-04-19T22:46:59.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 -- 172.21.15.113:0/4149020648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe570106910 msgr2=0x7fe570106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:59.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 --2- 172.21.15.113:0/4149020648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe570106910 0x7fe570106cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5680098f0 tx=0x7fe568009c00 comp rx=0 tx=0).stop 2024-04-19T22:46:59.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 -- 172.21.15.113:0/4149020648 shutdown_connections 2024-04-19T22:46:59.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 --2- 172.21.15.113:0/4149020648 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe5701012d0 0x7fe57010d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 --2- 172.21.15.113:0/4149020648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe570106910 0x7fe570106cf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 --2- 172.21.15.113:0/4149020648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 0x7fe570100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 -- 172.21.15.113:0/4149020648 >> 172.21.15.113:0/4149020648 conn(0x7fe5700777d0 msgr2=0x7fe5700feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.145+0000 7fe5777ba700 1 -- 172.21.15.113:0/4149020648 shutdown_connections 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- 172.21.15.113:0/4149020648 wait complete. 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 Processor -- start 2024-04-19T22:46:59.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- start start 2024-04-19T22:46:59.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 0x7fe570198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:59.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 0x7fe5701986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe570110350 con 0x7fe5701012d0 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe5701101d0 con 0x7fe570100910 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fe5701104d0 con 0x7fe570106910 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:45668/0 (socket says 172.21.15.113:45668) 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 -- 172.21.15.113:0/411899631 learned_addr learned my addr 172.21.15.113:0/411899631 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe574d55700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 0x7fe5701986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575556700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 0x7fe570198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 -- 172.21.15.113:0/411899631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 msgr2=0x7fe570198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 0x7fe570198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 -- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 msgr2=0x7fe5701986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 0x7fe5701986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 -- 172.21.15.113:0/411899631 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57019d180 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe574d55700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 0x7fe5701986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe575d57700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00e3c0 tx=0x7fe56c00e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0092d0 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe56c00ee70 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe57019d470 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c007e50 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5701a4cf0 con 0x7fe570106910 2024-04-19T22:46:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.149+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57004ff50 con 0x7fe570106910 2024-04-19T22:46:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.153+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fe56c012050 con 0x7fe570106910 2024-04-19T22:46:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.153+0000 7fe5667fc700 1 --2- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 0x7fe55c070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:46:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.153+0000 7fe575556700 1 --2- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 0x7fe55c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:46:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.153+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fe56c08dce0 con 0x7fe570106910 2024-04-19T22:46:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.153+0000 7fe575556700 1 --2- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 0x7fe55c070700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe568009fd0 tx=0x7fe568019040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:46:59.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.157+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe56c010040 con 0x7fe570106910 2024-04-19T22:46:59.165 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[23441]: cluster 2024-04-19T22:46:57.631189+0000 mgr.y (mgr.24389) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:59.165 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.910232414Z level=info msg="Executing migration" id="add index team.org_id" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.935498764Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:58 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:58.977306351Z level=info msg="Executing migration" id="create team member table" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.00267899Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.04457541Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.069924199Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.128473137Z level=info msg="Executing migration" id="Add column email to team table" 2024-04-19T22:46:59.166 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.170521497Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-04-19T22:46:59.294 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:46:59 smithi113 bash[21528]: cluster 2024-04-19T22:46:57.631189+0000 mgr.y (mgr.24389) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:59.294 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:46:59 smithi113 bash[28910]: cluster 2024-04-19T22:46:57.631189+0000 mgr.y (mgr.24389) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:46:59.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.373+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5701a4f20 con 0x7fe570106910 2024-04-19T22:46:59.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.377+0000 7fe5667fc700 1 -- 172.21.15.113:0/411899631 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+21003 (secure 0 0 0) 0x7fe56c05b620 con 0x7fe570106910 2024-04-19T22:46:59.379 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:46:59.379 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":75,"fsid":"dd3df874-fe9c-11ee-bc92-c7b262605968","created":"2024-04-19T22:34:47.152859+0000","modified":"2024-04-19T22:46:03.581522+0000","last_up_change":"2024-04-19T22:44:26.046461+0000","last_in_change":"2024-04-19T22:44:00.330026+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T22:40:10.861972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-04-19T22:45:07.492777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-04-19T22:45:09.096820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-04-19T22:45:10.760613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-04-19T22:45:11.243435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-04-19T22:45:13.724458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf68f079-0f8d-4dca-8791-8e3fe35c1d87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":947963826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":947963826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":947963826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6803","nonce":947963826}]},"public_addr":"172.21.15.113:6801/947963826","cluster_addr":"172.21.15.113:6802/947963826","heartbeat_back_addr":"172.21.15.113:6804/947963826","heartbeat_front_addr":"172.21.15.113:6803/947963826","state":["exists","up"]},{"osd":1,"uuid":"88cfae52-7613-4c00-91bc-ffb48af3915d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3290228916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3290228916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":3290228916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6807","nonce":3290228916}]},"public_addr":"172.21.15.113:6805/3290228916","cluster_addr":"172.21.15.113:6806/3290228916","heartbeat_back_addr":"172.21.15.113:6808/3290228916","heartbeat_front_addr":"172.21.15.113:6807/3290228916","state":["exists","up"]},{"osd":2,"uuid":"2cb5d205-e57e-41c2-ad9d-1963cd39ad8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":2132568950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":2132568950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2132568950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6811","nonce":2132568950}]},"public_addr":"172.21.15.113:6809/2132568950","cluster_addr":"172.21.15.113:6810/2132568950","heartbeat_back_addr":"172.21.15.113:6812/2132568950","heartbeat_front_addr":"172.21.15.113:6811/2132568950","state":["exists","up"]},{"osd":3,"uuid":"f37fb43e-3da1-49da-a486-e4e4ec9328fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":1760998485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1760998485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1760998485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6815","nonce":1760998485}]},"public_addr":"172.21.15.113:6813/1760998485","cluster_addr":"172.21.15.113:6814/1760998485","heartbeat_back_addr":"172.21.15.113:6816/1760998485","heartbeat_front_addr":"172.21.15.113:6815/1760998485","state":["exists","up"]},{"osd":4,"uuid":"fb1d832c-ddaf-4a8e-943f-b6af469c3102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2100817193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6801","nonce":2100817193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2100817193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2100817193}]},"public_addr":"172.21.15.178:6800/2100817193","cluster_addr":"172.21.15.178:6801/2100817193","heartbeat_back_addr":"172.21.15.178:6803/2100817193","heartbeat_front_addr":"172.21.15.178:6802/2100817193","state":["exists","up"]},{"osd":5,"uuid":"1cb4fd11-e8ba-4531-8f77-cad3a865b53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2719719766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2719719766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":2719719766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2719719766}]},"public_addr":"172.21.15.178:6804/2719719766","cluster_addr":"172.21.15.178:6805/2719719766","heartbeat_back_addr":"172.21.15.178:6807/2719719766","heartbeat_front_addr":"172.21.15.178:6806/2719719766","state":["exists","up"]},{"osd":6,"uuid":"4b0a5910-1fbf-488b-8e8e-d0e64fe77f3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":2545851179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2545851179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2545851179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":2545851179}]},"public_addr":"172.21.15.178:6808/2545851179","cluster_addr":"172.21.15.178:6809/2545851179","heartbeat_back_addr":"172.21.15.178:6811/2545851179","heartbeat_front_addr":"172.21.15.178:6810/2545851179","state":["exists","up"]},{"osd":7,"uuid":"95319baf-3d59-43e3-820c-decd5a03bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1965706255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":1965706255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":1965706255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1965706255}]},"public_addr":"172.21.15.178:6812/1965706255","cluster_addr":"172.21.15.178:6813/1965706255","heartbeat_back_addr":"172.21.15.178:6815/1965706255","heartbeat_front_addr":"172.21.15.178:6814/1965706255","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:38:20.395451+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:39:13.872631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:40:06.914513+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:01.835109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:41:52.051583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:42:42.788939+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:43:32.712514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T22:44:24.151921+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.113:0/2937751484":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/3327923552":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/467518466":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/2227053540":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/3152323235":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/3425154508":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/1796898942":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/4182507758":"2024-04-20T22:46:03.581492+0000","172.21.15.113:0/2646177015":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3413585980":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/138586898":"2024-04-20T22:35:19.772443+0000","172.21.15.113:0/3535526494":"2024-04-20T22:35:54.228397+0000","172.21.15.113:0/1810151022":"2024-04-20T22:46:03.581492+0000","172.21.15.113:6800/2885784740":"2024-04-20T22:35:19.772443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 msgr2=0x7fe55c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 0x7fe55c070700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe568009fd0 tx=0x7fe568019040 comp rx=0 tx=0).stop 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 msgr2=0x7fe57019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00e3c0 tx=0x7fe56c00e6d0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 shutdown_connections 2024-04-19T22:46:59.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe55c06e240 0x7fe55c070700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe570106910 0x7fe57019ca40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe570100910 0x7fe570198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 --2- 172.21.15.113:0/411899631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5701012d0 0x7fe5701986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 >> 172.21.15.113:0/411899631 conn(0x7fe5700777d0 msgr2=0x7fe5700fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 shutdown_connections 2024-04-19T22:46:59.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:46:59.381+0000 7fe5777ba700 1 -- 172.21.15.113:0/411899631 wait complete. 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.212369055Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.254571868Z level=info msg="Executing migration" id="create dashboard acl table" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.296589849Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.321885571Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.34744747Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.389220689Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-04-19T22:46:59.435 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.414736346Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.439857037Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.46511666Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.490327356Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.515590318Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.557454209Z level=info msg="Executing migration" id="create tag table" 2024-04-19T22:46:59.704 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.582958875Z level=info msg="Executing migration" id="add index tag.key_value" 2024-04-19T22:46:59.705 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.62495516Z level=info msg="Executing migration" id="create login attempt table" 2024-04-19T22:46:59.705 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.667018587Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.708983162Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.725840232Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.751009875Z level=info msg="Executing migration" id="create login_attempt v2" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.767895702Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.784921008Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.818477528Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-04-19T22:46:59.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.843670195Z level=info msg="Executing migration" id="create user auth table" 2024-04-19T22:46:59.983 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.869010479Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-04-19T22:46:59.983 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.894251608Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-04-19T22:46:59.983 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.919426845Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-04-19T22:46:59.983 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.944749359Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-04-19T22:46:59.983 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:46:59 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:46:59.986664325Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-04-19T22:47:00.251 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[23441]: audit 2024-04-19T22:46:59.377550+0000 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.113:0/411899631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:47:00.251 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.028652725Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.053861563Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.079017151Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.120927445Z level=info msg="Executing migration" id="create server_lock table" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.163114343Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.188296592Z level=info msg="Executing migration" id="create user auth token table" 2024-04-19T22:47:00.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.23073861Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.256039979Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.297963486Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.323257199Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.348394252Z level=info msg="Executing migration" id="create cache_data table" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.373743863Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.398987366Z level=info msg="Executing migration" id="create short_url table v1" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.424268053Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.449405698Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-04-19T22:47:00.512 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.49131955Z level=info msg="Executing migration" id="delete alert_definition table" 2024-04-19T22:47:00.513 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.516548043Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-04-19T22:47:00.544 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:00 smithi113 bash[21528]: audit 2024-04-19T22:46:59.377550+0000 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.113:0/411899631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:47:00.544 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:00 smithi113 bash[28910]: audit 2024-04-19T22:46:59.377550+0000 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.113:0/411899631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-19T22:47:00.789 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.541915578Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-04-19T22:47:00.789 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.567174681Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-04-19T22:47:00.789 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.609173337Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-04-19T22:47:00.789 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.634327996Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-04-19T22:47:00.790 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.676268049Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-04-19T22:47:00.790 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.701453328Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-04-19T22:47:00.790 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.726887798Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-04-19T22:47:00.790 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.752080435Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-04-19T22:47:00.790 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.793946465Z level=info msg="Executing migration" id="drop alert_definition table" 2024-04-19T22:47:00.978 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-19T22:47:00.979 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-19T22:47:00.979 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-19T22:47:00.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-19T22:47:00.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-19T22:47:00.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-19T22:47:00.981 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-19T22:47:00.981 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-19T22:47:01.041 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.819225848Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-04-19T22:47:01.041 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.861139679Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-04-19T22:47:01.042 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.90305987Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-04-19T22:47:01.042 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.928553598Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-04-19T22:47:01.042 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:00 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:00.978846826Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-04-19T22:47:01.042 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.004083596Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-04-19T22:47:01.042 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.046145627Z level=info msg="Executing migration" id="create alert_instance table" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[23441]: cluster 2024-04-19T22:46:59.632627+0000 mgr.y (mgr.24389) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.088104906Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.113296882Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.155321389Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.180859221Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.23120838Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.256528707Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-04-19T22:47:01.294 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.298386318Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-04-19T22:47:01.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:01 smithi113 bash[21528]: cluster 2024-04-19T22:46:59.632627+0000 mgr.y (mgr.24389) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:01.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:01 smithi113 bash[28910]: cluster 2024-04-19T22:46:59.632627+0000 mgr.y (mgr.24389) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:01.550 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.340298888Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-04-19T22:47:01.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.365553272Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-04-19T22:47:01.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.390835333Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-04-19T22:47:01.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.432897729Z level=info msg="Executing migration" id="create alert_rule table" 2024-04-19T22:47:01.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.52009786Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-04-19T22:47:01.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.608899983Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-04-19T22:47:01.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.650876148Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-04-19T22:47:01.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.726112339Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-04-19T22:47:01.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.851355332Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-04-19T22:47:01.872 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.876680115Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-04-19T22:47:02.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.901830488Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-04-19T22:47:02.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.943831766Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-04-19T22:47:02.132 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:01 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:01.98587427Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-04-19T22:47:02.133 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.027814126Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-04-19T22:47:02.133 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.069763764Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-04-19T22:47:02.133 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.095093372Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-04-19T22:47:02.133 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.136958274Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.179143413Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.221083215Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.246321161Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.288349673Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.313576673Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.36410616Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-04-19T22:47:02.385 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.389291823Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-04-19T22:47:02.646 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.414634897Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-04-19T22:47:02.646 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.439864229Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-04-19T22:47:02.646 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.465130925Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-04-19T22:47:02.646 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.482035436Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-04-19T22:47:02.646 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.498914524Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.515807979Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.532816204Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.557920023Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.574903486Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.600205957Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.625363091Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-04-19T22:47:02.647 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.65062263Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-04-19T22:47:02.906 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.700942528Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.72619874Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.751346754Z level=info msg="Executing migration" id="create provenance_type table" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.793375014Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.835542097Z level=info msg="Executing migration" id="create alert_image table" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.860729277Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.885990525Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-04-19T22:47:02.907 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.911253881Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-04-19T22:47:02.930 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:02 smithi113 systemd[1]: Stopping Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T22:47:02.930 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:02 smithi113 bash[57875]: ts=2024-04-19T22:47:02.716Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-04-19T22:47:03.167 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[23441]: cluster 2024-04-19T22:47:01.633372+0000 mgr.y (mgr.24389) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:03.167 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.936460531Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.978430024Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:02 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:02.978728705Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.020410898Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.045707404Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.087665227Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.088170313Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.088577058Z level=info msg="alerts found to migrate" alerts=0 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.129769169Z level=info msg="Executing migration" id="create library_element table v1" 2024-04-19T22:47:03.168 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.171881712Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-04-19T22:47:03.268 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:03 smithi113 bash[28910]: cluster 2024-04-19T22:47:01.633372+0000 mgr.y (mgr.24389) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:03.269 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:03 smithi113 bash[21528]: cluster 2024-04-19T22:47:01.633372+0000 mgr.y (mgr.24389) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:03.436 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.213853641Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-04-19T22:47:03.436 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.239391025Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-04-19T22:47:03.436 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.306234775Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-04-19T22:47:03.436 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.331635262Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-04-19T22:47:03.436 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.373412901Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-04-19T22:47:03.437 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.398819872Z level=info msg="Executing migration" id="create data_keys table" 2024-04-19T22:47:03.437 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.44080533Z level=info msg="Executing migration" id="create secrets table" 2024-04-19T22:47:03.523 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:03 smithi113 bash[59495]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-alertmanager-a 2024-04-19T22:47:03.523 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:03 smithi113 bash[59557]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-alertmanager-a 2024-04-19T22:47:03.688 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.466073949Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-04-19T22:47:03.688 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.507823467Z level=info msg="Executing migration" id="add name column into data_keys" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.533167798Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.55005232Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.600305905Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.633853437Z level=info msg="Executing migration" id="create kv_store table v1" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.650895676Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.667796485Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-04-19T22:47:03.689 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.693073737Z level=info msg="Executing migration" id="create permission table" 2024-04-19T22:47:03.794 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:03 smithi113 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-04-19T22:47:03.794 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:03 smithi113 systemd[1]: Stopped Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:47:03.794 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:03 smithi113 systemd[1]: Started Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.718291478Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.760303753Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.785477531Z level=info msg="Executing migration" id="create role table" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.827521169Z level=info msg="Executing migration" id="add column display_name" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.852800612Z level=info msg="Executing migration" id="add column group_name" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.87793044Z level=info msg="Executing migration" id="add index role.org_id" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.903349567Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.928560178Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-04-19T22:47:03.966 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:03 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:03.970512913Z level=info msg="Executing migration" id="create team role table" 2024-04-19T22:47:04.251 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.012437004Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.037692568Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.079696802Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.121622916Z level=info msg="Executing migration" id="create user role table" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.163634206Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.214359567Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-04-19T22:47:04.252 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.256303254Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-04-19T22:47:04.516 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.357351291Z level=info msg="Executing migration" id="create builtin role table" 2024-04-19T22:47:04.801 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:04.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.520975545Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-04-19T22:47:04.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: audit 2024-04-19T22:47:03.575030+0000 mon.a (mon.0) 875 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:04.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: audit 2024-04-19T22:47:03.580613+0000 mon.a (mon.0) 876 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:04.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: cephadm 2024-04-19T22:47:03.585459+0000 mgr.y (mgr.24389) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-04-19T22:47:04.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: cluster 2024-04-19T22:47:03.633806+0000 mgr.y (mgr.24389) 64 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:04.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: cephadm 2024-04-19T22:47:03.825166+0000 mgr.y (mgr.24389) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi178 2024-04-19T22:47:04.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[23441]: audit 2024-04-19T22:47:03.840318+0000 mon.a (mon.0) 877 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:05.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: audit 2024-04-19T22:47:03.575030+0000 mon.a (mon.0) 875 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:05.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: audit 2024-04-19T22:47:03.580613+0000 mon.a (mon.0) 876 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: cephadm 2024-04-19T22:47:03.585459+0000 mgr.y (mgr.24389) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: cluster 2024-04-19T22:47:03.633806+0000 mgr.y (mgr.24389) 64 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: cephadm 2024-04-19T22:47:03.825166+0000 mgr.y (mgr.24389) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi178 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[21528]: audit 2024-04-19T22:47:03.840318+0000 mon.a (mon.0) 877 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: audit 2024-04-19T22:47:03.575030+0000 mon.a (mon.0) 875 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: audit 2024-04-19T22:47:03.580613+0000 mon.a (mon.0) 876 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: cephadm 2024-04-19T22:47:03.585459+0000 mgr.y (mgr.24389) 63 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: cluster 2024-04-19T22:47:03.633806+0000 mgr.y (mgr.24389) 64 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: cephadm 2024-04-19T22:47:03.825166+0000 mgr.y (mgr.24389) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi178 2024-04-19T22:47:05.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[28910]: audit 2024-04-19T22:47:03.840318+0000 mon.a (mon.0) 877 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.771Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.771Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.773Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.113 port=9094 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.774Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.804Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.805Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.809Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-04-19T22:47:05.046 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:04 smithi113 bash[59585]: ts=2024-04-19T22:47:04.809Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-04-19T22:47:05.258 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:04 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:04.845453546Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-04-19T22:47:05.259 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.012136017Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-04-19T22:47:05.550 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.263407099Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-04-19T22:47:05.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.386113326Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-04-19T22:47:05.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.443566691Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-04-19T22:47:05.551 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.512047046Z level=info msg="Executing migration" id="add unique index role.uid" 2024-04-19T22:47:05.833 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[23441]: audit 2024-04-19T22:47:04.657338+0000 mgr.y (mgr.24389) 66 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:05.833 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.579159553Z level=info msg="Executing migration" id="create seed assignment table" 2024-04-19T22:47:05.833 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.638049002Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-04-19T22:47:05.833 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.705326742Z level=info msg="Executing migration" id="add column hidden to role table" 2024-04-19T22:47:05.833 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.794189779Z level=info msg="Executing migration" id="create query_history table v1" 2024-04-19T22:47:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:05 smithi113 bash[21528]: audit 2024-04-19T22:47:04.657338+0000 mgr.y (mgr.24389) 66 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:06.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:05 smithi113 bash[28910]: audit 2024-04-19T22:47:04.657338+0000 mgr.y (mgr.24389) 66 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:06.142 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.839751051Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-04-19T22:47:06.142 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.889406669Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-04-19T22:47:06.142 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.957552071Z level=info msg="Executing migration" id="teams permissions migration" 2024-04-19T22:47:06.142 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:05 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:05.9994305Z level=info msg="Executing migration" id="dashboard permissions" 2024-04-19T22:47:06.143 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.076570034Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-04-19T22:47:06.143 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.147034401Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-04-19T22:47:06.438 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.24772684Z level=info msg="Executing migration" id="alerting notification permissions" 2024-04-19T22:47:06.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[23441]: cluster 2024-04-19T22:47:05.635492+0000 mgr.y (mgr.24389) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:06.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.443123807Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-04-19T22:47:06.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.688781611Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-04-19T22:47:07.013 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.014 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.014 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.014 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.017 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.017 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.020 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.020 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:07.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:06 smithi113 bash[28910]: cluster 2024-04-19T22:47:05.635492+0000 mgr.y (mgr.24389) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:07.045 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:06 smithi113 bash[59585]: ts=2024-04-19T22:47:06.774Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000429862s 2024-04-19T22:47:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:06 smithi113 bash[21528]: cluster 2024-04-19T22:47:05.635492+0000 mgr.y (mgr.24389) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:07.142 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.811227665Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-04-19T22:47:07.143 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.903498373Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-04-19T22:47:07.143 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:06 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:06.971544323Z level=info msg="Executing migration" id="create correlation table v1" 2024-04-19T22:47:07.445 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.14734073Z level=info msg="Executing migration" id="add index correlations.uid" 2024-04-19T22:47:07.445 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.342960558Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-04-19T22:47:07.698 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.449416076Z level=info msg="Executing migration" id="add correlation config column" 2024-04-19T22:47:07.794 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:07.980 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.703002623Z level=info msg="Executing migration" id="create entity_events table" 2024-04-19T22:47:07.981 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.825794307Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-04-19T22:47:07.981 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.892992025Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-04-19T22:47:07.981 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.893314875Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.98509636Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:07 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:07.985417424Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.071755579Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.127572785Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.185494654Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-04-19T22:47:08.241 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.24521659Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-04-19T22:47:08.517 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.287217188Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-04-19T22:47:08.517 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.329343942Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-04-19T22:47:08.517 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.37985823Z level=info msg="Executing migration" id="Drop public config table" 2024-04-19T22:47:08.517 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.452029941Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-04-19T22:47:08.679 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:08 smithi113 bash[28910]: cluster 2024-04-19T22:47:07.636158+0000 mgr.y (mgr.24389) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:08.679 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:08 smithi113 bash[21528]: cluster 2024-04-19T22:47:07.636158+0000 mgr.y (mgr.24389) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:08.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.521695847Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-04-19T22:47:08.801 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.588313993Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-04-19T22:47:08.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[23441]: cluster 2024-04-19T22:47:07.636158+0000 mgr.y (mgr.24389) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:09.053 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:08 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:08.807959641Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-04-19T22:47:09.323 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.058434929Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-04-19T22:47:09.323 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.1592006Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-04-19T22:47:09.323 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.243180417Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-04-19T22:47:09.608 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.327448637Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.369355667Z level=info msg="Executing migration" id="add share column" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.394550026Z level=info msg="Executing migration" id="create default alerting folders" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.436750895Z level=info msg="Executing migration" id="create file table" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.495905324Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.546607225Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.613228943Z level=info msg="Executing migration" id="create file_meta table" 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 systemd[1]: Stopping Ceph prometheus.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-04-19T22:47:09.609 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.487Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.488Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.488Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-04-19T22:47:09.610 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[48961]: ts=2024-04-19T22:47:09.488Z caller=main.go:1147 level=info msg="See you next time!" 2024-04-19T22:47:09.889 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.697702974Z level=info msg="Executing migration" id="file table idx: path key" 2024-04-19T22:47:10.165 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:09 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:09.894109867Z level=info msg="Executing migration" id="set path collation in file table" 2024-04-19T22:47:10.422 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.169800286Z level=info msg="Executing migration" id="managed permissions migration" 2024-04-19T22:47:10.422 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.249330777Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-04-19T22:47:10.423 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.325314669Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-04-19T22:47:10.423 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.393219637Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-04-19T22:47:10.423 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[51521]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-prometheus-a 2024-04-19T22:47:10.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[51582]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-prometheus-a 2024-04-19T22:47:10.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:10 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-04-19T22:47:10.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:10 smithi178 systemd[1]: Stopped Ceph prometheus.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:47:10.424 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:10 smithi178 systemd[1]: Started Ceph prometheus.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T22:47:10.772 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.505344606Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPING 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPED 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTING 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Serving on http://:::9283 2024-04-19T22:47:10.789 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTED 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPING 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPED 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTING 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Serving on http://:::9283 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTED 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPING 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STOPPED 2024-04-19T22:47:10.790 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTING 2024-04-19T22:47:11.044 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Serving on http://:::9283 2024-04-19T22:47:11.044 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:10 smithi113 bash[21785]: [19/Apr/2024:22:47:10] ENGINE Bus STARTED 2024-04-19T22:47:11.050 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.777120788Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-04-19T22:47:11.050 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:10 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:10.925333729Z level=info msg="Executing migration" id="update group index for alert rules" 2024-04-19T22:47:11.497 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.233235885Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-04-19T22:47:11.497 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.339378864Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-04-19T22:47:11.497 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.423648326Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-04-19T22:47:11.497 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.500617046Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-04-19T22:47:11.497 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: cluster 2024-04-19T22:47:09.637493+0000 mgr.y (mgr.24389) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:11.497 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.434086+0000 mon.a (mon.0) 878 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.497 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.443974+0000 mon.a (mon.0) 879 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.474800+0000 mon.a (mon.0) 880 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.476083+0000 mgr.y (mgr.24389) 70 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.478515+0000 mon.a (mon.0) 881 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.479301+0000 mgr.y (mgr.24389) 71 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.484311+0000 mon.a (mon.0) 882 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.501569+0000 mon.a (mon.0) 883 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.506914+0000 mon.a (mon.0) 884 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.514214+0000 mon.a (mon.0) 885 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.525904+0000 mon.a (mon.0) 886 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.529871+0000 mon.a (mon.0) 887 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:11.498 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.535322+0000 mon.a (mon.0) 888 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.499 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[23441]: audit 2024-04-19T22:47:10.554936+0000 mon.a (mon.0) 889 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:47:11.754 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.56610889Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-04-19T22:47:11.754 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.616578027Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-04-19T22:47:11.754 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.725417465Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: cluster 2024-04-19T22:47:09.637493+0000 mgr.y (mgr.24389) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.434086+0000 mon.a (mon.0) 878 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.443974+0000 mon.a (mon.0) 879 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.474800+0000 mon.a (mon.0) 880 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.476083+0000 mgr.y (mgr.24389) 70 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.478515+0000 mon.a (mon.0) 881 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.479301+0000 mgr.y (mgr.24389) 71 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.484311+0000 mon.a (mon.0) 882 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.501569+0000 mon.a (mon.0) 883 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.506914+0000 mon.a (mon.0) 884 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.514214+0000 mon.a (mon.0) 885 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.525904+0000 mon.a (mon.0) 886 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.529871+0000 mon.a (mon.0) 887 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.535322+0000 mon.a (mon.0) 888 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[28910]: audit 2024-04-19T22:47:10.554936+0000 mon.a (mon.0) 889 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: cluster 2024-04-19T22:47:09.637493+0000 mgr.y (mgr.24389) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.434086+0000 mon.a (mon.0) 878 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.443974+0000 mon.a (mon.0) 879 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.474800+0000 mon.a (mon.0) 880 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.476083+0000 mgr.y (mgr.24389) 70 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-19T22:47:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.478515+0000 mon.a (mon.0) 881 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.479301+0000 mgr.y (mgr.24389) 71 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi113.front.sepia.ceph.com:9093"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.484311+0000 mon.a (mon.0) 882 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.501569+0000 mon.a (mon.0) 883 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.506914+0000 mon.a (mon.0) 884 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.514214+0000 mon.a (mon.0) 885 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.525904+0000 mon.a (mon.0) 886 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.529871+0000 mon.a (mon.0) 887 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.535322+0000 mon.a (mon.0) 888 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:11 smithi113 bash[21528]: audit 2024-04-19T22:47:10.554936+0000 mon.a (mon.0) 889 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.759104071Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.792873945Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.843515298Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.910725979Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.93620714Z level=info msg="Executing migration" id="create folder table" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:11.978269032Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-04-19T22:47:12.024 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:12.028552071Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.842Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.842Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.842Z caller=main.go:570 level=info host_details="(Linux 5.15.0-105-generic #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 x86_64 smithi178 (none))" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.842Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.842Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.844Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.844Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.845Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.845Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.848Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-04-19T22:47:12.025 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.848Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.855µs 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.848Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.849Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.849Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.849Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.684µs wal_replay_duration=782.616µs wbl_replay_duration=146ns total_replay_duration=823.848µs 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.850Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.850Z caller=main.go:1029 level=info msg="TSDB started" 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.850Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.871Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.231373ms db_storage=856ns remote_storage=1.294µs web_handler=500ns query_engine=630ns scrape=288.092µs scrape_sd=134.721µs notify=20.748µs notify_sd=24.109µs rules=20.487444ms tracing=5.981µs 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.871Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-04-19T22:47:12.026 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 22:47:11 smithi178 bash[51610]: ts=2024-04-19T22:47:11.871Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:12.053877518Z level=info msg="Executing migration" id="Update folder title length" 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:12.095814904Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=migrator t=2024-04-19T22:47:12.137731409Z level=info msg="migrations completed" performed=485 skipped=0 duration=20.81290083s 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=sqlstore t=2024-04-19T22:47:12.139087105Z level=info msg="Created default organization" 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=plugin.finder t=2024-04-19T22:47:12.268073844Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=secrets t=2024-04-19T22:47:12.268264063Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=query_data t=2024-04-19T22:47:12.27205917Z level=info msg="Query Service initialization" 2024-04-19T22:47:12.301 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[50863]: logger=live.push_http t=2024-04-19T22:47:12.276213348Z level=info msg="Live Push Gateway initialization" 2024-04-19T22:47:12.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[23441]: audit 2024-04-19T22:47:10.502219+0000 mgr.y (mgr.24389) 72 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:12.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[23441]: audit 2024-04-19T22:47:10.507583+0000 mgr.y (mgr.24389) 73 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:12.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[23441]: audit 2024-04-19T22:47:10.526457+0000 mgr.y (mgr.24389) 74 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:12.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:12 smithi178 bash[23441]: audit 2024-04-19T22:47:10.530306+0000 mgr.y (mgr.24389) 75 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:12.932 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[28910]: audit 2024-04-19T22:47:10.502219+0000 mgr.y (mgr.24389) 72 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[28910]: audit 2024-04-19T22:47:10.507583+0000 mgr.y (mgr.24389) 73 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[28910]: audit 2024-04-19T22:47:10.526457+0000 mgr.y (mgr.24389) 74 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[28910]: audit 2024-04-19T22:47:10.530306+0000 mgr.y (mgr.24389) 75 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[21528]: audit 2024-04-19T22:47:10.502219+0000 mgr.y (mgr.24389) 72 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[21528]: audit 2024-04-19T22:47:10.507583+0000 mgr.y (mgr.24389) 73 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi178.front.sepia.ceph.com:9095"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[21528]: audit 2024-04-19T22:47:10.526457+0000 mgr.y (mgr.24389) 74 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-19T22:47:12.933 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:12 smithi113 bash[21528]: audit 2024-04-19T22:47:10.530306+0000 mgr.y (mgr.24389) 75 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi178.front.sepia.ceph.com:3000"}]: dispatch 2024-04-19T22:47:13.488 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:13 smithi113 bash[21528]: cluster 2024-04-19T22:47:11.638145+0000 mgr.y (mgr.24389) 76 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:13.618 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[23441]: cluster 2024-04-19T22:47:11.638145+0000 mgr.y (mgr.24389) 76 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=infra.usagestats.collector t=2024-04-19T22:47:13.372752931Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=provisioning.datasources t=2024-04-19T22:47:13.376041204Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=provisioning.datasources t=2024-04-19T22:47:13.456479018Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=provisioning.alerting t=2024-04-19T22:47:13.506521984Z level=info msg="starting to provision alerting" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=provisioning.alerting t=2024-04-19T22:47:13.506553004Z level=info msg="finished to provision alerting" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=grafanaStorageLogger t=2024-04-19T22:47:13.507087419Z level=info msg="storage starting" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=ngalert.state.manager t=2024-04-19T22:47:13.508145348Z level=info msg="Warming state cache for startup" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=http.server t=2024-04-19T22:47:13.511283767Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=ngalert.state.manager t=2024-04-19T22:47:13.570059775Z level=info msg="State cache has been initialized" states=0 duration=61.915276ms 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=ticker t=2024-04-19T22:47:13.570117975Z level=info msg=starting first_tick=2024-04-19T22:47:20Z 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=ngalert.multiorg.alertmanager t=2024-04-19T22:47:13.570132672Z level=info msg="starting MultiOrg Alertmanager" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T22:47:13.579436457Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-04-19T22:47:13.619 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T22:47:13.623396451Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-04-19T22:47:13.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:13 smithi113 bash[28910]: cluster 2024-04-19T22:47:11.638145+0000 mgr.y (mgr.24389) 76 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:14.051 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T22:47:13.712592693Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-04-19T22:47:14.051 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T22:47:13.756792187Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=3 code="database is locked" 2024-04-19T22:47:14.051 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:47:13 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T22:47:13.871574011Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=4 code="database is locked" 2024-04-19T22:47:15.044 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 22:47:14 smithi113 bash[59585]: ts=2024-04-19T22:47:14.777Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003079506s 2024-04-19T22:47:15.050 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:15.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:15 smithi113 bash[21528]: cluster 2024-04-19T22:47:13.638587+0000 mgr.y (mgr.24389) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:15.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:15 smithi113 bash[28910]: cluster 2024-04-19T22:47:13.638587+0000 mgr.y (mgr.24389) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:15.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:15 smithi178 bash[23441]: cluster 2024-04-19T22:47:13.638587+0000 mgr.y (mgr.24389) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- 172.21.15.113:0/2222255401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c806a4d0 msgr2=0x7fd7c806a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/2222255401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c806a4d0 0x7fd7c806a950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009990 tx=0x7fd7b0009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- 172.21.15.113:0/2222255401 shutdown_connections 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/2222255401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c8104d00 0x7fd7c8105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/2222255401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c81071e0 0x7fd7c8069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/2222255401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c806a4d0 0x7fd7c806a950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- 172.21.15.113:0/2222255401 >> 172.21.15.113:0/2222255401 conn(0x7fd7c80771d0 msgr2=0x7fd7c80775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- 172.21.15.113:0/2222255401 shutdown_connections 2024-04-19T22:47:16.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- 172.21.15.113:0/2222255401 wait complete. 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 Processor -- start 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- start start 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c806a4d0 0x7fd7c819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 0x7fd7c819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c81071e0 0x7fd7c81a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c81182d0 con 0x7fd7c8104d00 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8118150 con 0x7fd7c806a4d0 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7cd55c700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c8118450 con 0x7fd7c81071e0 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.185+0000 7fd7c67fc700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 0x7fd7c819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:16.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c77fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c81071e0 0x7fd7c81a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 0x7fd7c819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:60598/0 (socket says 172.21.15.113:60598) 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 -- 172.21.15.113:0/1489888199 learned_addr learned my addr 172.21.15.113:0/1489888199 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c6ffd700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c806a4d0 0x7fd7c819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 -- 172.21.15.113:0/1489888199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c81071e0 msgr2=0x7fd7c81a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7c81071e0 0x7fd7c81a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 -- 172.21.15.113:0/1489888199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c806a4d0 msgr2=0x7fd7c819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c806a4d0 0x7fd7c819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 -- 172.21.15.113:0/1489888199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c81a3710 con 0x7fd7c8104d00 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c6ffd700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c806a4d0 0x7fd7c819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c67fc700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 0x7fd7c819ec40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0005910 tx=0x7fd7b0004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0027070 con 0x7fd7c8104d00 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c81a39a0 con 0x7fd7c8104d00 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd7b0022470 con 0x7fd7c8104d00 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0017650 con 0x7fd7c8104d00 2024-04-19T22:47:16.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c81ab280 con 0x7fd7c8104d00 2024-04-19T22:47:16.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7c81046c0 con 0x7fd7c8104d00 2024-04-19T22:47:16.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fd7b002a070 con 0x7fd7c8104d00 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd7b406e0a0 0x7fd7b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fd7b008f760 con 0x7fd7c8104d00 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c6ffd700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd7b406e0a0 0x7fd7b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6805/3290228916 conn(0x7fd7b40778e0 0x7fd7b4079d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 --> v2:172.21.15.113:6805/3290228916 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7b002ee50 con 0x7fd7b40778e0 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd7b008fbf0 con 0x7fd7c8104d00 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c77fe700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6805/3290228916 conn(0x7fd7b40778e0 0x7fd7b4079d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c6ffd700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd7b406e0a0 0x7fd7b4070560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009c90 tx=0x7fd7b8009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.189+0000 7fd7c77fe700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6805/3290228916 conn(0x7fd7b40778e0 0x7fd7b4079d40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:16.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.193+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== osd.1 v2:172.21.15.113:6805/3290228916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7b002ee50 con 0x7fd7b40778e0 2024-04-19T22:47:16.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 --> v2:172.21.15.113:6805/3290228916 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7c81017e0 con 0x7fd7b40778e0 2024-04-19T22:47:16.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7bffff700 1 -- 172.21.15.113:0/1489888199 <== osd.1 v2:172.21.15.113:6805/3290228916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7c81017e0 con 0x7fd7b40778e0 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6805/3290228916 conn(0x7fd7b40778e0 msgr2=0x7fd7b4079d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6805/3290228916 conn(0x7fd7b40778e0 0x7fd7b4079d40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd7b406e0a0 msgr2=0x7fd7b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/1489888199 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd7b406e0a0 0x7fd7b4070560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009c90 tx=0x7fd7b8009260 comp rx=0 tx=0).stop 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 msgr2=0x7fd7c819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:16.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 --2- 172.21.15.113:0/1489888199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7c8104d00 0x7fd7c819ec40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0005910 tx=0x7fd7b0004580 comp rx=0 tx=0).stop 2024-04-19T22:47:16.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7c77fe700 1 -- 172.21.15.113:0/1489888199 reap_dead start 2024-04-19T22:47:16.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 shutdown_connections 2024-04-19T22:47:16.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 >> 172.21.15.113:0/1489888199 conn(0x7fd7c80771d0 msgr2=0x7fd7c8103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:16.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 shutdown_connections 2024-04-19T22:47:16.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:16.209+0000 7fd7cd55c700 1 -- 172.21.15.113:0/1489888199 wait complete. 2024-04-19T22:47:16.768 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:16 smithi113 bash[28910]: audit 2024-04-19T22:47:14.661608+0000 mgr.y (mgr.24389) 78 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:16.768 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:16 smithi113 bash[21528]: audit 2024-04-19T22:47:14.661608+0000 mgr.y (mgr.24389) 78 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:16.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:16 smithi178 bash[23441]: audit 2024-04-19T22:47:14.661608+0000 mgr.y (mgr.24389) 78 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:17.794 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[28910]: cluster 2024-04-19T22:47:15.639357+0000 mgr.y (mgr.24389) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[28910]: audit 2024-04-19T22:47:16.595727+0000 mon.a (mon.0) 890 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[28910]: audit 2024-04-19T22:47:16.604737+0000 mon.a (mon.0) 891 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[21528]: cluster 2024-04-19T22:47:15.639357+0000 mgr.y (mgr.24389) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[21528]: audit 2024-04-19T22:47:16.595727+0000 mon.a (mon.0) 890 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:17.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:17 smithi113 bash[21528]: audit 2024-04-19T22:47:16.604737+0000 mon.a (mon.0) 891 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:17.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:17 smithi178 bash[23441]: cluster 2024-04-19T22:47:15.639357+0000 mgr.y (mgr.24389) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:17.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:17 smithi178 bash[23441]: audit 2024-04-19T22:47:16.595727+0000 mon.a (mon.0) 890 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:17.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:17 smithi178 bash[23441]: audit 2024-04-19T22:47:16.604737+0000 mon.a (mon.0) 891 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:19.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:19 smithi178 bash[23441]: cluster 2024-04-19T22:47:17.640127+0000 mgr.y (mgr.24389) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:19.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:19 smithi178 bash[23441]: audit 2024-04-19T22:47:18.864296+0000 mon.a (mon.0) 892 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:19.959 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:19 smithi113 bash[28910]: cluster 2024-04-19T22:47:17.640127+0000 mgr.y (mgr.24389) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:19.960 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:19 smithi113 bash[28910]: audit 2024-04-19T22:47:18.864296+0000 mon.a (mon.0) 892 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:19.960 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:19 smithi113 bash[21528]: cluster 2024-04-19T22:47:17.640127+0000 mgr.y (mgr.24389) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:19.960 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:19 smithi113 bash[21528]: audit 2024-04-19T22:47:18.864296+0000 mon.a (mon.0) 892 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:20.701 INFO:teuthology.orchestra.run.smithi113.stdout:55834574945 2024-04-19T22:47:20.701 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-19T22:47:21.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:21 smithi178 bash[23441]: cluster 2024-04-19T22:47:19.641559+0000 mgr.y (mgr.24389) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:21.834 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:21 smithi113 bash[28910]: cluster 2024-04-19T22:47:19.641559+0000 mgr.y (mgr.24389) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:21.834 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:21 smithi113 bash[21528]: cluster 2024-04-19T22:47:19.641559+0000 mgr.y (mgr.24389) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:22.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1732306918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41073e0 msgr2=0x7fc0c41077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1732306918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41073e0 0x7fc0c41077c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40098f0 tx=0x7fc0b4009c00 comp rx=0 tx=0).stop 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1732306918 shutdown_connections 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1732306918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 0x7fc0c4104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1732306918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41073e0 0x7fc0c41077c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1732306918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0c41007b0 0x7fc0c4100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.812+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1732306918 >> 172.21.15.113:0/1732306918 conn(0x7fc0c4077760 msgr2=0x7fc0c40feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1732306918 shutdown_connections 2024-04-19T22:47:22.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1732306918 wait complete. 2024-04-19T22:47:22.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 Processor -- start 2024-04-19T22:47:22.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- start start 2024-04-19T22:47:22.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 0x7fc0c41a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:22.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 0x7fc0c41a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0c41073e0 0x7fc0c419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4118580 con 0x7fc0c41007b0 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4118400 con 0x7fc0c4101250 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c4118700 con 0x7fc0c41073e0 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 0x7fc0c41a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 0x7fc0c41a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49670/0 (socket says 172.21.15.113:49670) 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 -- 172.21.15.113:0/1297974467 learned_addr learned my addr 172.21.15.113:0/1297974467 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca88a700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0c41073e0 0x7fc0c419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 -- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0c41073e0 msgr2=0x7fc0c419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0c41073e0 0x7fc0c419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 -- 172.21.15.113:0/1297974467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 msgr2=0x7fc0c41a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0c9888700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 0x7fc0c41a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 0x7fc0c41a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 -- 172.21.15.113:0/1297974467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c419f000 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0c9888700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0c4101250 0x7fc0c41a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0ca089700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 0x7fc0c41a46a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400fb40 tx=0x7fc0b400fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4027070 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c419f290 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc0b400b560 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4004ac0 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41ab500 con 0x7fc0c41007b0 2024-04-19T22:47:22.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0c4103730 con 0x7fc0c41007b0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.816+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fc0b402a070 con 0x7fc0c41007b0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc0b006e0a0 0x7fc0b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fc0b408f5f0 con 0x7fc0c41007b0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0c9888700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc0b006e0a0 0x7fc0b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.178:6800/2100817193 conn(0x7fc0b00778e0 0x7fc0b0079d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 --> v2:172.21.15.178:6800/2100817193 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0b400b0b0 con 0x7fc0b00778e0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc0b408fa80 con 0x7fc0c41007b0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0c9888700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc0b006e0a0 0x7fc0b0070560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ffd10 tx=0x7fc0c0009310 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:22.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0ca88a700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.178:6800/2100817193 conn(0x7fc0b00778e0 0x7fc0b0079d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:22.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0ca88a700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.178:6800/2100817193 conn(0x7fc0b00778e0 0x7fc0b0079d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:22.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.820+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== osd.4 v2:172.21.15.178:6800/2100817193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0b400b0b0 con 0x7fc0b00778e0 2024-04-19T22:47:22.837 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.836+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 --> v2:172.21.15.178:6800/2100817193 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0c4101a60 con 0x7fc0b00778e0 2024-04-19T22:47:22.838 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0bb7fe700 1 -- 172.21.15.113:0/1297974467 <== osd.4 v2:172.21.15.178:6800/2100817193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0c4101a60 con 0x7fc0b00778e0 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 >> v2:172.21.15.178:6800/2100817193 conn(0x7fc0b00778e0 msgr2=0x7fc0b0079d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.178:6800/2100817193 conn(0x7fc0b00778e0 0x7fc0b0079d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc0b006e0a0 msgr2=0x7fc0b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1297974467 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc0b006e0a0 0x7fc0b0070560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ffd10 tx=0x7fc0c0009310 comp rx=0 tx=0).stop 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 msgr2=0x7fc0c41a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 --2- 172.21.15.113:0/1297974467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0c41007b0 0x7fc0c41a46a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400fb40 tx=0x7fc0b400fb70 comp rx=0 tx=0).stop 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0ca88a700 1 -- 172.21.15.113:0/1297974467 reap_dead start 2024-04-19T22:47:22.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 shutdown_connections 2024-04-19T22:47:22.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 >> 172.21.15.113:0/1297974467 conn(0x7fc0c4077760 msgr2=0x7fc0c4102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:22.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 shutdown_connections 2024-04-19T22:47:22.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:22.840+0000 7fc0cc2ed700 1 -- 172.21.15.113:0/1297974467 wait complete. 2024-04-19T22:47:23.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- 172.21.15.113:0/17010222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c100d00 msgr2=0x7ffb0c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- 172.21.15.113:0/17010222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c100d00 0x7ffb0c101180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009990 tx=0x7ffafc009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- 172.21.15.113:0/17010222 shutdown_connections 2024-04-19T22:47:23.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- 172.21.15.113:0/17010222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0c10ef40 0x7ffb0c111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- 172.21.15.113:0/17010222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c1033b0 0x7ffb0c1007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- 172.21.15.113:0/17010222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c100d00 0x7ffb0c101180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- 172.21.15.113:0/17010222 >> 172.21.15.113:0/17010222 conn(0x7ffb0c077770 msgr2=0x7ffb0c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- 172.21.15.113:0/17010222 shutdown_connections 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- 172.21.15.113:0/17010222 wait complete. 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 Processor -- start 2024-04-19T22:47:23.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- start start 2024-04-19T22:47:23.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 0x7ffb0c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:23.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0c1033b0 0x7ffb0c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:23.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c10ef40 0x7ffb0c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:23.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c114110 con 0x7ffb0c100d00 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c113f90 con 0x7ffb0c1033b0 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb1156a700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0c114290 con 0x7ffb0c10ef40 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb0affd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 0x7ffb0c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb0b7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c10ef40 0x7ffb0c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb0affd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 0x7ffb0c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49682/0 (socket says 172.21.15.113:49682) 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.736+0000 7ffb0affd700 1 -- 172.21.15.113:0/1067068381 learned_addr learned my addr 172.21.15.113:0/1067068381 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0a7fc700 1 --2- 172.21.15.113:0/1067068381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0c1033b0 0x7ffb0c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 -- 172.21.15.113:0/1067068381 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c10ef40 msgr2=0x7ffb0c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 --2- 172.21.15.113:0/1067068381 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb0c10ef40 0x7ffb0c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 -- 172.21.15.113:0/1067068381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0c1033b0 msgr2=0x7ffb0c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 --2- 172.21.15.113:0/1067068381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0c1033b0 0x7ffb0c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 -- 172.21.15.113:0/1067068381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c19f580 con 0x7ffb0c100d00 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0affd700 1 --2- 172.21.15.113:0/1067068381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 0x7ffb0c19a570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000eb30 tx=0x7ffb0000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000cc90 con 0x7ffb0c100d00 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0c19f870 con 0x7ffb0c100d00 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7ffb000044d0 con 0x7ffb0c100d00 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00010430 con 0x7ffb0c100d00 2024-04-19T22:47:23.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0c1a70f0 con 0x7ffb0c100d00 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb0c062940 con 0x7ffb0c100d00 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7ffb00003f30 con 0x7ffb0c100d00 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.113:6800/3719359025 conn(0x7ffaf406e0a0 0x7ffaf4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7ffb0008e280 con 0x7ffb0c100d00 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0a7fc700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.113:6800/3719359025 conn(0x7ffaf406e0a0 0x7ffaf4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.178:6812/1965706255 conn(0x7ffaf4077960 0x7ffaf4079dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 --> v2:172.21.15.178:6812/1965706255 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb00019e70 con 0x7ffaf4077960 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ffb00095050 con 0x7ffb0c100d00 2024-04-19T22:47:23.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0a7fc700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.113:6800/3719359025 conn(0x7ffaf406e0a0 0x7ffaf4070560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006010 tx=0x7ffafc01a040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:23.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.740+0000 7ffb0b7fe700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.178:6812/1965706255 conn(0x7ffaf4077960 0x7ffaf4079dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:23.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.744+0000 7ffb0b7fe700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.178:6812/1965706255 conn(0x7ffaf4077960 0x7ffaf4079dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:23.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.744+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== osd.7 v2:172.21.15.178:6812/1965706255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb00019e70 con 0x7ffaf4077960 2024-04-19T22:47:23.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.760+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 --> v2:172.21.15.178:6812/1965706255 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb0c062d40 con 0x7ffaf4077960 2024-04-19T22:47:23.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffaf3fff700 1 -- 172.21.15.113:0/1067068381 <== osd.7 v2:172.21.15.178:6812/1965706255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffb0c062d40 con 0x7ffaf4077960 2024-04-19T22:47:23.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 >> v2:172.21.15.178:6812/1965706255 conn(0x7ffaf4077960 msgr2=0x7ffaf4079dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.178:6812/1965706255 conn(0x7ffaf4077960 0x7ffaf4079dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 >> v2:172.21.15.113:6800/3719359025 conn(0x7ffaf406e0a0 msgr2=0x7ffaf4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 --2- 172.21.15.113:0/1067068381 >> v2:172.21.15.113:6800/3719359025 conn(0x7ffaf406e0a0 0x7ffaf4070560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006010 tx=0x7ffafc01a040 comp rx=0 tx=0).stop 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 msgr2=0x7ffb0c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 --2- 172.21.15.113:0/1067068381 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb0c100d00 0x7ffb0c19a570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000eb30 tx=0x7ffb0000ee40 comp rx=0 tx=0).stop 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb0b7fe700 1 -- 172.21.15.113:0/1067068381 reap_dead start 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 shutdown_connections 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 >> 172.21.15.113:0/1067068381 conn(0x7ffb0c077770 msgr2=0x7ffb0c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 shutdown_connections 2024-04-19T22:47:23.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:23.764+0000 7ffb1156a700 1 -- 172.21.15.113:0/1067068381 wait complete. 2024-04-19T22:47:23.774 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:23 smithi113 bash[21528]: cluster 2024-04-19T22:47:21.642267+0000 mgr.y (mgr.24389) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:23.774 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:23 smithi113 bash[28910]: cluster 2024-04-19T22:47:21.642267+0000 mgr.y (mgr.24389) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:23.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:23 smithi178 bash[23441]: cluster 2024-04-19T22:47:21.642267+0000 mgr.y (mgr.24389) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:24.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- 172.21.15.113:0/2425729154 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 msgr2=0x7f2070102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- 172.21.15.113:0/2425729154 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070102830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20640098f0 tx=0x7f2064009c00 comp rx=0 tx=0).stop 2024-04-19T22:47:24.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- 172.21.15.113:0/2425729154 shutdown_connections 2024-04-19T22:47:24.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- 172.21.15.113:0/2425729154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070102d70 0x7f207010f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- 172.21.15.113:0/2425729154 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070108350 0x7f2070108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- 172.21.15.113:0/2425729154 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070102830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- 172.21.15.113:0/2425729154 >> 172.21.15.113:0/2425729154 conn(0x7f2070079390 msgr2=0x7f20700797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:24.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- 172.21.15.113:0/2425729154 shutdown_connections 2024-04-19T22:47:24.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- 172.21.15.113:0/2425729154 wait complete. 2024-04-19T22:47:24.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 Processor -- start 2024-04-19T22:47:24.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 -- start start 2024-04-19T22:47:24.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.328+0000 7f20782d3700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 0x7f2070074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070108350 0x7f2070074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2070111d40 con 0x7f2070102d70 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2070111bc0 con 0x7f2070108350 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f2070111ec0 con 0x7f20701023b0 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 0x7f2070074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 0x7f2070074a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49708/0 (socket says 172.21.15.113:49708) 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070074530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:53726/0 (socket says 172.21.15.113:53726) 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 -- 172.21.15.113:0/1357157143 learned_addr learned my addr 172.21.15.113:0/1357157143 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f2076870700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070108350 0x7f2070074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 -- 172.21.15.113:0/1357157143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070108350 msgr2=0x7f2070074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070108350 0x7f2070074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 -- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 msgr2=0x7f2070074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 0x7f2070074a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 -- 172.21.15.113:0/1357157143 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20701a6680 con 0x7f20701023b0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2070102d70 0x7f2070074a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f2076870700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2070108350 0x7f2070074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207606f700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070074530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f206800ef10 tx=0x7f206800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800ca70 con 0x7f20701023b0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20701a6910 con 0x7f20701023b0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f2068019070 con 0x7f20701023b0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680146e0 con 0x7f20701023b0 2024-04-19T22:47:24.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20701a6e50 con 0x7f20701023b0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2070107800 con 0x7f20701023b0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f2068012050 con 0x7f20701023b0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.113:6800/3719359025 conn(0x7f205806e0a0 0x7f2058070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f206808eb50 con 0x7f20701023b0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.113:6800/3719359025 conn(0x7f205806e0a0 0x7f2058070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.178:6808/2545851179 conn(0x7f20580778e0 0x7f2058079d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 --> v2:172.21.15.178:6808/2545851179 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f205807a3d0 con 0x7f20580778e0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f206808efe0 con 0x7f20701023b0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.332+0000 7f207586e700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.113:6800/3719359025 conn(0x7f205806e0a0 0x7f2058070560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f20701127a0 tx=0x7f2064019040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.336+0000 7f2076870700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.178:6808/2545851179 conn(0x7f20580778e0 0x7f2058079d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.336+0000 7f2076870700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.178:6808/2545851179 conn(0x7f20580778e0 0x7f2058079d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.336+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== osd.6 v2:172.21.15.178:6808/2545851179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f205807a3d0 con 0x7f20580778e0 2024-04-19T22:47:24.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.352+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 --> v2:172.21.15.178:6808/2545851179 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2070103990 con 0x7f20580778e0 2024-04-19T22:47:24.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f206f7fe700 1 -- 172.21.15.113:0/1357157143 <== osd.6 v2:172.21.15.178:6808/2545851179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2070103990 con 0x7f20580778e0 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 >> v2:172.21.15.178:6808/2545851179 conn(0x7f20580778e0 msgr2=0x7f2058079d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.178:6808/2545851179 conn(0x7f20580778e0 0x7f2058079d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 >> v2:172.21.15.113:6800/3719359025 conn(0x7f205806e0a0 msgr2=0x7f2058070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 --2- 172.21.15.113:0/1357157143 >> v2:172.21.15.113:6800/3719359025 conn(0x7f205806e0a0 0x7f2058070560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f20701127a0 tx=0x7f2064019040 comp rx=0 tx=0).stop 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 msgr2=0x7f2070074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 --2- 172.21.15.113:0/1357157143 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f20701023b0 0x7f2070074530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f206800ef10 tx=0x7f206800c3a0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f2076870700 1 -- 172.21.15.113:0/1357157143 reap_dead start 2024-04-19T22:47:24.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 shutdown_connections 2024-04-19T22:47:24.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 >> 172.21.15.113:0/1357157143 conn(0x7f2070079390 msgr2=0x7f2070105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:24.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 shutdown_connections 2024-04-19T22:47:24.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.356+0000 7f20782d3700 1 -- 172.21.15.113:0/1357157143 wait complete. 2024-04-19T22:47:24.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/2373407728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf8006a1f0 msgr2=0x7fcf8006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- 172.21.15.113:0/2373407728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf8006a1f0 0x7fcf8006a5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0099c0 tx=0x7fcf7c009cd0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/2373407728 shutdown_connections 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- 172.21.15.113:0/2373407728 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf80107640 0x7fcf8010f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- 172.21.15.113:0/2373407728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf8006a1f0 0x7fcf8006a5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- 172.21.15.113:0/2373407728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8006aba0 0x7fcf80106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/2373407728 >> 172.21.15.113:0/2373407728 conn(0x7fcf800771d0 msgr2=0x7fcf800775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/2373407728 shutdown_connections 2024-04-19T22:47:24.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/2373407728 wait complete. 2024-04-19T22:47:24.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 Processor -- start 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- start start 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8006a1f0 0x7fcf8019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf8006aba0 0x7fcf8019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 0x7fcf8019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80111d30 con 0x7fcf8006aba0 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80111bb0 con 0x7fcf8006a1f0 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fcf80111eb0 con 0x7fcf80107640 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf86d05700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 0x7fcf8019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf8006aba0 0x7fcf8019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf86d05700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 0x7fcf8019ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:53752/0 (socket says 172.21.15.113:53752) 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf86d05700 1 -- 172.21.15.113:0/3086250279 learned_addr learned my addr 172.21.15.113:0/3086250279 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf86504700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8006a1f0 0x7fcf8019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 -- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 msgr2=0x7fcf8019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 0x7fcf8019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 -- 172.21.15.113:0/3086250279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8006a1f0 msgr2=0x7fcf8019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8006a1f0 0x7fcf8019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 -- 172.21.15.113:0/3086250279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8019f3f0 con 0x7fcf8006aba0 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf86d05700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcf80107640 0x7fcf8019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf85d03700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf8006aba0 0x7fcf8019a920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcf80069db0 tx=0x7fcf7000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70015020 con 0x7fcf8006aba0 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8019f6e0 con 0x7fcf8006aba0 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fcf70011ce0 con 0x7fcf8006aba0 2024-04-19T22:47:24.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70010c00 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.596+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801a6f60 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf8010de40 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fcf70018020 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6800/3719359025 conn(0x7fcf6c06e0a0 0x7fcf6c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fcf7008dd50 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf86504700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6800/3719359025 conn(0x7fcf6c06e0a0 0x7fcf6c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6801/947963826 conn(0x7fcf6c0778e0 0x7fcf6c079d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 --> v2:172.21.15.113:6801/947963826 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf700068b0 con 0x7fcf6c0778e0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fcf7008e1e0 con 0x7fcf8006aba0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf86d05700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6801/947963826 conn(0x7fcf6c0778e0 0x7fcf6c079d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf86504700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6800/3719359025 conn(0x7fcf6c06e0a0 0x7fcf6c070560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c000c00 tx=0x7fcf7c005a90 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf86d05700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6801/947963826 conn(0x7fcf6c0778e0 0x7fcf6c079d40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:24.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.600+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== osd.0 v2:172.21.15.113:6801/947963826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf700068b0 con 0x7fcf6c0778e0 2024-04-19T22:47:24.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 --> v2:172.21.15.113:6801/947963826 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf801039f0 con 0x7fcf6c0778e0 2024-04-19T22:47:24.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf777fe700 1 -- 172.21.15.113:0/3086250279 <== osd.0 v2:172.21.15.113:6801/947963826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf801039f0 con 0x7fcf6c0778e0 2024-04-19T22:47:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6801/947963826 conn(0x7fcf6c0778e0 msgr2=0x7fcf6c079d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6801/947963826 conn(0x7fcf6c0778e0 0x7fcf6c079d40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6800/3719359025 conn(0x7fcf6c06e0a0 msgr2=0x7fcf6c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 --2- 172.21.15.113:0/3086250279 >> v2:172.21.15.113:6800/3719359025 conn(0x7fcf6c06e0a0 0x7fcf6c070560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c000c00 tx=0x7fcf7c005a90 comp rx=0 tx=0).stop 2024-04-19T22:47:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf8006aba0 msgr2=0x7fcf8019a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 --2- 172.21.15.113:0/3086250279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcf8006aba0 0x7fcf8019a920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcf80069db0 tx=0x7fcf7000b730 comp rx=0 tx=0).stop 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf86d05700 1 -- 172.21.15.113:0/3086250279 reap_dead start 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 shutdown_connections 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 >> 172.21.15.113:0/3086250279 conn(0x7fcf800771d0 msgr2=0x7fcf8010d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 shutdown_connections 2024-04-19T22:47:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:24.620+0000 7fcf88768700 1 -- 172.21.15.113:0/3086250279 wait complete. 2024-04-19T22:47:25.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:25.524 INFO:teuthology.orchestra.run.smithi113.stdout:133143986243 2024-04-19T22:47:25.524 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-19T22:47:25.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:25 smithi113 bash[28910]: cluster 2024-04-19T22:47:23.642748+0000 mgr.y (mgr.24389) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:25.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:25 smithi113 bash[21528]: cluster 2024-04-19T22:47:23.642748+0000 mgr.y (mgr.24389) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:25.800 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:25 smithi178 bash[23441]: cluster 2024-04-19T22:47:23.642748+0000 mgr.y (mgr.24389) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- 172.21.15.113:0/2033863057 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce4101d80 msgr2=0x7f6ce4105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- 172.21.15.113:0/2033863057 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce4101d80 0x7f6ce4105dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009920 tx=0x7f6cd0009c30 comp rx=0 tx=0).stop 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- 172.21.15.113:0/2033863057 shutdown_connections 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- 172.21.15.113:0/2033863057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce41064b0 0x7f6ce410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- 172.21.15.113:0/2033863057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41013d0 0x7f6ce41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- 172.21.15.113:0/2033863057 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce4101d80 0x7f6ce4105dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- 172.21.15.113:0/2033863057 >> 172.21.15.113:0/2033863057 conn(0x7f6ce4078100 msgr2=0x7f6ce4078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- 172.21.15.113:0/2033863057 shutdown_connections 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- 172.21.15.113:0/2033863057 wait complete. 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 Processor -- start 2024-04-19T22:47:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- start start 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 0x7f6ce4102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce4101d80 0x7f6ce41033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41064b0 0x7f6ce41038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce4110b50 con 0x7f6ce41064b0 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce41109d0 con 0x7f6ce4101d80 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ceb018700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce4110cd0 con 0x7f6ce41013d0 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 0x7f6ce4102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce95b5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41064b0 0x7f6ce41038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 0x7f6ce4102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:53770/0 (socket says 172.21.15.113:53770) 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 -- 172.21.15.113:0/3056274256 learned_addr learned my addr 172.21.15.113:0/3056274256 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:26.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce3fff700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce4101d80 0x7f6ce41033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 -- 172.21.15.113:0/3056274256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce4101d80 msgr2=0x7f6ce41033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce4101d80 0x7f6ce41033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 -- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41064b0 msgr2=0x7f6ce41038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41064b0 0x7f6ce41038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce8db4700 1 -- 172.21.15.113:0/3056274256 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce41a66d0 con 0x7f6ce41013d0 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce3fff700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ce4101d80 0x7f6ce41033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.788+0000 7f6ce95b5700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ce41064b0 0x7f6ce41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce8db4700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 0x7f6ce4102e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800ec10 tx=0x7f6cd800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:26.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800cd40 con 0x7f6ce41013d0 2024-04-19T22:47:26.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce41a69c0 con 0x7f6ce41013d0 2024-04-19T22:47:26.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6cd80044d0 con 0x7f6ce41013d0 2024-04-19T22:47:26.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8010690 con 0x7f6ce41013d0 2024-04-19T22:47:26.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce41a6f20 con 0x7f6ce41013d0 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce406b2c0 con 0x7f6ce41013d0 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f6cd8003e20 con 0x7f6ce41013d0 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cd406e0a0 0x7f6cd4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f6cd808e360 con 0x7f6ce41013d0 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce3fff700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cd406e0a0 0x7f6cd4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:26.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.178:6804/2719719766 conn(0x7f6cd4077960 0x7f6cd4079dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 --> v2:172.21.15.178:6804/2719719766 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cd407a450 con 0x7f6cd4077960 2024-04-19T22:47:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f6cd8095050 con 0x7f6ce41013d0 2024-04-19T22:47:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce95b5700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.178:6804/2719719766 conn(0x7f6cd4077960 0x7f6cd4079dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.792+0000 7f6ce3fff700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cd406e0a0 0x7f6cd4070560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4104900 tx=0x7f6cd0019040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:26.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.796+0000 7f6ce95b5700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.178:6804/2719719766 conn(0x7f6cd4077960 0x7f6cd4079dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:26.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:26 smithi113 bash[28910]: audit 2024-04-19T22:47:24.666209+0000 mgr.y (mgr.24389) 84 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:26.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:26 smithi113 bash[21528]: audit 2024-04-19T22:47:24.666209+0000 mgr.y (mgr.24389) 84 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:26.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.796+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== osd.5 v2:172.21.15.178:6804/2719719766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cd407a450 con 0x7f6cd4077960 2024-04-19T22:47:26.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:26 smithi178 bash[23441]: audit 2024-04-19T22:47:24.666209+0000 mgr.y (mgr.24389) 84 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:26.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 --> v2:172.21.15.178:6804/2719719766 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ce41028b0 con 0x7f6cd4077960 2024-04-19T22:47:26.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ce1ffb700 1 -- 172.21.15.113:0/3056274256 <== osd.5 v2:172.21.15.178:6804/2719719766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ce41028b0 con 0x7f6cd4077960 2024-04-19T22:47:26.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 >> v2:172.21.15.178:6804/2719719766 conn(0x7f6cd4077960 msgr2=0x7f6cd4079dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.178:6804/2719719766 conn(0x7f6cd4077960 0x7f6cd4079dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:26.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cd406e0a0 msgr2=0x7f6cd4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 --2- 172.21.15.113:0/3056274256 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6cd406e0a0 0x7f6cd4070560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4104900 tx=0x7f6cd0019040 comp rx=0 tx=0).stop 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 msgr2=0x7f6ce4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 --2- 172.21.15.113:0/3056274256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ce41013d0 0x7f6ce4102e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800ec10 tx=0x7f6cd800ef20 comp rx=0 tx=0).stop 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ce95b5700 1 -- 172.21.15.113:0/3056274256 reap_dead start 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 shutdown_connections 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 >> 172.21.15.113:0/3056274256 conn(0x7f6ce4078100 msgr2=0x7f6ce406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 shutdown_connections 2024-04-19T22:47:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:26.816+0000 7f6ceb018700 1 -- 172.21.15.113:0/3056274256 wait complete. 2024-04-19T22:47:27.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3013484814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a441007b0 msgr2=0x7f6a44100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3013484814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a441007b0 0x7f6a44100c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a340099c0 tx=0x7f6a34009cd0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3013484814 shutdown_connections 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3013484814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a44101170 0x7f6a4410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3013484814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44107280 0x7f6a44107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3013484814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a441007b0 0x7f6a44100c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3013484814 >> 172.21.15.113:0/3013484814 conn(0x7f6a44077760 msgr2=0x7f6a440feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3013484814 shutdown_connections 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3013484814 wait complete. 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 Processor -- start 2024-04-19T22:47:27.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 -- start start 2024-04-19T22:47:27.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.460+0000 7f6a48b4d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a441007b0 0x7f6a441981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:27.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 0x7f6a44198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:27.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a44107280 0x7f6a4419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:27.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44111dc0 con 0x7f6a44101170 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44111c40 con 0x7f6a441007b0 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f6a44111f40 con 0x7f6a44107280 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 0x7f6a44198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a42d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a44107280 0x7f6a4419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 0x7f6a44198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49768/0 (socket says 172.21.15.113:49768) 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 -- 172.21.15.113:0/3270773339 learned_addr learned my addr 172.21.15.113:0/3270773339 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 -- 172.21.15.113:0/3270773339 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a44107280 msgr2=0x7f6a4419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 --2- 172.21.15.113:0/3270773339 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6a44107280 0x7f6a4419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 -- 172.21.15.113:0/3270773339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a441007b0 msgr2=0x7f6a441981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 --2- 172.21.15.113:0/3270773339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a441007b0 0x7f6a441981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 -- 172.21.15.113:0/3270773339 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4419d180 con 0x7f6a44101170 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a41d9b700 1 --2- 172.21.15.113:0/3270773339 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 0x7f6a44198700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005910 tx=0x7f6a3400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:27.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34027070 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f6a3400fb80 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4419d410 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340173f0 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441018c0 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a44105740 con 0x7f6a44101170 2024-04-19T22:47:27.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f6a34022470 con 0x7f6a44101170 2024-04-19T22:47:27.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6a2c06e0f0 0x7f6a2c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:27.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f6a3408eb90 con 0x7f6a44101170 2024-04-19T22:47:27.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.464+0000 7f6a4259c700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6a2c06e0f0 0x7f6a2c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:27.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a337fe700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6809/2132568950 conn(0x7f6a2c077a30 0x7f6a2c079e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:27.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 --> v2:172.21.15.113:6809/2132568950 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a34001d30 con 0x7f6a2c077a30 2024-04-19T22:47:27.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f6a340912e0 con 0x7f6a44101170 2024-04-19T22:47:27.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a42d9d700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6809/2132568950 conn(0x7f6a2c077a30 0x7f6a2c079e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:27.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a4259c700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6a2c06e0f0 0x7f6a2c0705b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005d90 tx=0x7f6a38005ce0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:27.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a42d9d700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6809/2132568950 conn(0x7f6a2c077a30 0x7f6a2c079e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:27.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.468+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== osd.2 v2:172.21.15.113:6809/2132568950 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a34001d30 con 0x7f6a2c077a30 2024-04-19T22:47:27.484 INFO:teuthology.orchestra.run.smithi113.stdout:236223201316 2024-04-19T22:47:27.484 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-19T22:47:27.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 --> v2:172.21.15.113:6809/2132568950 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a4404ff50 con 0x7f6a2c077a30 2024-04-19T22:47:27.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a337fe700 1 -- 172.21.15.113:0/3270773339 <== osd.2 v2:172.21.15.113:6809/2132568950 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a4404ff50 con 0x7f6a2c077a30 2024-04-19T22:47:27.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6809/2132568950 conn(0x7f6a2c077a30 msgr2=0x7f6a2c079e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6809/2132568950 conn(0x7f6a2c077a30 0x7f6a2c079e90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6a2c06e0f0 msgr2=0x7f6a2c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3270773339 >> v2:172.21.15.113:6800/3719359025 conn(0x7f6a2c06e0f0 0x7f6a2c0705b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005d90 tx=0x7f6a38005ce0 comp rx=0 tx=0).stop 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 msgr2=0x7f6a44198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 --2- 172.21.15.113:0/3270773339 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a44101170 0x7f6a44198700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005910 tx=0x7f6a3400f690 comp rx=0 tx=0).stop 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a42d9d700 1 -- 172.21.15.113:0/3270773339 reap_dead start 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 shutdown_connections 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 >> 172.21.15.113:0/3270773339 conn(0x7f6a44077760 msgr2=0x7f6a44104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 shutdown_connections 2024-04-19T22:47:27.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:27.496+0000 7f6a48b4d700 1 -- 172.21.15.113:0/3270773339 wait complete. 2024-04-19T22:47:27.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:27 smithi113 bash[28910]: cluster 2024-04-19T22:47:25.643599+0000 mgr.y (mgr.24389) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:27.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:27 smithi113 bash[21528]: cluster 2024-04-19T22:47:25.643599+0000 mgr.y (mgr.24389) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:27.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:27 smithi178 bash[23441]: cluster 2024-04-19T22:47:25.643599+0000 mgr.y (mgr.24389) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:27.916 INFO:teuthology.orchestra.run.smithi113.stdout:34359738478 2024-04-19T22:47:27.916 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-19T22:47:27.966 INFO:teuthology.orchestra.run.smithi113.stdout:201863462958 2024-04-19T22:47:27.967 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 -- 172.21.15.113:0/1075775903 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8401033a0 msgr2=0x7fe8401007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 --2- 172.21.15.113:0/1075775903 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8401033a0 0x7fe8401007b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe830009990 tx=0x7fe830009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 -- 172.21.15.113:0/1075775903 shutdown_connections 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 --2- 172.21.15.113:0/1075775903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe84010ef30 0x7fe840111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 --2- 172.21.15.113:0/1075775903 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8401033a0 0x7fe8401007b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 --2- 172.21.15.113:0/1075775903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 0x7fe840101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 -- 172.21.15.113:0/1075775903 >> 172.21.15.113:0/1075775903 conn(0x7fe840077760 msgr2=0x7fe8400feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:28.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 -- 172.21.15.113:0/1075775903 shutdown_connections 2024-04-19T22:47:28.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.092+0000 7fe84665e700 1 -- 172.21.15.113:0/1075775903 wait complete. 2024-04-19T22:47:28.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 Processor -- start 2024-04-19T22:47:28.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- start start 2024-04-19T22:47:28.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 0x7fe84019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:28.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8401033a0 0x7fe84019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:28.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 0x7fe84019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe840114100 con 0x7fe840100cf0 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe840113f80 con 0x7fe8401033a0 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fe840114280 con 0x7fe84010ef30 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 0x7fe84019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83ffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 0x7fe84019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 0x7fe84019ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:53806/0 (socket says 172.21.15.113:53806) 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 -- 172.21.15.113:0/3139380536 learned_addr learned my addr 172.21.15.113:0/3139380536 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83f7fe700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8401033a0 0x7fe84019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 -- 172.21.15.113:0/3139380536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8401033a0 msgr2=0x7fe84019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8401033a0 0x7fe84019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 -- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 msgr2=0x7fe84019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 0x7fe84019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 -- 172.21.15.113:0/3139380536 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84019f550 con 0x7fe84010ef30 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83ffff700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe840100cf0 0x7fe84019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe844bfb700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 0x7fe84019ee10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8380094f0 tx=0x7fe83800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83800ddd0 con 0x7fe84010ef30 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84019f840 con 0x7fe84010ef30 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8401a70c0 con 0x7fe84010ef30 2024-04-19T22:47:28.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe838009e20 con 0x7fe84010ef30 2024-04-19T22:47:28.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838015400 con 0x7fe84010ef30 2024-04-19T22:47:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe840062940 con 0x7fe84010ef30 2024-04-19T22:47:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fe838004fa0 con 0x7fe84010ef30 2024-04-19T22:47:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe82806e0a0 0x7fe828070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fe83808da80 con 0x7fe84010ef30 2024-04-19T22:47:28.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83ffff700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe82806e0a0 0x7fe828070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6813/1760998485 conn(0x7fe828077960 0x7fe828079dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.096+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 --> v2:172.21.15.113:6813/1760998485 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe838010ec0 con 0x7fe828077960 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.100+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe8380922c0 con 0x7fe84010ef30 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.100+0000 7fe83f7fe700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6813/1760998485 conn(0x7fe828077960 0x7fe828079dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.100+0000 7fe83f7fe700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6813/1760998485 conn(0x7fe828077960 0x7fe828079dc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.100+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== osd.3 v2:172.21.15.113:6813/1760998485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe838010ec0 con 0x7fe828077960 2024-04-19T22:47:28.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.100+0000 7fe83ffff700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe82806e0a0 0x7fe828070560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe83000b2e0 tx=0x7fe83001a040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:28.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.116+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 --> v2:172.21.15.113:6813/1760998485 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe840062d40 con 0x7fe828077960 2024-04-19T22:47:28.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.116+0000 7fe83d7fa700 1 -- 172.21.15.113:0/3139380536 <== osd.3 v2:172.21.15.113:6813/1760998485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe840062d40 con 0x7fe828077960 2024-04-19T22:47:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6813/1760998485 conn(0x7fe828077960 msgr2=0x7fe828079dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6813/1760998485 conn(0x7fe828077960 0x7fe828079dc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe82806e0a0 msgr2=0x7fe828070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 --2- 172.21.15.113:0/3139380536 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe82806e0a0 0x7fe828070560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe83000b2e0 tx=0x7fe83001a040 comp rx=0 tx=0).stop 2024-04-19T22:47:28.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 msgr2=0x7fe84019ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 --2- 172.21.15.113:0/3139380536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe84010ef30 0x7fe84019ee10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8380094f0 tx=0x7fe83800d3b0 comp rx=0 tx=0).stop 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe844bfb700 1 -- 172.21.15.113:0/3139380536 reap_dead start 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 shutdown_connections 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 >> 172.21.15.113:0/3139380536 conn(0x7fe840077760 msgr2=0x7fe8400feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 shutdown_connections 2024-04-19T22:47:28.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:28.120+0000 7fe84665e700 1 -- 172.21.15.113:0/3139380536 wait complete. 2024-04-19T22:47:28.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:28 smithi113 bash[28910]: cluster 2024-04-19T22:47:27.644404+0000 mgr.y (mgr.24389) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:28.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:28 smithi113 bash[21528]: cluster 2024-04-19T22:47:27.644404+0000 mgr.y (mgr.24389) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:28.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:28 smithi178 bash[23441]: cluster 2024-04-19T22:47:27.644404+0000 mgr.y (mgr.24389) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:29.770 INFO:teuthology.orchestra.run.smithi113.stdout:167503724601 2024-04-19T22:47:29.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-19T22:47:29.807 INFO:teuthology.orchestra.run.smithi113.stdout:111669149775 2024-04-19T22:47:29.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-19T22:47:29.814 INFO:teuthology.orchestra.run.smithi113.stdout:77309411418 2024-04-19T22:47:29.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-19T22:47:30.278 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:31.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:30 smithi113 bash[28910]: cluster 2024-04-19T22:47:29.645336+0000 mgr.y (mgr.24389) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:31.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:30 smithi113 bash[21528]: cluster 2024-04-19T22:47:29.645336+0000 mgr.y (mgr.24389) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:31.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:30 smithi178 bash[23441]: cluster 2024-04-19T22:47:29.645336+0000 mgr.y (mgr.24389) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[21528]: audit 2024-04-19T22:47:30.878504+0000 mon.a (mon.0) 893 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[21528]: audit 2024-04-19T22:47:30.884344+0000 mon.a (mon.0) 894 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[21528]: audit 2024-04-19T22:47:31.456090+0000 mon.a (mon.0) 895 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[21528]: audit 2024-04-19T22:47:31.456845+0000 mon.a (mon.0) 896 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[21528]: audit 2024-04-19T22:47:31.461720+0000 mon.a (mon.0) 897 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[28910]: audit 2024-04-19T22:47:30.878504+0000 mon.a (mon.0) 893 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.229 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[28910]: audit 2024-04-19T22:47:30.884344+0000 mon.a (mon.0) 894 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.230 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[28910]: audit 2024-04-19T22:47:31.456090+0000 mon.a (mon.0) 895 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:47:32.230 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[28910]: audit 2024-04-19T22:47:31.456845+0000 mon.a (mon.0) 896 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:47:32.230 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:31 smithi113 bash[28910]: audit 2024-04-19T22:47:31.461720+0000 mon.a (mon.0) 897 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:31 smithi178 bash[23441]: audit 2024-04-19T22:47:30.878504+0000 mon.a (mon.0) 893 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:31 smithi178 bash[23441]: audit 2024-04-19T22:47:30.884344+0000 mon.a (mon.0) 894 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:31 smithi178 bash[23441]: audit 2024-04-19T22:47:31.456090+0000 mon.a (mon.0) 895 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:47:32.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:31 smithi178 bash[23441]: audit 2024-04-19T22:47:31.456845+0000 mon.a (mon.0) 896 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:47:32.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:31 smithi178 bash[23441]: audit 2024-04-19T22:47:31.461720+0000 mon.a (mon.0) 897 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:47:32.653 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:32.654 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:33.322 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:33.322 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:33.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:33 smithi113 bash[21528]: cluster 2024-04-19T22:47:31.645972+0000 mgr.y (mgr.24389) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:33.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:33 smithi113 bash[28910]: cluster 2024-04-19T22:47:31.645972+0000 mgr.y (mgr.24389) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:33.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:33 smithi178 bash[23441]: cluster 2024-04-19T22:47:31.645972+0000 mgr.y (mgr.24389) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:34.346 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:34.346 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:34.347 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:47:34.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:34 smithi113 bash[21528]: audit 2024-04-19T22:47:33.894120+0000 mon.a (mon.0) 898 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:34.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:34 smithi113 bash[28910]: audit 2024-04-19T22:47:33.894120+0000 mon.a (mon.0) 898 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:34.801 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:34.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:34 smithi178 bash[23441]: audit 2024-04-19T22:47:33.894120+0000 mon.a (mon.0) 898 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 -- 172.21.15.113:0/832053520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 msgr2=0x7f3bb0108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 --2- 172.21.15.113:0/832053520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0108730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80098f0 tx=0x7f3ba8009c00 comp rx=0 tx=0).stop 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 -- 172.21.15.113:0/832053520 shutdown_connections 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 --2- 172.21.15.113:0/832053520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 0x7f3bb010f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 --2- 172.21.15.113:0/832053520 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0108730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 --2- 172.21.15.113:0/832053520 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.196+0000 7f3bb732c700 1 -- 172.21.15.113:0/832053520 >> 172.21.15.113:0/832053520 conn(0x7f3bb0078150 msgr2=0x7f3bb0078560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- 172.21.15.113:0/832053520 shutdown_connections 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- 172.21.15.113:0/832053520 wait complete. 2024-04-19T22:47:35.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 Processor -- start 2024-04-19T22:47:35.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- start start 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb0101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 0x7f3bb0101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0111c30 con 0x7f3bb0108350 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0111ab0 con 0x7f3bb006b320 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb0111db0 con 0x7f3bb006a960 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb58c9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:35.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb0101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb58c9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52914/0 (socket says 172.21.15.113:52914) 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb58c9700 1 -- 172.21.15.113:0/1185198122 learned_addr learned my addr 172.21.15.113:0/1185198122 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb48c7700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 0x7f3bb0101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 -- 172.21.15.113:0/1185198122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 msgr2=0x7f3bb0101770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 0x7f3bb0101770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 -- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 msgr2=0x7f3bb0101cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 -- 172.21.15.113:0/1185198122 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb01a6740 con 0x7f3bb006a960 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb58c9700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb50c8700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb0101230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009230 tx=0x7f3ba800fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8005140 con 0x7f3bb006a960 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f3ba800b560 con 0x7f3bb006a960 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8003980 con 0x7f3bb006a960 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb01a69d0 con 0x7f3bb006a960 2024-04-19T22:47:35.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb01a6e20 con 0x7f3bb006a960 2024-04-19T22:47:35.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb004ff50 con 0x7f3bb006a960 2024-04-19T22:47:35.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.200+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f3ba800b9f0 con 0x7f3bb006a960 2024-04-19T22:47:35.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.204+0000 7f3bae7fc700 1 --2- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 0x7f3b98070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:35.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.204+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f3ba808f110 con 0x7f3bb006a960 2024-04-19T22:47:35.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.204+0000 7f3bb48c7700 1 --2- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 0x7f3b98070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:35.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.204+0000 7f3bb48c7700 1 --2- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 0x7f3b98070560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bb01126e0 tx=0x7f3ba4009310 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:35.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.208+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3ba8013030 con 0x7f3bb006a960 2024-04-19T22:47:35.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.416+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3bb01a70b0 con 0x7f3bb006a960 2024-04-19T22:47:35.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.416+0000 7f3bae7fc700 1 -- 172.21.15.113:0/1185198122 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ba805c9d0 con 0x7f3bb006a960 2024-04-19T22:47:35.417 INFO:teuthology.orchestra.run.smithi113.stdout:55834574948 2024-04-19T22:47:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 msgr2=0x7f3b98070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 0x7f3b98070560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bb01126e0 tx=0x7f3ba4009310 comp rx=0 tx=0).stop 2024-04-19T22:47:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 msgr2=0x7f3bb0101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb0101230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009230 tx=0x7f3ba800fb40 comp rx=0 tx=0).stop 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 shutdown_connections 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> v2:172.21.15.113:6800/3719359025 conn(0x7f3b9806e0a0 0x7f3b98070560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bb0108350 0x7f3bb0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bb006a960 0x7f3bb0101230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 --2- 172.21.15.113:0/1185198122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb006b320 0x7f3bb0101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 >> 172.21.15.113:0/1185198122 conn(0x7f3bb0078150 msgr2=0x7f3bb0105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 shutdown_connections 2024-04-19T22:47:35.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:35.420+0000 7f3bb732c700 1 -- 172.21.15.113:0/1185198122 wait complete. 2024-04-19T22:47:35.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:35 smithi113 bash[28910]: cluster 2024-04-19T22:47:33.646781+0000 mgr.y (mgr.24389) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:35.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:35 smithi113 bash[28910]: audit 2024-04-19T22:47:35.421721+0000 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.113:0/1185198122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-19T22:47:35.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:35 smithi113 bash[21528]: cluster 2024-04-19T22:47:33.646781+0000 mgr.y (mgr.24389) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:35.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:35 smithi113 bash[21528]: audit 2024-04-19T22:47:35.421721+0000 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.113:0/1185198122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-19T22:47:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:35 smithi178 bash[23441]: cluster 2024-04-19T22:47:33.646781+0000 mgr.y (mgr.24389) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:35.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:35 smithi178 bash[23441]: audit 2024-04-19T22:47:35.421721+0000 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.113:0/1185198122' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-19T22:47:36.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:36 smithi113 bash[28910]: audit 2024-04-19T22:47:34.669458+0000 mgr.y (mgr.24389) 90 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:36.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:36 smithi113 bash[21528]: audit 2024-04-19T22:47:34.669458+0000 mgr.y (mgr.24389) 90 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:36.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:36 smithi178 bash[23441]: audit 2024-04-19T22:47:34.669458+0000 mgr.y (mgr.24389) 90 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:37.425 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574945 got 55834574948 for osd.1 2024-04-19T22:47:37.425 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:37.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:37 smithi113 bash[21528]: cluster 2024-04-19T22:47:35.648144+0000 mgr.y (mgr.24389) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:37.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:37 smithi113 bash[28910]: cluster 2024-04-19T22:47:35.648144+0000 mgr.y (mgr.24389) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:37.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:37 smithi178 bash[23441]: cluster 2024-04-19T22:47:35.648144+0000 mgr.y (mgr.24389) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:39.794 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:39 smithi113 bash[28910]: cluster 2024-04-19T22:47:37.648595+0000 mgr.y (mgr.24389) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:39.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:39 smithi113 bash[21528]: cluster 2024-04-19T22:47:37.648595+0000 mgr.y (mgr.24389) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:39.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:39 smithi178 bash[23441]: cluster 2024-04-19T22:47:37.648595+0000 mgr.y (mgr.24389) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:41.758 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:41 smithi113 bash[21528]: cluster 2024-04-19T22:47:39.649983+0000 mgr.y (mgr.24389) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:41.758 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:41 smithi113 bash[28910]: cluster 2024-04-19T22:47:39.649983+0000 mgr.y (mgr.24389) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:41.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:41 smithi178 bash[23441]: cluster 2024-04-19T22:47:39.649983+0000 mgr.y (mgr.24389) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:43.794 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:43 smithi113 bash[21528]: cluster 2024-04-19T22:47:41.650619+0000 mgr.y (mgr.24389) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:43.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:43 smithi113 bash[28910]: cluster 2024-04-19T22:47:41.650619+0000 mgr.y (mgr.24389) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:43.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:43 smithi178 bash[23441]: cluster 2024-04-19T22:47:41.650619+0000 mgr.y (mgr.24389) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:44.801 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:44.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:44 smithi178 bash[23441]: cluster 2024-04-19T22:47:43.651251+0000 mgr.y (mgr.24389) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:44.931 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:44 smithi113 bash[28910]: cluster 2024-04-19T22:47:43.651251+0000 mgr.y (mgr.24389) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:44.931 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:44 smithi113 bash[21528]: cluster 2024-04-19T22:47:43.651251+0000 mgr.y (mgr.24389) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:45.801 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:45 smithi178 bash[23441]: audit 2024-04-19T22:47:44.677335+0000 mgr.y (mgr.24389) 96 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:46.039 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:45 smithi113 bash[28910]: audit 2024-04-19T22:47:44.677335+0000 mgr.y (mgr.24389) 96 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:46.040 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:45 smithi113 bash[21528]: audit 2024-04-19T22:47:44.677335+0000 mgr.y (mgr.24389) 96 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/880144588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf4104d60 msgr2=0x7f7bf41051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/880144588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf4104d60 0x7f7bf41051e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00b0a0 tx=0x7f7bec00b3b0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/880144588 shutdown_connections 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/880144588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf4104d60 0x7f7bf41051e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/880144588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf41072f0 0x7f7bf406a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/880144588 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf406aee0 0x7f7bf406b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/880144588 >> 172.21.15.113:0/880144588 conn(0x7f7bf4077040 msgr2=0x7f7bf4077450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/880144588 shutdown_connections 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/880144588 wait complete. 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 Processor -- start 2024-04-19T22:47:46.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- start start 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf406aee0 0x7f7bf419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 0x7f7bf41a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf4118320 con 0x7f7bf4104d60 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf41181a0 con 0x7f7bf406aee0 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf41184a0 con 0x7f7bf41072f0 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43174/0 (socket says 172.21.15.113:43174) 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 -- 172.21.15.113:0/1036685129 learned_addr learned my addr 172.21.15.113:0/1036685129 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf3fff700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 0x7f7bf41a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf37fe700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf406aee0 0x7f7bf419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 -- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 msgr2=0x7f7bf41a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 0x7f7bf41a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 -- 172.21.15.113:0/1036685129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf406aee0 msgr2=0x7f7bf419e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf406aee0 0x7f7bf419e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 -- 172.21.15.113:0/1036685129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf41a36a0 con 0x7f7bf4104d60 2024-04-19T22:47:46.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf3fff700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 0x7f7bf41a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:46.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf2ffd700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7be800e9a0 tx=0x7f7be800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:46.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be800cbd0 con 0x7f7bf4104d60 2024-04-19T22:47:46.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f7be800cd70 con 0x7f7bf4104d60 2024-04-19T22:47:46.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8018680 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf41a3990 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf41ab210 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.200+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf404ff50 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.204+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f7be8010430 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.204+0000 7f7bf0ff9700 1 --2- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 0x7f7bdc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.204+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f7be808e2f0 con 0x7f7bf4104d60 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.204+0000 7f7bf37fe700 1 --2- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 0x7f7bdc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.204+0000 7f7bf37fe700 1 --2- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 0x7f7bdc070560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7be4005ea0 tx=0x7f7be4005e30 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:46.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.208+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7be805bc30 con 0x7f7bf4104d60 2024-04-19T22:47:46.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.412+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7bf41ab3e0 con 0x7f7bf4104d60 2024-04-19T22:47:46.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.412+0000 7f7bf0ff9700 1 -- 172.21.15.113:0/1036685129 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7be805f8e0 con 0x7f7bf4104d60 2024-04-19T22:47:46.413 INFO:teuthology.orchestra.run.smithi113.stdout:236223201320 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 msgr2=0x7f7bdc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 0x7f7bdc070560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7be4005ea0 tx=0x7f7be4005e30 comp rx=0 tx=0).stop 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 msgr2=0x7f7bf419ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7be800e9a0 tx=0x7f7be800ecb0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 shutdown_connections 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7bdc06e0a0 0x7f7bdc070560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7bf41072f0 0x7f7bf41a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf406aee0 0x7f7bf419e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 --2- 172.21.15.113:0/1036685129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7bf4104d60 0x7f7bf419ebd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 >> 172.21.15.113:0/1036685129 conn(0x7f7bf4077040 msgr2=0x7f7bf41002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:46.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 shutdown_connections 2024-04-19T22:47:46.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.416+0000 7f7bf9e48700 1 -- 172.21.15.113:0/1036685129 wait complete. 2024-04-19T22:47:46.822 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:46 smithi113 bash[28910]: cluster 2024-04-19T22:47:45.652338+0000 mgr.y (mgr.24389) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:46.823 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:46 smithi113 bash[28910]: audit 2024-04-19T22:47:46.417982+0000 mon.a (mon.0) 899 : audit 0 from='client.? 172.21.15.113:0/1036685129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-19T22:47:46.823 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:46 smithi113 bash[21528]: cluster 2024-04-19T22:47:45.652338+0000 mgr.y (mgr.24389) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:46.823 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:46 smithi113 bash[21528]: audit 2024-04-19T22:47:46.417982+0000 mon.a (mon.0) 899 : audit 0 from='client.? 172.21.15.113:0/1036685129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-19T22:47:46.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 -- 172.21.15.113:0/2590219901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006b5b0 msgr2=0x7f11a0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2590219901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006b5b0 0x7f11a0106f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1194009990 tx=0x7f1194009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 -- 172.21.15.113:0/2590219901 shutdown_connections 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2590219901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a0107650 0x7f11a010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2590219901 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a006ac00 0x7f11a006afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2590219901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006b5b0 0x7f11a0106f70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 -- 172.21.15.113:0/2590219901 >> 172.21.15.113:0/2590219901 conn(0x7f11a0077040 msgr2=0x7f11a0077450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 -- 172.21.15.113:0/2590219901 shutdown_connections 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.988+0000 7f11a84b7700 1 -- 172.21.15.113:0/2590219901 wait complete. 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 Processor -- start 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- start start 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 0x7f11a0198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 0x7f11a0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 0x7f11a019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f11a0111d80 con 0x7f11a006ac00 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f11a0111c00 con 0x7f11a006b5b0 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f11a0111f00 con 0x7f11a0107650 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6253700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 0x7f11a0198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 0x7f11a019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6253700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 0x7f11a0198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43184/0 (socket says 172.21.15.113:43184) 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6253700 1 -- 172.21.15.113:0/2877373463 learned_addr learned my addr 172.21.15.113:0/2877373463 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a5a52700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 0x7f11a0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 -- 172.21.15.113:0/2877373463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 msgr2=0x7f11a0198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 0x7f11a0198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 -- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 msgr2=0x7f11a0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 0x7f11a0198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 -- 172.21.15.113:0/2877373463 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a019d250 con 0x7f11a0107650 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a5a52700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 0x7f11a0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a6a54700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 0x7f11a019cb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f119800be20 tx=0x7f1198009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198019070 con 0x7f11a0107650 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f119800cc10 con 0x7f11a0107650 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a019d540 con 0x7f11a0107650 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980125a0 con 0x7f11a0107650 2024-04-19T22:47:46.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a01012f0 con 0x7f11a0107650 2024-04-19T22:47:46.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a004ff50 con 0x7f11a0107650 2024-04-19T22:47:46.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f119801c070 con 0x7f11a0107650 2024-04-19T22:47:46.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.992+0000 7f119f7fe700 1 --2- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 0x7f1188070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:46.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.996+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f119808d6b0 con 0x7f11a0107650 2024-04-19T22:47:46.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:46.996+0000 7f11a6253700 1 --2- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 0x7f1188070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:46.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.000+0000 7f11a6253700 1 --2- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 0x7f1188070560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1190005950 tx=0x7f119000b500 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:46.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.000+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f119805eca0 con 0x7f11a0107650 2024-04-19T22:47:47.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:46 smithi178 bash[23441]: cluster 2024-04-19T22:47:45.652338+0000 mgr.y (mgr.24389) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:47.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:46 smithi178 bash[23441]: audit 2024-04-19T22:47:46.417982+0000 mon.a (mon.0) 899 : audit 0 from='client.? 172.21.15.113:0/1036685129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-19T22:47:47.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.212+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f11a01015b0 con 0x7f11a0107650 2024-04-19T22:47:47.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.212+0000 7f119f7fe700 1 -- 172.21.15.113:0/2877373463 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f11980634d0 con 0x7f11a0107650 2024-04-19T22:47:47.213 INFO:teuthology.orchestra.run.smithi113.stdout:133143986248 2024-04-19T22:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 msgr2=0x7f1188070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 0x7f1188070560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1190005950 tx=0x7f119000b500 comp rx=0 tx=0).stop 2024-04-19T22:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 msgr2=0x7f11a019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 0x7f11a019cb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f119800be20 tx=0x7f1198009ed0 comp rx=0 tx=0).stop 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 shutdown_connections 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> v2:172.21.15.113:6800/3719359025 conn(0x7f118806e0a0 0x7f1188070560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11a0107650 0x7f11a019cb10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11a006ac00 0x7f11a0198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 --2- 172.21.15.113:0/2877373463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a006b5b0 0x7f11a0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:47.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 >> 172.21.15.113:0/2877373463 conn(0x7f11a0077040 msgr2=0x7f11a00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:47.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 shutdown_connections 2024-04-19T22:47:47.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:47.216+0000 7f11a84b7700 1 -- 172.21.15.113:0/2877373463 wait complete. 2024-04-19T22:47:47.577 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:48.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:47 smithi113 bash[21528]: audit 2024-04-19T22:47:47.217921+0000 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.113:0/2877373463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-19T22:47:48.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:47 smithi113 bash[28910]: audit 2024-04-19T22:47:47.217921+0000 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.113:0/2877373463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-19T22:47:48.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:47 smithi178 bash[23441]: audit 2024-04-19T22:47:47.217921+0000 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.113:0/2877373463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-19T22:47:48.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 -- 172.21.15.113:0/730669577 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074460 msgr2=0x7f5f4c074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:48.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/730669577 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074460 0x7f5f4c074840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009990 tx=0x7f5f3c009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 -- 172.21.15.113:0/730669577 shutdown_connections 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/730669577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/730669577 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074460 0x7f5f4c074840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/730669577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074d80 0x7f5f4c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 -- 172.21.15.113:0/730669577 >> 172.21.15.113:0/730669577 conn(0x7f5f4c079420 msgr2=0x7f5f4c079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 -- 172.21.15.113:0/730669577 shutdown_connections 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.792+0000 7f5f53ba5700 1 -- 172.21.15.113:0/730669577 wait complete. 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 Processor -- start 2024-04-19T22:47:48.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- start start 2024-04-19T22:47:48.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:48.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 0x7f5f4c19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:48.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:48.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c113f00 con 0x7f5f4c074460 2024-04-19T22:47:48.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c113d80 con 0x7f5f4c10ed30 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c114080 con 0x7f5f4c074d80 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51140700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 0x7f5f4c19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54060/0 (socket says 172.21.15.113:54060) 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51140700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 0x7f5f4c19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:50694/0 (socket says 172.21.15.113:50694) 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 -- 172.21.15.113:0/1365763093 learned_addr learned my addr 172.21.15.113:0/1365763093 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f52142700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 -- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 msgr2=0x7f5f4c19a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 0x7f5f4c19a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 -- 172.21.15.113:0/1365763093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 msgr2=0x7f5f4c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 -- 172.21.15.113:0/1365763093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c19f390 con 0x7f5f4c074460 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f52142700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:48.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51941700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000c00 tx=0x7f5f3c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c027070 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c19f620 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5f3c022470 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c1a6f00 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c017650 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f30005120 con 0x7f5f4c074460 2024-04-19T22:47:48.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f5f3c02a070 con 0x7f5f4c074460 2024-04-19T22:47:48.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 --2- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 0x7f5f38070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:48.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f5f3c08eef0 con 0x7f5f4c074460 2024-04-19T22:47:48.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.796+0000 7f5f51140700 1 --2- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 0x7f5f38070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:48.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.800+0000 7f5f51140700 1 --2- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 0x7f5f38070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009680 tx=0x7f5f48009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:48.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:48.804+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5f3c013070 con 0x7f5f4c074460 2024-04-19T22:47:49.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.016+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5f300056e0 con 0x7f5f4c074460 2024-04-19T22:47:49.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.016+0000 7f5f42ffd700 1 -- 172.21.15.113:0/1365763093 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f3c05c7b0 con 0x7f5f4c074460 2024-04-19T22:47:49.015 INFO:teuthology.orchestra.run.smithi113.stdout:34359738482 2024-04-19T22:47:49.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 msgr2=0x7f5f38070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:49.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 0x7f5f38070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009680 tx=0x7f5f48009260 comp rx=0 tx=0).stop 2024-04-19T22:47:49.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 msgr2=0x7f5f4c19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:49.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000c00 tx=0x7f5f3c0057c0 comp rx=0 tx=0).stop 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 shutdown_connections 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5f3806e0a0 0x7f5f38070560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4c10ed30 0x7f5f4c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5f4c074460 0x7f5f4c19a380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 --2- 172.21.15.113:0/1365763093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5f4c074d80 0x7f5f4c19a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 >> 172.21.15.113:0/1365763093 conn(0x7f5f4c079420 msgr2=0x7f5f4c106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 shutdown_connections 2024-04-19T22:47:49.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:49.020+0000 7f5f53ba5700 1 -- 172.21.15.113:0/1365763093 wait complete. 2024-04-19T22:47:49.031 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:48 smithi113 bash[28910]: cluster 2024-04-19T22:47:47.653050+0000 mgr.y (mgr.24389) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:49.031 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:48 smithi113 bash[21528]: cluster 2024-04-19T22:47:47.653050+0000 mgr.y (mgr.24389) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:49.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:48 smithi178 bash[23441]: cluster 2024-04-19T22:47:47.653050+0000 mgr.y (mgr.24389) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:49.587 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201316 got 236223201320 for osd.7 2024-04-19T22:47:49.587 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:49.634 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:49 smithi113 bash[28910]: audit 2024-04-19T22:47:48.912373+0000 mon.a (mon.0) 900 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:49.634 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:49 smithi113 bash[28910]: audit 2024-04-19T22:47:49.019780+0000 mon.a (mon.0) 901 : audit 0 from='client.? 172.21.15.113:0/1365763093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-19T22:47:49.634 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:49 smithi113 bash[21528]: audit 2024-04-19T22:47:48.912373+0000 mon.a (mon.0) 900 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:49.634 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:49 smithi113 bash[21528]: audit 2024-04-19T22:47:49.019780+0000 mon.a (mon.0) 901 : audit 0 from='client.? 172.21.15.113:0/1365763093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-19T22:47:50.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:49 smithi178 bash[23441]: audit 2024-04-19T22:47:48.912373+0000 mon.a (mon.0) 900 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:47:50.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:49 smithi178 bash[23441]: audit 2024-04-19T22:47:49.019780+0000 mon.a (mon.0) 901 : audit 0 from='client.? 172.21.15.113:0/1365763093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-19T22:47:51.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:50 smithi113 bash[21528]: cluster 2024-04-19T22:47:49.653772+0000 mgr.y (mgr.24389) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:51.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:50 smithi113 bash[28910]: cluster 2024-04-19T22:47:49.653772+0000 mgr.y (mgr.24389) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:51.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:50 smithi178 bash[23441]: cluster 2024-04-19T22:47:49.653772+0000 mgr.y (mgr.24389) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:51.414 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986243 got 133143986248 for osd.4 2024-04-19T22:47:51.414 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:51.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738478 got 34359738482 for osd.0 2024-04-19T22:47:51.971 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- 172.21.15.113:0/1450847206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c10ef30 msgr2=0x7fab8c111320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- 172.21.15.113:0/1450847206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c10ef30 0x7fab8c111320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab84009f90 tx=0x7fab8400b330 comp rx=0 tx=0).stop 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- 172.21.15.113:0/1450847206 shutdown_connections 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- 172.21.15.113:0/1450847206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c10ef30 0x7fab8c111320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- 172.21.15.113:0/1450847206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c1033a0 0x7fab8c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- 172.21.15.113:0/1450847206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c100cf0 0x7fab8c101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- 172.21.15.113:0/1450847206 >> 172.21.15.113:0/1450847206 conn(0x7fab8c077760 msgr2=0x7fab8c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- 172.21.15.113:0/1450847206 shutdown_connections 2024-04-19T22:47:52.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- 172.21.15.113:0/1450847206 wait complete. 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 Processor -- start 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- start start 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 0x7fab8c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 0x7fab8c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c114140 con 0x7fab8c1033a0 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c113fc0 con 0x7fab8c10ef30 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab922ec700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c1142c0 con 0x7fab8c100cf0 2024-04-19T22:47:52.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 0x7fab8c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:50740/0 (socket says 172.21.15.113:50740) 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.388+0000 7fab8bfff700 1 -- 172.21.15.113:0/1551609679 learned_addr learned my addr 172.21.15.113:0/1551609679 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab90889700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 0x7fab8c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 -- 172.21.15.113:0/1551609679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 msgr2=0x7fab8c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 0x7fab8c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 -- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 msgr2=0x7fab8c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 0x7fab8c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 -- 172.21.15.113:0/1551609679 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c19f590 con 0x7fab8c100cf0 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8b7fe700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 0x7fab8c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab90889700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 0x7fab8c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:52.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8bfff700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b530 tx=0x7fab7c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c015020 con 0x7fab8c100cf0 2024-04-19T22:47:52.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fab7c011ce0 con 0x7fab8c100cf0 2024-04-19T22:47:52.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c19f880 con 0x7fab8c100cf0 2024-04-19T22:47:52.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c010e10 con 0x7fab8c100cf0 2024-04-19T22:47:52.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a7100 con 0x7fab8c100cf0 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c04ff50 con 0x7fab8c100cf0 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fab7c018020 con 0x7fab8c100cf0 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 --2- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 0x7fab74070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8b7fe700 1 --2- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 0x7fab74070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fab7c08da20 con 0x7fab8c100cf0 2024-04-19T22:47:52.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.392+0000 7fab8b7fe700 1 --2- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 0x7fab74070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab80009750 tx=0x7fab80009310 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.396+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fab7c01f020 con 0x7fab8c100cf0 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 -- 172.21.15.113:0/133447409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b4108360 msgr2=0x7f77b4108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 --2- 172.21.15.113:0/133447409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b4108360 0x7f77b4108740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009990 tx=0x7f77a4009ca0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 -- 172.21.15.113:0/133447409 shutdown_connections 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 --2- 172.21.15.113:0/133447409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4102ca0 0x7f77b410f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 --2- 172.21.15.113:0/133447409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b4108360 0x7f77b4108740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 --2- 172.21.15.113:0/133447409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b41022e0 0x7f77b4102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 -- 172.21.15.113:0/133447409 >> 172.21.15.113:0/133447409 conn(0x7f77b40793a0 msgr2=0x7f77b40797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 -- 172.21.15.113:0/133447409 shutdown_connections 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.364+0000 7f77ba120700 1 -- 172.21.15.113:0/133447409 wait complete. 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 Processor -- start 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- start start 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b41022e0 0x7f77b4198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 0x7f77b419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f77b4111d00 con 0x7f77b4102ca0 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f77b4111b80 con 0x7f77b4108360 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f77b4111e80 con 0x7f77b41022e0 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54080/0 (socket says 172.21.15.113:54080) 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 -- 172.21.15.113:0/1493597998 learned_addr learned my addr 172.21.15.113:0/1493597998 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b37fe700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b41022e0 0x7f77b4198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b3fff700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 0x7f77b419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 -- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b41022e0 msgr2=0x7f77b4198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b41022e0 0x7f77b4198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 -- 172.21.15.113:0/1493597998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 msgr2=0x7f77b419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 0x7f77b419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 -- 172.21.15.113:0/1493597998 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b419d150 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b3fff700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 0x7f77b419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b2ffd700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77a800e9a0 tx=0x7f77a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a800cbd0 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f77a800cd70 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b419d440 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8018680 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b41a4cc0 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b404ff50 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f77a8010430 con 0x7f77b4102ca0 2024-04-19T22:47:52.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.368+0000 7f77b0ff9700 1 --2- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 0x7f779c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.372+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f77a808e560 con 0x7f77b4102ca0 2024-04-19T22:47:52.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.372+0000 7f77b37fe700 1 --2- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 0x7f779c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.372+0000 7f77b37fe700 1 --2- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 0x7f779c070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77a4005b00 tx=0x7f77a4005a90 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.380+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f77a805bea0 con 0x7f77b4102ca0 2024-04-19T22:47:52.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f77b41a4f20 con 0x7f77b4102ca0 2024-04-19T22:47:52.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77b0ff9700 1 -- 172.21.15.113:0/1493597998 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77a805fb50 con 0x7f77b4102ca0 2024-04-19T22:47:52.622 INFO:teuthology.orchestra.run.smithi113.stdout:201863462964 2024-04-19T22:47:52.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- 172.21.15.113:0/2548142966 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 msgr2=0x7f310006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- 172.21.15.113:0/2548142966 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f310006a5d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009920 tx=0x7f30fc009c30 comp rx=0 tx=0).stop 2024-04-19T22:47:52.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- 172.21.15.113:0/2548142966 shutdown_connections 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- 172.21.15.113:0/2548142966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3100107640 0x7f310010f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- 172.21.15.113:0/2548142966 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f310006a5d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- 172.21.15.113:0/2548142966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f310006aba0 0x7f3100106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- 172.21.15.113:0/2548142966 >> 172.21.15.113:0/2548142966 conn(0x7f31000771d0 msgr2=0x7f31000775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- 172.21.15.113:0/2548142966 shutdown_connections 2024-04-19T22:47:52.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- 172.21.15.113:0/2548142966 wait complete. 2024-04-19T22:47:52.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 Processor -- start 2024-04-19T22:47:52.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- start start 2024-04-19T22:47:52.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f31001981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f310006aba0 0x7f3100198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 0x7f310019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111c90 con 0x7f3100107640 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111b10 con 0x7f310006aba0 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3108190700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f3100111e10 con 0x7f310006a1f0 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3105f2c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f31001981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3105f2c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f31001981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:50764/0 (socket says 172.21.15.113:50764) 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 0x7f310019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f3105f2c700 1 -- 172.21.15.113:0/1099037156 learned_addr learned my addr 172.21.15.113:0/1099037156 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310572b700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f310006aba0 0x7f3100198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 -- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 msgr2=0x7f31001981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f31001981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 -- 172.21.15.113:0/1099037156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f310006aba0 msgr2=0x7f3100198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f310006aba0 0x7f3100198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 -- 172.21.15.113:0/1099037156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310019d1b0 con 0x7f3100107640 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f310672d700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 0x7f310019ca70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30f800cc50 tx=0x7f30f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8016020 con 0x7f3100107640 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310019d4a0 con 0x7f3100107640 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 msgr2=0x7f779c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 0x7f779c070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77a4005b00 tx=0x7f77a4005a90 comp rx=0 tx=0).stop 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 msgr2=0x7f77b4198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.624+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77a800e9a0 tx=0x7f77a800ecb0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 shutdown_connections 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> v2:172.21.15.113:6800/3719359025 conn(0x7f779c06e0a0 0x7f779c070560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77b4108360 0x7f77b419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77b41022e0 0x7f77b4198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 --2- 172.21.15.113:0/1493597998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77b4102ca0 0x7f77b4198680 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77a800e9a0 tx=0x7f77a800ecb0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 >> 172.21.15.113:0/1493597998 conn(0x7f77b40793a0 msgr2=0x7f77b4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f30f8012420 con 0x7f3100107640 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001a4d20 con 0x7f3100107640 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 shutdown_connections 2024-04-19T22:47:52.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f77ba120700 1 -- 172.21.15.113:0/1493597998 wait complete. 2024-04-19T22:47:52.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f80115e0 con 0x7f3100107640 2024-04-19T22:47:52.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310004ff50 con 0x7f3100107640 2024-04-19T22:47:52.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f30f8019020 con 0x7f3100107640 2024-04-19T22:47:52.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 --2- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 0x7f30ec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f30f808deb0 con 0x7f3100107640 2024-04-19T22:47:52.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f3105f2c700 1 --2- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 0x7f30ec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.628+0000 7f3105f2c700 1 --2- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 0x7f30ec070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009680 tx=0x7f30fc019040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.632+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f30f8020020 con 0x7f3100107640 2024-04-19T22:47:52.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fab8c19b8e0 con 0x7fab8c100cf0 2024-04-19T22:47:52.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab897fa700 1 -- 172.21.15.113:0/1551609679 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fab7c05b240 con 0x7fab8c100cf0 2024-04-19T22:47:52.651 INFO:teuthology.orchestra.run.smithi113.stdout:167503724606 2024-04-19T22:47:52.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 msgr2=0x7fab74070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 0x7fab74070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab80009750 tx=0x7fab80009310 comp rx=0 tx=0).stop 2024-04-19T22:47:52.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 msgr2=0x7fab8c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b530 tx=0x7fab7c00b840 comp rx=0 tx=0).stop 2024-04-19T22:47:52.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 shutdown_connections 2024-04-19T22:47:52.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> v2:172.21.15.113:6800/3719359025 conn(0x7fab7406e0a0 0x7fab74070560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab8c10ef30 0x7fab8c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fab8c100cf0 0x7fab8c19a580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 --2- 172.21.15.113:0/1551609679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fab8c1033a0 0x7fab8c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.652+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 >> 172.21.15.113:0/1551609679 conn(0x7fab8c077760 msgr2=0x7fab8c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.660+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 shutdown_connections 2024-04-19T22:47:52.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.660+0000 7fab922ec700 1 -- 172.21.15.113:0/1551609679 wait complete. 2024-04-19T22:47:52.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[28910]: cluster 2024-04-19T22:47:51.654396+0000 mgr.y (mgr.24389) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:52.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[28910]: audit 2024-04-19T22:47:52.626845+0000 mon.a (mon.0) 902 : audit 0 from='client.? 172.21.15.113:0/1493597998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-19T22:47:52.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[28910]: audit 2024-04-19T22:47:52.655869+0000 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.113:0/1551609679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-19T22:47:52.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[21528]: cluster 2024-04-19T22:47:51.654396+0000 mgr.y (mgr.24389) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:52.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[21528]: audit 2024-04-19T22:47:52.626845+0000 mon.a (mon.0) 902 : audit 0 from='client.? 172.21.15.113:0/1493597998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-19T22:47:52.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:52 smithi113 bash[21528]: audit 2024-04-19T22:47:52.655869+0000 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.113:0/1551609679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/2295205814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 msgr2=0x7f223006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- 172.21.15.113:0/2295205814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f223006a5d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22200099c0 tx=0x7f2220009cd0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/2295205814 shutdown_connections 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- 172.21.15.113:0/2295205814 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 0x7f223010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- 172.21.15.113:0/2295205814 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f223006a5d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- 172.21.15.113:0/2295205814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f2230106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/2295205814 >> 172.21.15.113:0/2295205814 conn(0x7f22300771d0 msgr2=0x7f22300775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/2295205814 shutdown_connections 2024-04-19T22:47:52.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/2295205814 wait complete. 2024-04-19T22:47:52.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 Processor -- start 2024-04-19T22:47:52.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- start start 2024-04-19T22:47:52.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f22301017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 0x7f2230101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2230111cd0 con 0x7f22301075a0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2230111b50 con 0x7f223006aba0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f2230111e50 con 0x7f223006a1f0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:50782/0 (socket says 172.21.15.113:50782) 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 -- 172.21.15.113:0/3761520838 learned_addr learned my addr 172.21.15.113:0/3761520838 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222ed9d700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 0x7f2230101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222dd9b700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f22301017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 -- 172.21.15.113:0/3761520838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 msgr2=0x7f22301017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f22301017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 -- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 msgr2=0x7f2230101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 0x7f2230101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 -- 172.21.15.113:0/3761520838 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22301a6680 con 0x7f223006a1f0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222dd9b700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f22301017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f222e59c700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2220006010 tx=0x7f2220003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220009e60 con 0x7f223006a1f0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f222000f460 con 0x7f223006a1f0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22301a6910 con 0x7f223006a1f0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22301a6dc0 con 0x7f223006a1f0 2024-04-19T22:47:52.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.816+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220017650 con 0x7f223006a1f0 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2210005120 con 0x7f223006a1f0 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f222000f610 con 0x7f223006a1f0 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f221f7fe700 1 --2- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 0x7f2218070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f222008edb0 con 0x7f223006a1f0 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f222dd9b700 1 --2- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 0x7f2218070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:47:52.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.820+0000 7f222dd9b700 1 --2- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 0x7f2218070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230100d80 tx=0x7f2224008040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:47:52.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.824+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2220013070 con 0x7f223006a1f0 2024-04-19T22:47:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.860+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f31001a5010 con 0x7f3100107640 2024-04-19T22:47:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f30f6ffd700 1 -- 172.21.15.113:0/1099037156 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30f805b7f0 con 0x7f3100107640 2024-04-19T22:47:52.862 INFO:teuthology.orchestra.run.smithi113.stdout:77309411423 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 msgr2=0x7f30ec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 0x7f30ec070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009680 tx=0x7f30fc019040 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 msgr2=0x7f310019ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 0x7f310019ca70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30f800cc50 tx=0x7f30f800cf60 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 shutdown_connections 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> v2:172.21.15.113:6800/3719359025 conn(0x7f30ec06e0a0 0x7f30ec070560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3100107640 0x7f310019ca70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f310006a1f0 0x7f31001981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 --2- 172.21.15.113:0/1099037156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f310006aba0 0x7f3100198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 >> 172.21.15.113:0/1099037156 conn(0x7f31000771d0 msgr2=0x7f31000ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:52.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 shutdown_connections 2024-04-19T22:47:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:52.864+0000 7f3108190700 1 -- 172.21.15.113:0/1099037156 wait complete. 2024-04-19T22:47:53.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.032+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f22100056e0 con 0x7f223006a1f0 2024-04-19T22:47:53.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.032+0000 7f221f7fe700 1 -- 172.21.15.113:0/3761520838 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f22200603a0 con 0x7f223006a1f0 2024-04-19T22:47:53.033 INFO:teuthology.orchestra.run.smithi113.stdout:111669149780 2024-04-19T22:47:53.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 msgr2=0x7f2218070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:53.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 0x7f2218070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230100d80 tx=0x7f2224008040 comp rx=0 tx=0).stop 2024-04-19T22:47:53.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 msgr2=0x7f2230101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:47:53.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2220006010 tx=0x7f2220003ba0 comp rx=0 tx=0).stop 2024-04-19T22:47:53.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 shutdown_connections 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> v2:172.21.15.113:6800/3719359025 conn(0x7f221806e0a0 0x7f2218070560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22301075a0 0x7f2230101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f223006a1f0 0x7f2230101290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 --2- 172.21.15.113:0/3761520838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223006aba0 0x7f22301017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 >> 172.21.15.113:0/3761520838 conn(0x7f22300771d0 msgr2=0x7f22300ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 shutdown_connections 2024-04-19T22:47:53.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:47:53.036+0000 7f2234e16700 1 -- 172.21.15.113:0/3761520838 wait complete. 2024-04-19T22:47:53.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:52 smithi178 bash[23441]: cluster 2024-04-19T22:47:51.654396+0000 mgr.y (mgr.24389) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:47:53.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:52 smithi178 bash[23441]: audit 2024-04-19T22:47:52.626845+0000 mon.a (mon.0) 902 : audit 0 from='client.? 172.21.15.113:0/1493597998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-19T22:47:53.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:52 smithi178 bash[23441]: audit 2024-04-19T22:47:52.655869+0000 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.113:0/1551609679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-19T22:47:54.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:53 smithi113 bash[28910]: audit 2024-04-19T22:47:52.866415+0000 mon.a (mon.0) 903 : audit 0 from='client.? 172.21.15.113:0/1099037156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-19T22:47:54.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:53 smithi113 bash[28910]: audit 2024-04-19T22:47:53.037186+0000 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.113:0/3761520838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-19T22:47:54.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:53 smithi113 bash[21528]: audit 2024-04-19T22:47:52.866415+0000 mon.a (mon.0) 903 : audit 0 from='client.? 172.21.15.113:0/1099037156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-19T22:47:54.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:53 smithi113 bash[21528]: audit 2024-04-19T22:47:53.037186+0000 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.113:0/3761520838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-19T22:47:54.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:53 smithi178 bash[23441]: audit 2024-04-19T22:47:52.866415+0000 mon.a (mon.0) 903 : audit 0 from='client.? 172.21.15.113:0/1099037156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-19T22:47:54.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:53 smithi178 bash[23441]: audit 2024-04-19T22:47:53.037186+0000 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.113:0/3761520838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-19T22:47:54.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411418 got 77309411423 for osd.2 2024-04-19T22:47:54.922 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:54.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462958 got 201863462964 for osd.6 2024-04-19T22:47:54.923 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:54.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724601 got 167503724606 for osd.5 2024-04-19T22:47:54.923 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:54.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149775 got 111669149780 for osd.3 2024-04-19T22:47:54.957 DEBUG:teuthology.parallel:result is None 2024-04-19T22:47:54.957 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-19T22:47:54.957 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph pg dump --format=json 2024-04-19T22:47:55.006 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:54 smithi113 bash[28910]: cluster 2024-04-19T22:47:53.655059+0000 mgr.y (mgr.24389) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:55.006 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:54 smithi113 bash[21528]: cluster 2024-04-19T22:47:53.655059+0000 mgr.y (mgr.24389) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:55.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:47:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:47:55.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:54 smithi178 bash[23441]: cluster 2024-04-19T22:47:53.655059+0000 mgr.y (mgr.24389) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:47:56.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:55 smithi113 bash[28910]: audit 2024-04-19T22:47:54.682265+0000 mgr.y (mgr.24389) 102 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:56.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:55 smithi113 bash[21528]: audit 2024-04-19T22:47:54.682265+0000 mgr.y (mgr.24389) 102 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:56.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:55 smithi178 bash[23441]: audit 2024-04-19T22:47:54.682265+0000 mgr.y (mgr.24389) 102 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:47:57.044 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:56 smithi113 bash[28910]: cluster 2024-04-19T22:47:55.656483+0000 mgr.y (mgr.24389) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:57.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:56 smithi113 bash[21528]: cluster 2024-04-19T22:47:55.656483+0000 mgr.y (mgr.24389) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:57.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:56 smithi178 bash[23441]: cluster 2024-04-19T22:47:55.656483+0000 mgr.y (mgr.24389) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:47:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:47:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:47:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:47:59.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:47:58 smithi113 bash[21528]: cluster 2024-04-19T22:47:57.657162+0000 mgr.y (mgr.24389) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:47:59.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:47:58 smithi113 bash[28910]: cluster 2024-04-19T22:47:57.657162+0000 mgr.y (mgr.24389) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:47:59.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:47:58 smithi178 bash[23441]: cluster 2024-04-19T22:47:57.657162+0000 mgr.y (mgr.24389) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:47:59.779 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:48:00.991 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:00 smithi113 bash[21528]: cluster 2024-04-19T22:47:59.658647+0000 mgr.y (mgr.24389) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:00.991 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:00 smithi113 bash[28910]: cluster 2024-04-19T22:47:59.658647+0000 mgr.y (mgr.24389) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:01.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:00 smithi178 bash[23441]: cluster 2024-04-19T22:47:59.658647+0000 mgr.y (mgr.24389) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/3015761202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806b5b0 msgr2=0x7fdd38106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- 172.21.15.113:0/3015761202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806b5b0 0x7fdd38106f70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009990 tx=0x7fdd28009ca0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/3015761202 shutdown_connections 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- 172.21.15.113:0/3015761202 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd38107650 0x7fdd3810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- 172.21.15.113:0/3015761202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd3806ac00 0x7fdd3806afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- 172.21.15.113:0/3015761202 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806b5b0 0x7fdd38106f70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/3015761202 >> 172.21.15.113:0/3015761202 conn(0x7fdd38077040 msgr2=0x7fdd38077450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/3015761202 shutdown_connections 2024-04-19T22:48:02.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/3015761202 wait complete. 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 Processor -- start 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- start start 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 0x7fdd38198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd38107650 0x7fdd3819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:02.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38111d40 con 0x7fdd3806ac00 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38111bc0 con 0x7fdd38107650 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fdd38111ec0 con 0x7fdd3806b5b0 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 0x7fdd38198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd367fc700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd367fc700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:34188/0 (socket says 172.21.15.113:34188) 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd367fc700 1 -- 172.21.15.113:0/2553959438 learned_addr learned my addr 172.21.15.113:0/2553959438 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd377fe700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd38107650 0x7fdd3819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 -- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 msgr2=0x7fdd381987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 -- 172.21.15.113:0/2553959438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd38107650 msgr2=0x7fdd3819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd38107650 0x7fdd3819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:02.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 -- 172.21.15.113:0/2553959438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3819d270 con 0x7fdd3806ac00 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd367fc700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd36ffd700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 0x7fdd38198260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00b450 tx=0x7fdd2c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c015020 con 0x7fdd3806ac00 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3819d560 con 0x7fdd3806ac00 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fdd2c011ce0 con 0x7fdd3806ac00 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c010cc0 con 0x7fdd3806ac00 2024-04-19T22:48:02.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.920+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd381a4de0 con 0x7fdd3806ac00 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3804ff50 con 0x7fdd3806ac00 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fdd2c018020 con 0x7fdd3806ac00 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd1ffff700 1 --2- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 0x7fdd20070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fdd2c08d790 con 0x7fdd3806ac00 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd367fc700 1 --2- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 0x7fdd20070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:02.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.924+0000 7fdd367fc700 1 --2- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 0x7fdd20070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd38100f90 tx=0x7fdd28005c00 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:02.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:02.928+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fdd2c01f020 con 0x7fdd3806ac00 2024-04-19T22:48:03.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:02 smithi113 bash[28910]: cluster 2024-04-19T22:48:01.659292+0000 mgr.y (mgr.24389) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:02 smithi113 bash[21528]: cluster 2024-04-19T22:48:01.659292+0000 mgr.y (mgr.24389) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:03.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:02 smithi178 bash[23441]: cluster 2024-04-19T22:48:01.659292+0000 mgr.y (mgr.24389) 106 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:03.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.128+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 --> v2:172.21.15.113:6800/3719359025 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd380ff870 con 0x7fdd2006e0a0 2024-04-19T22:48:03.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.164+0000 7fdd1ffff700 1 -- 172.21.15.113:0/2553959438 <== mgr.24389 v2:172.21.15.113:6800/3719359025 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346503 (secure 0 0 0) 0x7fdd380ff870 con 0x7fdd2006e0a0 2024-04-19T22:48:03.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 msgr2=0x7fdd20070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 0x7fdd20070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd38100f90 tx=0x7fdd28005c00 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 msgr2=0x7fdd38198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 0x7fdd38198260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00b450 tx=0x7fdd2c00b760 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 shutdown_connections 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> v2:172.21.15.113:6800/3719359025 conn(0x7fdd2006e0a0 0x7fdd20070560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd38107650 0x7fdd3819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd3806ac00 0x7fdd38198260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 --2- 172.21.15.113:0/2553959438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdd3806b5b0 0x7fdd381987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 >> 172.21.15.113:0/2553959438 conn(0x7fdd38077040 msgr2=0x7fdd380ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:03.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 shutdown_connections 2024-04-19T22:48:03.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:03.168+0000 7fdd3d531700 1 -- 172.21.15.113:0/2553959438 wait complete. 2024-04-19T22:48:03.172 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-19T22:48:04.012 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:03 smithi113 bash[21528]: audit 2024-04-19T22:48:03.133659+0000 mgr.y (mgr.24389) 107 : audit 0 from='client.14685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:04.013 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:03 smithi113 bash[28910]: audit 2024-04-19T22:48:03.133659+0000 mgr.y (mgr.24389) 107 : audit 0 from='client.14685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:04.014 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-19T22:48:01.658911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1100,"num_read_kb":946,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236272,"kb_used_data":7644,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":749724944,"statfs":{"total":767960285184,"available":767718342656,"internally_reserved":0,"allocated":7827456,"data_stored":4145033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005669"},"pg_stats":[{"pgid":"6.1b","version":"68'1","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725595+0000","last_change":"2024-04-19T22:45:15.537133+0000","last_active":"2024-04-19T22:46:03.725595+0000","last_peered":"2024-04-19T22:46:03.725595+0000","last_clean":"2024-04-19T22:46:03.725595+0000","last_became_active":"2024-04-19T22:45:15.536240+0000","last_became_peered":"2024-04-19T22:45:15.536240+0000","last_unstale":"2024-04-19T22:46:03.725595+0000","last_undegraded":"2024-04-19T22:46:03.725595+0000","last_fullsized":"2024-04-19T22:46:03.725595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:16:00.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589811+0000","last_change":"2024-04-19T22:45:13.189643+0000","last_active":"2024-04-19T22:46:03.589811+0000","last_peered":"2024-04-19T22:46:03.589811+0000","last_clean":"2024-04-19T22:46:03.589811+0000","last_became_active":"2024-04-19T22:45:13.188568+0000","last_became_peered":"2024-04-19T22:45:13.188568+0000","last_unstale":"2024-04-19T22:46:03.589811+0000","last_undegraded":"2024-04-19T22:46:03.589811+0000","last_fullsized":"2024-04-19T22:46:03.589811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:37:03.414597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787741+0000","last_change":"2024-04-19T22:45:56.773957+0000","last_active":"2024-04-19T22:46:03.787741+0000","last_peered":"2024-04-19T22:46:03.787741+0000","last_clean":"2024-04-19T22:46:03.787741+0000","last_became_active":"2024-04-19T22:45:56.772983+0000","last_became_peered":"2024-04-19T22:45:56.772983+0000","last_unstale":"2024-04-19T22:46:03.787741+0000","last_undegraded":"2024-04-19T22:46:03.787741+0000","last_fullsized":"2024-04-19T22:46:03.787741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:42:02.461796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725997+0000","last_change":"2024-04-19T22:45:10.803875+0000","last_active":"2024-04-19T22:46:03.725997+0000","last_peered":"2024-04-19T22:46:03.725997+0000","last_clean":"2024-04-19T22:46:03.725997+0000","last_became_active":"2024-04-19T22:45:10.803345+0000","last_became_peered":"2024-04-19T22:45:10.803345+0000","last_unstale":"2024-04-19T22:46:03.725997+0000","last_undegraded":"2024-04-19T22:46:03.725997+0000","last_fullsized":"2024-04-19T22:46:03.725997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:47:54.732753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589778+0000","last_change":"2024-04-19T22:45:15.203489+0000","last_active":"2024-04-19T22:46:03.589778+0000","last_peered":"2024-04-19T22:46:03.589778+0000","last_clean":"2024-04-19T22:46:03.589778+0000","last_became_active":"2024-04-19T22:45:15.202603+0000","last_became_peered":"2024-04-19T22:45:15.202603+0000","last_unstale":"2024-04-19T22:46:03.589778+0000","last_undegraded":"2024-04-19T22:46:03.589778+0000","last_fullsized":"2024-04-19T22:46:03.589778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:00:46.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591694+0000","last_change":"2024-04-19T22:45:13.178550+0000","last_active":"2024-04-19T22:46:03.591694+0000","last_peered":"2024-04-19T22:46:03.591694+0000","last_clean":"2024-04-19T22:46:03.591694+0000","last_became_active":"2024-04-19T22:45:13.178015+0000","last_became_peered":"2024-04-19T22:45:13.178015+0000","last_unstale":"2024-04-19T22:46:03.591694+0000","last_undegraded":"2024-04-19T22:46:03.591694+0000","last_fullsized":"2024-04-19T22:46:03.591694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:52:43.608099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726561+0000","last_change":"2024-04-19T22:45:08.580974+0000","last_active":"2024-04-19T22:46:03.726561+0000","last_peered":"2024-04-19T22:46:03.726561+0000","last_clean":"2024-04-19T22:46:03.726561+0000","last_became_active":"2024-04-19T22:45:08.580512+0000","last_became_peered":"2024-04-19T22:45:08.580512+0000","last_unstale":"2024-04-19T22:46:03.726561+0000","last_undegraded":"2024-04-19T22:46:03.726561+0000","last_fullsized":"2024-04-19T22:46:03.726561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:42:31.681990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787839+0000","last_change":"2024-04-19T22:45:10.804508+0000","last_active":"2024-04-19T22:46:03.787839+0000","last_peered":"2024-04-19T22:46:03.787839+0000","last_clean":"2024-04-19T22:46:03.787839+0000","last_became_active":"2024-04-19T22:45:10.804245+0000","last_became_peered":"2024-04-19T22:45:10.804245+0000","last_unstale":"2024-04-19T22:46:03.787839+0000","last_undegraded":"2024-04-19T22:46:03.787839+0000","last_fullsized":"2024-04-19T22:46:03.787839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:49:05.720219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787602+0000","last_change":"2024-04-19T22:45:15.218720+0000","last_active":"2024-04-19T22:46:03.787602+0000","last_peered":"2024-04-19T22:46:03.787602+0000","last_clean":"2024-04-19T22:46:03.787602+0000","last_became_active":"2024-04-19T22:45:15.217965+0000","last_became_peered":"2024-04-19T22:45:15.217965+0000","last_unstale":"2024-04-19T22:46:03.787602+0000","last_undegraded":"2024-04-19T22:46:03.787602+0000","last_fullsized":"2024-04-19T22:46:03.787602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:27:30.329420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788901+0000","last_change":"2024-04-19T22:45:13.183705+0000","last_active":"2024-04-19T22:46:03.788901+0000","last_peered":"2024-04-19T22:46:03.788901+0000","last_clean":"2024-04-19T22:46:03.788901+0000","last_became_active":"2024-04-19T22:45:13.182998+0000","last_became_peered":"2024-04-19T22:45:13.182998+0000","last_unstale":"2024-04-19T22:46:03.788901+0000","last_undegraded":"2024-04-19T22:46:03.788901+0000","last_fullsized":"2024-04-19T22:46:03.788901+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:35:31.957708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790523+0000","last_change":"2024-04-19T22:45:08.573062+0000","last_active":"2024-04-19T22:46:03.790523+0000","last_peered":"2024-04-19T22:46:03.790523+0000","last_clean":"2024-04-19T22:46:03.790523+0000","last_became_active":"2024-04-19T22:45:08.572630+0000","last_became_peered":"2024-04-19T22:45:08.572630+0000","last_unstale":"2024-04-19T22:46:03.790523+0000","last_undegraded":"2024-04-19T22:46:03.790523+0000","last_fullsized":"2024-04-19T22:46:03.790523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:19:52.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788336+0000","last_change":"2024-04-19T22:45:10.793078+0000","last_active":"2024-04-19T22:46:03.788336+0000","last_peered":"2024-04-19T22:46:03.788336+0000","last_clean":"2024-04-19T22:46:03.788336+0000","last_became_active":"2024-04-19T22:45:10.792634+0000","last_became_peered":"2024-04-19T22:45:10.792634+0000","last_unstale":"2024-04-19T22:46:03.788336+0000","last_undegraded":"2024-04-19T22:46:03.788336+0000","last_fullsized":"2024-04-19T22:46:03.788336+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:01:26.012319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786878+0000","last_change":"2024-04-19T22:45:15.207174+0000","last_active":"2024-04-19T22:46:03.786878+0000","last_peered":"2024-04-19T22:46:03.786878+0000","last_clean":"2024-04-19T22:46:03.786878+0000","last_became_active":"2024-04-19T22:45:15.206413+0000","last_became_peered":"2024-04-19T22:45:15.206413+0000","last_unstale":"2024-04-19T22:46:03.786878+0000","last_undegraded":"2024-04-19T22:46:03.786878+0000","last_fullsized":"2024-04-19T22:46:03.786878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:34:53.780597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787743+0000","last_change":"2024-04-19T22:45:13.188828+0000","last_active":"2024-04-19T22:46:03.787743+0000","last_peered":"2024-04-19T22:46:03.787743+0000","last_clean":"2024-04-19T22:46:03.787743+0000","last_became_active":"2024-04-19T22:45:13.187218+0000","last_became_peered":"2024-04-19T22:45:13.187218+0000","last_unstale":"2024-04-19T22:46:03.787743+0000","last_undegraded":"2024-04-19T22:46:03.787743+0000","last_fullsized":"2024-04-19T22:46:03.787743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:31:20.720958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789414+0000","last_change":"2024-04-19T22:45:08.580915+0000","last_active":"2024-04-19T22:46:03.789414+0000","last_peered":"2024-04-19T22:46:03.789414+0000","last_clean":"2024-04-19T22:46:03.789414+0000","last_became_active":"2024-04-19T22:45:08.580559+0000","last_became_peered":"2024-04-19T22:45:08.580559+0000","last_unstale":"2024-04-19T22:46:03.789414+0000","last_undegraded":"2024-04-19T22:46:03.789414+0000","last_fullsized":"2024-04-19T22:46:03.789414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:18:26.442689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"68'12","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788838+0000","last_change":"2024-04-19T22:45:10.790439+0000","last_active":"2024-04-19T22:46:03.788838+0000","last_peered":"2024-04-19T22:46:03.788838+0000","last_clean":"2024-04-19T22:46:03.788838+0000","last_became_active":"2024-04-19T22:45:10.790056+0000","last_became_peered":"2024-04-19T22:45:10.790056+0000","last_unstale":"2024-04-19T22:46:03.788838+0000","last_undegraded":"2024-04-19T22:46:03.788838+0000","last_fullsized":"2024-04-19T22:46:03.788838+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:48:34.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726746+0000","last_change":"2024-04-19T22:45:15.536971+0000","last_active":"2024-04-19T22:46:03.726746+0000","last_peered":"2024-04-19T22:46:03.726746+0000","last_clean":"2024-04-19T22:46:03.726746+0000","last_became_active":"2024-04-19T22:45:15.536061+0000","last_became_peered":"2024-04-19T22:45:15.536061+0000","last_unstale":"2024-04-19T22:46:03.726746+0000","last_undegraded":"2024-04-19T22:46:03.726746+0000","last_fullsized":"2024-04-19T22:46:03.726746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:17:56.043477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590678+0000","last_change":"2024-04-19T22:45:13.190587+0000","last_active":"2024-04-19T22:46:03.590678+0000","last_peered":"2024-04-19T22:46:03.590678+0000","last_clean":"2024-04-19T22:46:03.590678+0000","last_became_active":"2024-04-19T22:45:13.190305+0000","last_became_peered":"2024-04-19T22:45:13.190305+0000","last_unstale":"2024-04-19T22:46:03.590678+0000","last_undegraded":"2024-04-19T22:46:03.590678+0000","last_fullsized":"2024-04-19T22:46:03.590678+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:07:02.420271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725816+0000","last_change":"2024-04-19T22:45:08.575706+0000","last_active":"2024-04-19T22:46:03.725816+0000","last_peered":"2024-04-19T22:46:03.725816+0000","last_clean":"2024-04-19T22:46:03.725816+0000","last_became_active":"2024-04-19T22:45:08.575143+0000","last_became_peered":"2024-04-19T22:45:08.575143+0000","last_unstale":"2024-04-19T22:46:03.725816+0000","last_undegraded":"2024-04-19T22:46:03.725816+0000","last_fullsized":"2024-04-19T22:46:03.725816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:44:24.089974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"68'9","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590324+0000","last_change":"2024-04-19T22:45:10.805253+0000","last_active":"2024-04-19T22:46:03.590324+0000","last_peered":"2024-04-19T22:46:03.590324+0000","last_clean":"2024-04-19T22:46:03.590324+0000","last_became_active":"2024-04-19T22:45:10.804957+0000","last_became_peered":"2024-04-19T22:45:10.804957+0000","last_unstale":"2024-04-19T22:46:03.590324+0000","last_undegraded":"2024-04-19T22:46:03.590324+0000","last_fullsized":"2024-04-19T22:46:03.590324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:42:53.969414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591336+0000","last_change":"2024-04-19T22:45:15.537899+0000","last_active":"2024-04-19T22:46:03.591336+0000","last_peered":"2024-04-19T22:46:03.591336+0000","last_clean":"2024-04-19T22:46:03.591336+0000","last_became_active":"2024-04-19T22:45:15.536160+0000","last_became_peered":"2024-04-19T22:45:15.536160+0000","last_unstale":"2024-04-19T22:46:03.591336+0000","last_undegraded":"2024-04-19T22:46:03.591336+0000","last_fullsized":"2024-04-19T22:46:03.591336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:38:45.059706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593531+0000","last_change":"2024-04-19T22:45:13.188082+0000","last_active":"2024-04-19T22:46:03.593531+0000","last_peered":"2024-04-19T22:46:03.593531+0000","last_clean":"2024-04-19T22:46:03.593531+0000","last_became_active":"2024-04-19T22:45:13.187509+0000","last_became_peered":"2024-04-19T22:45:13.187509+0000","last_unstale":"2024-04-19T22:46:03.593531+0000","last_undegraded":"2024-04-19T22:46:03.593531+0000","last_fullsized":"2024-04-19T22:46:03.593531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:45:19.191880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789572+0000","last_change":"2024-04-19T22:45:08.570475+0000","last_active":"2024-04-19T22:46:03.789572+0000","last_peered":"2024-04-19T22:46:03.789572+0000","last_clean":"2024-04-19T22:46:03.789572+0000","last_became_active":"2024-04-19T22:45:08.570137+0000","last_became_peered":"2024-04-19T22:45:08.570137+0000","last_unstale":"2024-04-19T22:46:03.789572+0000","last_undegraded":"2024-04-19T22:46:03.789572+0000","last_fullsized":"2024-04-19T22:46:03.789572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:45:02.194976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"68'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787273+0000","last_change":"2024-04-19T22:45:10.801455+0000","last_active":"2024-04-19T22:46:03.787273+0000","last_peered":"2024-04-19T22:46:03.787273+0000","last_clean":"2024-04-19T22:46:03.787273+0000","last_became_active":"2024-04-19T22:45:10.794030+0000","last_became_peered":"2024-04-19T22:45:10.794030+0000","last_unstale":"2024-04-19T22:46:03.787273+0000","last_undegraded":"2024-04-19T22:46:03.787273+0000","last_fullsized":"2024-04-19T22:46:03.787273+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:06:54.545123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.594164+0000","last_change":"2024-04-19T22:45:15.209381+0000","last_active":"2024-04-19T22:46:03.594164+0000","last_peered":"2024-04-19T22:46:03.594164+0000","last_clean":"2024-04-19T22:46:03.594164+0000","last_became_active":"2024-04-19T22:45:15.208523+0000","last_became_peered":"2024-04-19T22:45:15.208523+0000","last_unstale":"2024-04-19T22:46:03.594164+0000","last_undegraded":"2024-04-19T22:46:03.594164+0000","last_fullsized":"2024-04-19T22:46:03.594164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:59:37.938189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787662+0000","last_change":"2024-04-19T22:45:13.187539+0000","last_active":"2024-04-19T22:46:03.787662+0000","last_peered":"2024-04-19T22:46:03.787662+0000","last_clean":"2024-04-19T22:46:03.787662+0000","last_became_active":"2024-04-19T22:45:13.186175+0000","last_became_peered":"2024-04-19T22:45:13.186175+0000","last_unstale":"2024-04-19T22:46:03.787662+0000","last_undegraded":"2024-04-19T22:46:03.787662+0000","last_fullsized":"2024-04-19T22:46:03.787662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:45:52.958637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"61'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725367+0000","last_change":"2024-04-19T22:45:08.571757+0000","last_active":"2024-04-19T22:46:03.725367+0000","last_peered":"2024-04-19T22:46:03.725367+0000","last_clean":"2024-04-19T22:46:03.725367+0000","last_became_active":"2024-04-19T22:45:08.571126+0000","last_became_peered":"2024-04-19T22:45:08.571126+0000","last_unstale":"2024-04-19T22:46:03.725367+0000","last_undegraded":"2024-04-19T22:46:03.725367+0000","last_fullsized":"2024-04-19T22:46:03.725367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:29:22.098141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725472+0000","last_change":"2024-04-19T22:45:10.803550+0000","last_active":"2024-04-19T22:46:03.725472+0000","last_peered":"2024-04-19T22:46:03.725472+0000","last_clean":"2024-04-19T22:46:03.725472+0000","last_became_active":"2024-04-19T22:45:10.802958+0000","last_became_peered":"2024-04-19T22:45:10.802958+0000","last_unstale":"2024-04-19T22:46:03.725472+0000","last_undegraded":"2024-04-19T22:46:03.725472+0000","last_fullsized":"2024-04-19T22:46:03.725472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:29:31.355784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790807+0000","last_change":"2024-04-19T22:45:15.212835+0000","last_active":"2024-04-19T22:46:03.790807+0000","last_peered":"2024-04-19T22:46:03.790807+0000","last_clean":"2024-04-19T22:46:03.790807+0000","last_became_active":"2024-04-19T22:45:15.211943+0000","last_became_peered":"2024-04-19T22:45:15.211943+0000","last_unstale":"2024-04-19T22:46:03.790807+0000","last_undegraded":"2024-04-19T22:46:03.790807+0000","last_fullsized":"2024-04-19T22:46:03.790807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:27:16.672767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767783+0000","last_change":"2024-04-19T22:45:13.181624+0000","last_active":"2024-04-19T22:47:53.767783+0000","last_peered":"2024-04-19T22:47:53.767783+0000","last_clean":"2024-04-19T22:47:53.767783+0000","last_became_active":"2024-04-19T22:45:13.180784+0000","last_became_peered":"2024-04-19T22:45:13.180784+0000","last_unstale":"2024-04-19T22:47:53.767783+0000","last_undegraded":"2024-04-19T22:47:53.767783+0000","last_fullsized":"2024-04-19T22:47:53.767783+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:15:57.618023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787597+0000","last_change":"2024-04-19T22:45:08.576386+0000","last_active":"2024-04-19T22:46:03.787597+0000","last_peered":"2024-04-19T22:46:03.787597+0000","last_clean":"2024-04-19T22:46:03.787597+0000","last_became_active":"2024-04-19T22:45:08.576060+0000","last_became_peered":"2024-04-19T22:45:08.576060+0000","last_unstale":"2024-04-19T22:46:03.787597+0000","last_undegraded":"2024-04-19T22:46:03.787597+0000","last_fullsized":"2024-04-19T22:46:03.787597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:18:30.943836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593945+0000","last_change":"2024-04-19T22:45:10.787344+0000","last_active":"2024-04-19T22:46:03.593945+0000","last_peered":"2024-04-19T22:46:03.593945+0000","last_clean":"2024-04-19T22:46:03.593945+0000","last_became_active":"2024-04-19T22:45:10.786172+0000","last_became_peered":"2024-04-19T22:45:10.786172+0000","last_unstale":"2024-04-19T22:46:03.593945+0000","last_undegraded":"2024-04-19T22:46:03.593945+0000","last_fullsized":"2024-04-19T22:46:03.593945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:18:48.195734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726078+0000","last_change":"2024-04-19T22:45:15.537066+0000","last_active":"2024-04-19T22:46:03.726078+0000","last_peered":"2024-04-19T22:46:03.726078+0000","last_clean":"2024-04-19T22:46:03.726078+0000","last_became_active":"2024-04-19T22:45:15.536196+0000","last_became_peered":"2024-04-19T22:45:15.536196+0000","last_unstale":"2024-04-19T22:46:03.726078+0000","last_undegraded":"2024-04-19T22:46:03.726078+0000","last_fullsized":"2024-04-19T22:46:03.726078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:59:19.506164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788291+0000","last_change":"2024-04-19T22:45:13.177065+0000","last_active":"2024-04-19T22:46:03.788291+0000","last_peered":"2024-04-19T22:46:03.788291+0000","last_clean":"2024-04-19T22:46:03.788291+0000","last_became_active":"2024-04-19T22:45:13.176514+0000","last_became_peered":"2024-04-19T22:45:13.176514+0000","last_unstale":"2024-04-19T22:46:03.788291+0000","last_undegraded":"2024-04-19T22:46:03.788291+0000","last_fullsized":"2024-04-19T22:46:03.788291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:48:23.928099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790496+0000","last_change":"2024-04-19T22:45:08.579693+0000","last_active":"2024-04-19T22:46:03.790496+0000","last_peered":"2024-04-19T22:46:03.790496+0000","last_clean":"2024-04-19T22:46:03.790496+0000","last_became_active":"2024-04-19T22:45:08.579366+0000","last_became_peered":"2024-04-19T22:45:08.579366+0000","last_unstale":"2024-04-19T22:46:03.790496+0000","last_undegraded":"2024-04-19T22:46:03.790496+0000","last_fullsized":"2024-04-19T22:46:03.790496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:23:10.449029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788737+0000","last_change":"2024-04-19T22:45:10.791679+0000","last_active":"2024-04-19T22:46:03.788737+0000","last_peered":"2024-04-19T22:46:03.788737+0000","last_clean":"2024-04-19T22:46:03.788737+0000","last_became_active":"2024-04-19T22:45:10.791234+0000","last_became_peered":"2024-04-19T22:45:10.791234+0000","last_unstale":"2024-04-19T22:46:03.788737+0000","last_undegraded":"2024-04-19T22:46:03.788737+0000","last_fullsized":"2024-04-19T22:46:03.788737+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:37:17.248283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788277+0000","last_change":"2024-04-19T22:45:15.213323+0000","last_active":"2024-04-19T22:46:03.788277+0000","last_peered":"2024-04-19T22:46:03.788277+0000","last_clean":"2024-04-19T22:46:03.788277+0000","last_became_active":"2024-04-19T22:45:15.212105+0000","last_became_peered":"2024-04-19T22:45:15.212105+0000","last_unstale":"2024-04-19T22:46:03.788277+0000","last_undegraded":"2024-04-19T22:46:03.788277+0000","last_fullsized":"2024-04-19T22:46:03.788277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:01:26.244813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789299+0000","last_change":"2024-04-19T22:45:13.178930+0000","last_active":"2024-04-19T22:46:03.789299+0000","last_peered":"2024-04-19T22:46:03.789299+0000","last_clean":"2024-04-19T22:46:03.789299+0000","last_became_active":"2024-04-19T22:45:13.178567+0000","last_became_peered":"2024-04-19T22:45:13.178567+0000","last_unstale":"2024-04-19T22:46:03.789299+0000","last_undegraded":"2024-04-19T22:46:03.789299+0000","last_fullsized":"2024-04-19T22:46:03.789299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:28:39.786737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789055+0000","last_change":"2024-04-19T22:45:08.581386+0000","last_active":"2024-04-19T22:46:03.789055+0000","last_peered":"2024-04-19T22:46:03.789055+0000","last_clean":"2024-04-19T22:46:03.789055+0000","last_became_active":"2024-04-19T22:45:08.581007+0000","last_became_peered":"2024-04-19T22:45:08.581007+0000","last_unstale":"2024-04-19T22:46:03.789055+0000","last_undegraded":"2024-04-19T22:46:03.789055+0000","last_fullsized":"2024-04-19T22:46:03.789055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:58:24.784876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"68'6","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787685+0000","last_change":"2024-04-19T22:45:10.798536+0000","last_active":"2024-04-19T22:46:03.787685+0000","last_peered":"2024-04-19T22:46:03.787685+0000","last_clean":"2024-04-19T22:46:03.787685+0000","last_became_active":"2024-04-19T22:45:10.797695+0000","last_became_peered":"2024-04-19T22:45:10.797695+0000","last_unstale":"2024-04-19T22:46:03.787685+0000","last_undegraded":"2024-04-19T22:46:03.787685+0000","last_fullsized":"2024-04-19T22:46:03.787685+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:38:40.127531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725262+0000","last_change":"2024-04-19T22:45:15.202400+0000","last_active":"2024-04-19T22:46:03.725262+0000","last_peered":"2024-04-19T22:46:03.725262+0000","last_clean":"2024-04-19T22:46:03.725262+0000","last_became_active":"2024-04-19T22:45:15.201407+0000","last_became_peered":"2024-04-19T22:45:15.201407+0000","last_unstale":"2024-04-19T22:46:03.725262+0000","last_undegraded":"2024-04-19T22:46:03.725262+0000","last_fullsized":"2024-04-19T22:46:03.725262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:18:42.909753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593769+0000","last_change":"2024-04-19T22:45:13.173257+0000","last_active":"2024-04-19T22:46:03.593769+0000","last_peered":"2024-04-19T22:46:03.593769+0000","last_clean":"2024-04-19T22:46:03.593769+0000","last_became_active":"2024-04-19T22:45:13.172407+0000","last_became_peered":"2024-04-19T22:45:13.172407+0000","last_unstale":"2024-04-19T22:46:03.593769+0000","last_undegraded":"2024-04-19T22:46:03.593769+0000","last_fullsized":"2024-04-19T22:46:03.593769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:49:01.457142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593217+0000","last_change":"2024-04-19T22:45:08.581513+0000","last_active":"2024-04-19T22:46:03.593217+0000","last_peered":"2024-04-19T22:46:03.593217+0000","last_clean":"2024-04-19T22:46:03.593217+0000","last_became_active":"2024-04-19T22:45:08.580954+0000","last_became_peered":"2024-04-19T22:45:08.580954+0000","last_unstale":"2024-04-19T22:46:03.593217+0000","last_undegraded":"2024-04-19T22:46:03.593217+0000","last_fullsized":"2024-04-19T22:46:03.593217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:53:41.071711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"68'10","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590510+0000","last_change":"2024-04-19T22:45:10.793990+0000","last_active":"2024-04-19T22:46:03.590510+0000","last_peered":"2024-04-19T22:46:03.590510+0000","last_clean":"2024-04-19T22:46:03.590510+0000","last_became_active":"2024-04-19T22:45:10.793691+0000","last_became_peered":"2024-04-19T22:45:10.793691+0000","last_unstale":"2024-04-19T22:46:03.590510+0000","last_undegraded":"2024-04-19T22:46:03.590510+0000","last_fullsized":"2024-04-19T22:46:03.590510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:16:40.334515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786785+0000","last_change":"2024-04-19T22:45:15.221323+0000","last_active":"2024-04-19T22:46:03.786785+0000","last_peered":"2024-04-19T22:46:03.786785+0000","last_clean":"2024-04-19T22:46:03.786785+0000","last_became_active":"2024-04-19T22:45:15.220645+0000","last_became_peered":"2024-04-19T22:45:15.220645+0000","last_unstale":"2024-04-19T22:46:03.786785+0000","last_undegraded":"2024-04-19T22:46:03.786785+0000","last_fullsized":"2024-04-19T22:46:03.786785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:35:07.017051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725968+0000","last_change":"2024-04-19T22:45:13.178344+0000","last_active":"2024-04-19T22:46:03.725968+0000","last_peered":"2024-04-19T22:46:03.725968+0000","last_clean":"2024-04-19T22:46:03.725968+0000","last_became_active":"2024-04-19T22:45:13.177442+0000","last_became_peered":"2024-04-19T22:45:13.177442+0000","last_unstale":"2024-04-19T22:46:03.725968+0000","last_undegraded":"2024-04-19T22:46:03.725968+0000","last_fullsized":"2024-04-19T22:46:03.725968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:26:19.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789925+0000","last_change":"2024-04-19T22:45:08.574594+0000","last_active":"2024-04-19T22:46:03.789925+0000","last_peered":"2024-04-19T22:46:03.789925+0000","last_clean":"2024-04-19T22:46:03.789925+0000","last_became_active":"2024-04-19T22:45:08.574245+0000","last_became_peered":"2024-04-19T22:45:08.574245+0000","last_unstale":"2024-04-19T22:46:03.789925+0000","last_undegraded":"2024-04-19T22:46:03.789925+0000","last_fullsized":"2024-04-19T22:46:03.789925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:00:46.916795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790639+0000","last_change":"2024-04-19T22:45:10.793030+0000","last_active":"2024-04-19T22:46:03.790639+0000","last_peered":"2024-04-19T22:46:03.790639+0000","last_clean":"2024-04-19T22:46:03.790639+0000","last_became_active":"2024-04-19T22:45:10.790333+0000","last_became_peered":"2024-04-19T22:45:10.790333+0000","last_unstale":"2024-04-19T22:46:03.790639+0000","last_undegraded":"2024-04-19T22:46:03.790639+0000","last_fullsized":"2024-04-19T22:46:03.790639+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:31:51.423728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591426+0000","last_change":"2024-04-19T22:45:15.190590+0000","last_active":"2024-04-19T22:46:03.591426+0000","last_peered":"2024-04-19T22:46:03.591426+0000","last_clean":"2024-04-19T22:46:03.591426+0000","last_became_active":"2024-04-19T22:45:15.189426+0000","last_became_peered":"2024-04-19T22:45:15.189426+0000","last_unstale":"2024-04-19T22:46:03.591426+0000","last_undegraded":"2024-04-19T22:46:03.591426+0000","last_fullsized":"2024-04-19T22:46:03.591426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:36:13.965454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'11","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767861+0000","last_change":"2024-04-19T22:45:13.183167+0000","last_active":"2024-04-19T22:47:53.767861+0000","last_peered":"2024-04-19T22:47:53.767861+0000","last_clean":"2024-04-19T22:47:53.767861+0000","last_became_active":"2024-04-19T22:45:13.182500+0000","last_became_peered":"2024-04-19T22:45:13.182500+0000","last_unstale":"2024-04-19T22:47:53.767861+0000","last_undegraded":"2024-04-19T22:47:53.767861+0000","last_fullsized":"2024-04-19T22:47:53.767861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:33:48.757651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787333+0000","last_change":"2024-04-19T22:45:08.570026+0000","last_active":"2024-04-19T22:46:03.787333+0000","last_peered":"2024-04-19T22:46:03.787333+0000","last_clean":"2024-04-19T22:46:03.787333+0000","last_became_active":"2024-04-19T22:45:08.569519+0000","last_became_peered":"2024-04-19T22:45:08.569519+0000","last_unstale":"2024-04-19T22:46:03.787333+0000","last_undegraded":"2024-04-19T22:46:03.787333+0000","last_fullsized":"2024-04-19T22:46:03.787333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:59:14.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787124+0000","last_change":"2024-04-19T22:45:10.795326+0000","last_active":"2024-04-19T22:46:03.787124+0000","last_peered":"2024-04-19T22:46:03.787124+0000","last_clean":"2024-04-19T22:46:03.787124+0000","last_became_active":"2024-04-19T22:45:10.794964+0000","last_became_peered":"2024-04-19T22:45:10.794964+0000","last_unstale":"2024-04-19T22:46:03.787124+0000","last_undegraded":"2024-04-19T22:46:03.787124+0000","last_fullsized":"2024-04-19T22:46:03.787124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:20:55.390410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787573+0000","last_change":"2024-04-19T22:45:15.212590+0000","last_active":"2024-04-19T22:46:03.787573+0000","last_peered":"2024-04-19T22:46:03.787573+0000","last_clean":"2024-04-19T22:46:03.787573+0000","last_became_active":"2024-04-19T22:45:15.211573+0000","last_became_peered":"2024-04-19T22:45:15.211573+0000","last_unstale":"2024-04-19T22:46:03.787573+0000","last_undegraded":"2024-04-19T22:46:03.787573+0000","last_fullsized":"2024-04-19T22:46:03.787573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:49:00.256929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'11","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.768399+0000","last_change":"2024-04-19T22:45:13.183652+0000","last_active":"2024-04-19T22:47:53.768399+0000","last_peered":"2024-04-19T22:47:53.768399+0000","last_clean":"2024-04-19T22:47:53.768399+0000","last_became_active":"2024-04-19T22:45:13.182802+0000","last_became_peered":"2024-04-19T22:45:13.182802+0000","last_unstale":"2024-04-19T22:47:53.768399+0000","last_undegraded":"2024-04-19T22:47:53.768399+0000","last_fullsized":"2024-04-19T22:47:53.768399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:08:51.867984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787390+0000","last_change":"2024-04-19T22:45:08.583782+0000","last_active":"2024-04-19T22:46:03.787390+0000","last_peered":"2024-04-19T22:46:03.787390+0000","last_clean":"2024-04-19T22:46:03.787390+0000","last_became_active":"2024-04-19T22:45:08.583218+0000","last_became_peered":"2024-04-19T22:45:08.583218+0000","last_unstale":"2024-04-19T22:46:03.787390+0000","last_undegraded":"2024-04-19T22:46:03.787390+0000","last_fullsized":"2024-04-19T22:46:03.787390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:03:57.931369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789183+0000","last_change":"2024-04-19T22:45:10.799112+0000","last_active":"2024-04-19T22:46:03.789183+0000","last_peered":"2024-04-19T22:46:03.789183+0000","last_clean":"2024-04-19T22:46:03.789183+0000","last_became_active":"2024-04-19T22:45:10.798841+0000","last_became_peered":"2024-04-19T22:45:10.798841+0000","last_unstale":"2024-04-19T22:46:03.789183+0000","last_undegraded":"2024-04-19T22:46:03.789183+0000","last_fullsized":"2024-04-19T22:46:03.789183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:58:26.687875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790244+0000","last_change":"2024-04-19T22:45:15.538294+0000","last_active":"2024-04-19T22:46:03.790244+0000","last_peered":"2024-04-19T22:46:03.790244+0000","last_clean":"2024-04-19T22:46:03.790244+0000","last_became_active":"2024-04-19T22:45:15.537443+0000","last_became_peered":"2024-04-19T22:45:15.537443+0000","last_unstale":"2024-04-19T22:46:03.790244+0000","last_undegraded":"2024-04-19T22:46:03.790244+0000","last_fullsized":"2024-04-19T22:46:03.790244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:02:19.167732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788854+0000","last_change":"2024-04-19T22:45:13.181699+0000","last_active":"2024-04-19T22:46:03.788854+0000","last_peered":"2024-04-19T22:46:03.788854+0000","last_clean":"2024-04-19T22:46:03.788854+0000","last_became_active":"2024-04-19T22:45:13.181359+0000","last_became_peered":"2024-04-19T22:45:13.181359+0000","last_unstale":"2024-04-19T22:46:03.788854+0000","last_undegraded":"2024-04-19T22:46:03.788854+0000","last_fullsized":"2024-04-19T22:46:03.788854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:23:36.577554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789356+0000","last_change":"2024-04-19T22:45:08.574040+0000","last_active":"2024-04-19T22:46:03.789356+0000","last_peered":"2024-04-19T22:46:03.789356+0000","last_clean":"2024-04-19T22:46:03.789356+0000","last_became_active":"2024-04-19T22:45:08.573701+0000","last_became_peered":"2024-04-19T22:45:08.573701+0000","last_unstale":"2024-04-19T22:46:03.789356+0000","last_undegraded":"2024-04-19T22:46:03.789356+0000","last_fullsized":"2024-04-19T22:46:03.789356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:56:47.846992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"68'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788757+0000","last_change":"2024-04-19T22:45:10.792743+0000","last_active":"2024-04-19T22:46:03.788757+0000","last_peered":"2024-04-19T22:46:03.788757+0000","last_clean":"2024-04-19T22:46:03.788757+0000","last_became_active":"2024-04-19T22:45:10.792301+0000","last_became_peered":"2024-04-19T22:45:10.792301+0000","last_unstale":"2024-04-19T22:46:03.788757+0000","last_undegraded":"2024-04-19T22:46:03.788757+0000","last_fullsized":"2024-04-19T22:46:03.788757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:55:19.296765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589854+0000","last_change":"2024-04-19T22:45:15.198388+0000","last_active":"2024-04-19T22:46:03.589854+0000","last_peered":"2024-04-19T22:46:03.589854+0000","last_clean":"2024-04-19T22:46:03.589854+0000","last_became_active":"2024-04-19T22:45:15.197451+0000","last_became_peered":"2024-04-19T22:45:15.197451+0000","last_unstale":"2024-04-19T22:46:03.589854+0000","last_undegraded":"2024-04-19T22:46:03.589854+0000","last_fullsized":"2024-04-19T22:46:03.589854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:01:42.729396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726763+0000","last_change":"2024-04-19T22:45:13.184849+0000","last_active":"2024-04-19T22:46:03.726763+0000","last_peered":"2024-04-19T22:46:03.726763+0000","last_clean":"2024-04-19T22:46:03.726763+0000","last_became_active":"2024-04-19T22:45:13.182034+0000","last_became_peered":"2024-04-19T22:45:13.182034+0000","last_unstale":"2024-04-19T22:46:03.726763+0000","last_undegraded":"2024-04-19T22:46:03.726763+0000","last_fullsized":"2024-04-19T22:46:03.726763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:44:41.890650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"61'1","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588389+0000","last_change":"2024-04-19T22:45:08.589344+0000","last_active":"2024-04-19T22:46:03.588389+0000","last_peered":"2024-04-19T22:46:03.588389+0000","last_clean":"2024-04-19T22:46:03.588389+0000","last_became_active":"2024-04-19T22:45:08.588563+0000","last_became_peered":"2024-04-19T22:45:08.588563+0000","last_unstale":"2024-04-19T22:46:03.588389+0000","last_undegraded":"2024-04-19T22:46:03.588389+0000","last_fullsized":"2024-04-19T22:46:03.588389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:15:14.474968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788382+0000","last_change":"2024-04-19T22:45:10.790471+0000","last_active":"2024-04-19T22:46:03.788382+0000","last_peered":"2024-04-19T22:46:03.788382+0000","last_clean":"2024-04-19T22:46:03.788382+0000","last_became_active":"2024-04-19T22:45:10.789657+0000","last_became_peered":"2024-04-19T22:45:10.789657+0000","last_unstale":"2024-04-19T22:46:03.788382+0000","last_undegraded":"2024-04-19T22:46:03.788382+0000","last_fullsized":"2024-04-19T22:46:03.788382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:35:34.553065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726028+0000","last_change":"2024-04-19T22:45:15.206768+0000","last_active":"2024-04-19T22:46:03.726028+0000","last_peered":"2024-04-19T22:46:03.726028+0000","last_clean":"2024-04-19T22:46:03.726028+0000","last_became_active":"2024-04-19T22:45:15.205879+0000","last_became_peered":"2024-04-19T22:45:15.205879+0000","last_unstale":"2024-04-19T22:46:03.726028+0000","last_undegraded":"2024-04-19T22:46:03.726028+0000","last_fullsized":"2024-04-19T22:46:03.726028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:33:34.245992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591111+0000","last_change":"2024-04-19T22:45:08.571672+0000","last_active":"2024-04-19T22:46:03.591111+0000","last_peered":"2024-04-19T22:46:03.591111+0000","last_clean":"2024-04-19T22:46:03.591111+0000","last_became_active":"2024-04-19T22:45:08.571360+0000","last_became_peered":"2024-04-19T22:45:08.571360+0000","last_unstale":"2024-04-19T22:46:03.591111+0000","last_undegraded":"2024-04-19T22:46:03.591111+0000","last_fullsized":"2024-04-19T22:46:03.591111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:22:02.933144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790799+0000","last_change":"2024-04-19T22:45:10.785228+0000","last_active":"2024-04-19T22:46:03.790799+0000","last_peered":"2024-04-19T22:46:03.790799+0000","last_clean":"2024-04-19T22:46:03.790799+0000","last_became_active":"2024-04-19T22:45:10.784961+0000","last_became_peered":"2024-04-19T22:45:10.784961+0000","last_unstale":"2024-04-19T22:46:03.790799+0000","last_undegraded":"2024-04-19T22:46:03.790799+0000","last_fullsized":"2024-04-19T22:46:03.790799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:58:06.348119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588155+0000","last_change":"2024-04-19T22:45:13.157874+0000","last_active":"2024-04-19T22:46:03.588155+0000","last_peered":"2024-04-19T22:46:03.588155+0000","last_clean":"2024-04-19T22:46:03.588155+0000","last_became_active":"2024-04-19T22:45:13.157033+0000","last_became_peered":"2024-04-19T22:45:13.157033+0000","last_unstale":"2024-04-19T22:46:03.588155+0000","last_undegraded":"2024-04-19T22:46:03.588155+0000","last_fullsized":"2024-04-19T22:46:03.588155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:03:34.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786814+0000","last_change":"2024-04-19T22:45:15.216345+0000","last_active":"2024-04-19T22:46:03.786814+0000","last_peered":"2024-04-19T22:46:03.786814+0000","last_clean":"2024-04-19T22:46:03.786814+0000","last_became_active":"2024-04-19T22:45:15.215676+0000","last_became_peered":"2024-04-19T22:45:15.215676+0000","last_unstale":"2024-04-19T22:46:03.786814+0000","last_undegraded":"2024-04-19T22:46:03.786814+0000","last_fullsized":"2024-04-19T22:46:03.786814+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:08:58.434011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593723+0000","last_change":"2024-04-19T22:45:08.587718+0000","last_active":"2024-04-19T22:46:03.593723+0000","last_peered":"2024-04-19T22:46:03.593723+0000","last_clean":"2024-04-19T22:46:03.593723+0000","last_became_active":"2024-04-19T22:45:08.587387+0000","last_became_peered":"2024-04-19T22:45:08.587387+0000","last_unstale":"2024-04-19T22:46:03.593723+0000","last_undegraded":"2024-04-19T22:46:03.593723+0000","last_fullsized":"2024-04-19T22:46:03.593723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:42:05.891402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"68'16","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767885+0000","last_change":"2024-04-19T22:45:10.804082+0000","last_active":"2024-04-19T22:47:53.767885+0000","last_peered":"2024-04-19T22:47:53.767885+0000","last_clean":"2024-04-19T22:47:53.767885+0000","last_became_active":"2024-04-19T22:45:10.803764+0000","last_became_peered":"2024-04-19T22:45:10.803764+0000","last_unstale":"2024-04-19T22:47:53.767885+0000","last_undegraded":"2024-04-19T22:47:53.767885+0000","last_fullsized":"2024-04-19T22:47:53.767885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:01:52.320135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"71'2","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593703+0000","last_change":"2024-04-19T22:45:21.495112+0000","last_active":"2024-04-19T22:46:03.593703+0000","last_peered":"2024-04-19T22:46:03.593703+0000","last_clean":"2024-04-19T22:46:03.593703+0000","last_became_active":"2024-04-19T22:45:12.150884+0000","last_became_peered":"2024-04-19T22:45:12.150884+0000","last_unstale":"2024-04-19T22:46:03.593703+0000","last_undegraded":"2024-04-19T22:46:03.593703+0000","last_fullsized":"2024-04-19T22:46:03.593703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:35:16.990888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031948419999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'11","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767703+0000","last_change":"2024-04-19T22:45:13.171218+0000","last_active":"2024-04-19T22:47:53.767703+0000","last_peered":"2024-04-19T22:47:53.767703+0000","last_clean":"2024-04-19T22:47:53.767703+0000","last_became_active":"2024-04-19T22:45:13.170495+0000","last_became_peered":"2024-04-19T22:45:13.170495+0000","last_unstale":"2024-04-19T22:47:53.767703+0000","last_undegraded":"2024-04-19T22:47:53.767703+0000","last_fullsized":"2024-04-19T22:47:53.767703+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:57:06.341243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726569+0000","last_change":"2024-04-19T22:45:15.211461+0000","last_active":"2024-04-19T22:46:03.726569+0000","last_peered":"2024-04-19T22:46:03.726569+0000","last_clean":"2024-04-19T22:46:03.726569+0000","last_became_active":"2024-04-19T22:45:15.210210+0000","last_became_peered":"2024-04-19T22:45:15.210210+0000","last_unstale":"2024-04-19T22:46:03.726569+0000","last_undegraded":"2024-04-19T22:46:03.726569+0000","last_fullsized":"2024-04-19T22:46:03.726569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:29:31.981396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787486+0000","last_change":"2024-04-19T22:45:08.576884+0000","last_active":"2024-04-19T22:46:03.787486+0000","last_peered":"2024-04-19T22:46:03.787486+0000","last_clean":"2024-04-19T22:46:03.787486+0000","last_became_active":"2024-04-19T22:45:08.576467+0000","last_became_peered":"2024-04-19T22:45:08.576467+0000","last_unstale":"2024-04-19T22:46:03.787486+0000","last_undegraded":"2024-04-19T22:46:03.787486+0000","last_fullsized":"2024-04-19T22:46:03.787486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:41:43.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"68'19","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589897+0000","last_change":"2024-04-19T22:45:10.794461+0000","last_active":"2024-04-19T22:46:03.589897+0000","last_peered":"2024-04-19T22:46:03.589897+0000","last_clean":"2024-04-19T22:46:03.589897+0000","last_became_active":"2024-04-19T22:45:10.793389+0000","last_became_peered":"2024-04-19T22:45:10.793389+0000","last_unstale":"2024-04-19T22:46:03.589897+0000","last_undegraded":"2024-04-19T22:46:03.589897+0000","last_fullsized":"2024-04-19T22:46:03.589897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:16:42.577566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787616+0000","last_change":"2024-04-19T22:45:13.179853+0000","last_active":"2024-04-19T22:46:03.787616+0000","last_peered":"2024-04-19T22:46:03.787616+0000","last_clean":"2024-04-19T22:46:03.787616+0000","last_became_active":"2024-04-19T22:45:13.178891+0000","last_became_peered":"2024-04-19T22:45:13.178891+0000","last_unstale":"2024-04-19T22:46:03.787616+0000","last_undegraded":"2024-04-19T22:46:03.787616+0000","last_fullsized":"2024-04-19T22:46:03.787616+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:29:41.539574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790343+0000","last_change":"2024-04-19T22:45:15.534007+0000","last_active":"2024-04-19T22:46:03.790343+0000","last_peered":"2024-04-19T22:46:03.790343+0000","last_clean":"2024-04-19T22:46:03.790343+0000","last_became_active":"2024-04-19T22:45:15.533118+0000","last_became_peered":"2024-04-19T22:45:15.533118+0000","last_unstale":"2024-04-19T22:46:03.790343+0000","last_undegraded":"2024-04-19T22:46:03.790343+0000","last_fullsized":"2024-04-19T22:46:03.790343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:29:29.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"68'18","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591879+0000","last_change":"2024-04-19T22:45:10.784163+0000","last_active":"2024-04-19T22:46:03.591879+0000","last_peered":"2024-04-19T22:46:03.591879+0000","last_clean":"2024-04-19T22:46:03.591879+0000","last_became_active":"2024-04-19T22:45:10.783335+0000","last_became_peered":"2024-04-19T22:45:10.783335+0000","last_unstale":"2024-04-19T22:46:03.591879+0000","last_undegraded":"2024-04-19T22:46:03.591879+0000","last_fullsized":"2024-04-19T22:46:03.591879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:39:37.499618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588340+0000","last_change":"2024-04-19T22:45:08.586174+0000","last_active":"2024-04-19T22:46:03.588340+0000","last_peered":"2024-04-19T22:46:03.588340+0000","last_clean":"2024-04-19T22:46:03.588340+0000","last_became_active":"2024-04-19T22:45:08.585491+0000","last_became_peered":"2024-04-19T22:45:08.585491+0000","last_unstale":"2024-04-19T22:46:03.588340+0000","last_undegraded":"2024-04-19T22:46:03.588340+0000","last_fullsized":"2024-04-19T22:46:03.588340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:23:25.459210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588964+0000","last_change":"2024-04-19T22:45:13.184745+0000","last_active":"2024-04-19T22:46:03.588964+0000","last_peered":"2024-04-19T22:46:03.588964+0000","last_clean":"2024-04-19T22:46:03.588964+0000","last_became_active":"2024-04-19T22:45:13.184391+0000","last_became_peered":"2024-04-19T22:45:13.184391+0000","last_unstale":"2024-04-19T22:46:03.588964+0000","last_undegraded":"2024-04-19T22:46:03.588964+0000","last_fullsized":"2024-04-19T22:46:03.588964+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:46:27.493399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789202+0000","last_change":"2024-04-19T22:45:15.202971+0000","last_active":"2024-04-19T22:46:03.789202+0000","last_peered":"2024-04-19T22:46:03.789202+0000","last_clean":"2024-04-19T22:46:03.789202+0000","last_became_active":"2024-04-19T22:45:15.200145+0000","last_became_peered":"2024-04-19T22:45:15.200145+0000","last_unstale":"2024-04-19T22:46:03.789202+0000","last_undegraded":"2024-04-19T22:46:03.789202+0000","last_fullsized":"2024-04-19T22:46:03.789202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:00:53.730301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725606+0000","last_change":"2024-04-19T22:45:10.797435+0000","last_active":"2024-04-19T22:46:03.725606+0000","last_peered":"2024-04-19T22:46:03.725606+0000","last_clean":"2024-04-19T22:46:03.725606+0000","last_became_active":"2024-04-19T22:45:10.797150+0000","last_became_peered":"2024-04-19T22:45:10.797150+0000","last_unstale":"2024-04-19T22:46:03.725606+0000","last_undegraded":"2024-04-19T22:46:03.725606+0000","last_fullsized":"2024-04-19T22:46:03.725606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:53:31.228324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"61'1","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787638+0000","last_change":"2024-04-19T22:45:08.580008+0000","last_active":"2024-04-19T22:46:03.787638+0000","last_peered":"2024-04-19T22:46:03.787638+0000","last_clean":"2024-04-19T22:46:03.787638+0000","last_became_active":"2024-04-19T22:45:08.579669+0000","last_became_peered":"2024-04-19T22:45:08.579669+0000","last_unstale":"2024-04-19T22:46:03.787638+0000","last_undegraded":"2024-04-19T22:46:03.787638+0000","last_fullsized":"2024-04-19T22:46:03.787638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:52:48.205465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:05.766074+0000","last_change":"2024-04-19T22:44:29.412383+0000","last_active":"2024-04-19T22:46:05.766074+0000","last_peered":"2024-04-19T22:46:05.766074+0000","last_clean":"2024-04-19T22:46:05.766074+0000","last_became_active":"2024-04-19T22:44:29.411199+0000","last_became_peered":"2024-04-19T22:44:29.411199+0000","last_unstale":"2024-04-19T22:46:05.766074+0000","last_undegraded":"2024-04-19T22:46:05.766074+0000","last_fullsized":"2024-04-19T22:46:05.766074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:40:10.912232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:40:10.912232+0000","last_clean_scrub_stamp":"2024-04-19T22:40:10.912232+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:11:30.618778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790296+0000","last_change":"2024-04-19T22:45:13.185834+0000","last_active":"2024-04-19T22:46:03.790296+0000","last_peered":"2024-04-19T22:46:03.790296+0000","last_clean":"2024-04-19T22:46:03.790296+0000","last_became_active":"2024-04-19T22:45:13.185121+0000","last_became_peered":"2024-04-19T22:45:13.185121+0000","last_unstale":"2024-04-19T22:46:03.790296+0000","last_undegraded":"2024-04-19T22:46:03.790296+0000","last_fullsized":"2024-04-19T22:46:03.790296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T22:59:19.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593169+0000","last_change":"2024-04-19T22:45:15.205058+0000","last_active":"2024-04-19T22:46:03.593169+0000","last_peered":"2024-04-19T22:46:03.593169+0000","last_clean":"2024-04-19T22:46:03.593169+0000","last_became_active":"2024-04-19T22:45:15.204198+0000","last_became_peered":"2024-04-19T22:45:15.204198+0000","last_unstale":"2024-04-19T22:46:03.593169+0000","last_undegraded":"2024-04-19T22:46:03.593169+0000","last_fullsized":"2024-04-19T22:46:03.593169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:46:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"68'14","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787022+0000","last_change":"2024-04-19T22:45:10.796383+0000","last_active":"2024-04-19T22:46:03.787022+0000","last_peered":"2024-04-19T22:46:03.787022+0000","last_clean":"2024-04-19T22:46:03.787022+0000","last_became_active":"2024-04-19T22:45:10.795603+0000","last_became_peered":"2024-04-19T22:45:10.795603+0000","last_unstale":"2024-04-19T22:46:03.787022+0000","last_undegraded":"2024-04-19T22:46:03.787022+0000","last_fullsized":"2024-04-19T22:46:03.787022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:46:24.756510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787493+0000","last_change":"2024-04-19T22:45:08.574983+0000","last_active":"2024-04-19T22:46:03.787493+0000","last_peered":"2024-04-19T22:46:03.787493+0000","last_clean":"2024-04-19T22:46:03.787493+0000","last_became_active":"2024-04-19T22:45:08.574693+0000","last_became_peered":"2024-04-19T22:45:08.574693+0000","last_unstale":"2024-04-19T22:46:03.787493+0000","last_undegraded":"2024-04-19T22:46:03.787493+0000","last_fullsized":"2024-04-19T22:46:03.787493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:45:52.857747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789000+0000","last_change":"2024-04-19T22:45:13.185771+0000","last_active":"2024-04-19T22:46:03.789000+0000","last_peered":"2024-04-19T22:46:03.789000+0000","last_clean":"2024-04-19T22:46:03.789000+0000","last_became_active":"2024-04-19T22:45:13.184829+0000","last_became_peered":"2024-04-19T22:45:13.184829+0000","last_unstale":"2024-04-19T22:46:03.789000+0000","last_undegraded":"2024-04-19T22:46:03.789000+0000","last_fullsized":"2024-04-19T22:46:03.789000+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:52:45.006551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591454+0000","last_change":"2024-04-19T22:45:15.534086+0000","last_active":"2024-04-19T22:46:03.591454+0000","last_peered":"2024-04-19T22:46:03.591454+0000","last_clean":"2024-04-19T22:46:03.591454+0000","last_became_active":"2024-04-19T22:45:15.533046+0000","last_became_peered":"2024-04-19T22:45:15.533046+0000","last_unstale":"2024-04-19T22:46:03.591454+0000","last_undegraded":"2024-04-19T22:46:03.591454+0000","last_fullsized":"2024-04-19T22:46:03.591454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:53:39.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790436+0000","last_change":"2024-04-19T22:45:08.573042+0000","last_active":"2024-04-19T22:46:03.790436+0000","last_peered":"2024-04-19T22:46:03.790436+0000","last_clean":"2024-04-19T22:46:03.790436+0000","last_became_active":"2024-04-19T22:45:08.572719+0000","last_became_peered":"2024-04-19T22:45:08.572719+0000","last_unstale":"2024-04-19T22:46:03.790436+0000","last_undegraded":"2024-04-19T22:46:03.790436+0000","last_fullsized":"2024-04-19T22:46:03.790436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:40:16.786026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"68'30","reported_seq":121,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767636+0000","last_change":"2024-04-19T22:45:10.799881+0000","last_active":"2024-04-19T22:47:53.767636+0000","last_peered":"2024-04-19T22:47:53.767636+0000","last_clean":"2024-04-19T22:47:53.767636+0000","last_became_active":"2024-04-19T22:45:10.799601+0000","last_became_peered":"2024-04-19T22:45:10.799601+0000","last_unstale":"2024-04-19T22:47:53.767636+0000","last_undegraded":"2024-04-19T22:47:53.767636+0000","last_fullsized":"2024-04-19T22:47:53.767636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:44:33.151939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789625+0000","last_change":"2024-04-19T22:45:13.174687+0000","last_active":"2024-04-19T22:46:03.789625+0000","last_peered":"2024-04-19T22:46:03.789625+0000","last_clean":"2024-04-19T22:46:03.789625+0000","last_became_active":"2024-04-19T22:45:13.174353+0000","last_became_peered":"2024-04-19T22:45:13.174353+0000","last_unstale":"2024-04-19T22:46:03.789625+0000","last_undegraded":"2024-04-19T22:46:03.789625+0000","last_fullsized":"2024-04-19T22:46:03.789625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:28:49.246240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590002+0000","last_change":"2024-04-19T22:45:15.191752+0000","last_active":"2024-04-19T22:46:03.590002+0000","last_peered":"2024-04-19T22:46:03.590002+0000","last_clean":"2024-04-19T22:46:03.590002+0000","last_became_active":"2024-04-19T22:45:15.190921+0000","last_became_peered":"2024-04-19T22:45:15.190921+0000","last_unstale":"2024-04-19T22:46:03.590002+0000","last_undegraded":"2024-04-19T22:46:03.590002+0000","last_fullsized":"2024-04-19T22:46:03.590002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:19:01.101620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"61'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.594328+0000","last_change":"2024-04-19T22:45:08.574027+0000","last_active":"2024-04-19T22:46:03.594328+0000","last_peered":"2024-04-19T22:46:03.594328+0000","last_clean":"2024-04-19T22:46:03.594328+0000","last_became_active":"2024-04-19T22:45:08.573497+0000","last_became_peered":"2024-04-19T22:45:08.573497+0000","last_unstale":"2024-04-19T22:46:03.594328+0000","last_undegraded":"2024-04-19T22:46:03.594328+0000","last_fullsized":"2024-04-19T22:46:03.594328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:19:03.801274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"68'13","reported_seq":63,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726851+0000","last_change":"2024-04-19T22:45:10.802370+0000","last_active":"2024-04-19T22:46:03.726851+0000","last_peered":"2024-04-19T22:46:03.726851+0000","last_clean":"2024-04-19T22:46:03.726851+0000","last_became_active":"2024-04-19T22:45:10.801830+0000","last_became_peered":"2024-04-19T22:45:10.801830+0000","last_unstale":"2024-04-19T22:46:03.726851+0000","last_undegraded":"2024-04-19T22:46:03.726851+0000","last_fullsized":"2024-04-19T22:46:03.726851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:14:30.869808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'5","reported_seq":194,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:57.624947+0000","last_change":"2024-04-19T22:45:21.487345+0000","last_active":"2024-04-19T22:47:57.624947+0000","last_peered":"2024-04-19T22:47:57.624947+0000","last_clean":"2024-04-19T22:47:57.624947+0000","last_became_active":"2024-04-19T22:45:12.165190+0000","last_became_peered":"2024-04-19T22:45:12.165190+0000","last_unstale":"2024-04-19T22:47:57.624947+0000","last_undegraded":"2024-04-19T22:47:57.624947+0000","last_fullsized":"2024-04-19T22:47:57.624947+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:43:34.571579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001858104,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589695+0000","last_change":"2024-04-19T22:45:13.191051+0000","last_active":"2024-04-19T22:46:03.589695+0000","last_peered":"2024-04-19T22:46:03.589695+0000","last_clean":"2024-04-19T22:46:03.589695+0000","last_became_active":"2024-04-19T22:45:13.189856+0000","last_became_peered":"2024-04-19T22:45:13.189856+0000","last_unstale":"2024-04-19T22:46:03.589695+0000","last_undegraded":"2024-04-19T22:46:03.589695+0000","last_fullsized":"2024-04-19T22:46:03.589695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:39:03.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788951+0000","last_change":"2024-04-19T22:45:15.541480+0000","last_active":"2024-04-19T22:46:03.788951+0000","last_peered":"2024-04-19T22:46:03.788951+0000","last_clean":"2024-04-19T22:46:03.788951+0000","last_became_active":"2024-04-19T22:45:15.540211+0000","last_became_peered":"2024-04-19T22:45:15.540211+0000","last_unstale":"2024-04-19T22:46:03.788951+0000","last_undegraded":"2024-04-19T22:46:03.788951+0000","last_fullsized":"2024-04-19T22:46:03.788951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:12:04.634444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790405+0000","last_change":"2024-04-19T22:45:08.579866+0000","last_active":"2024-04-19T22:46:03.790405+0000","last_peered":"2024-04-19T22:46:03.790405+0000","last_clean":"2024-04-19T22:46:03.790405+0000","last_became_active":"2024-04-19T22:45:08.579548+0000","last_became_peered":"2024-04-19T22:45:08.579548+0000","last_unstale":"2024-04-19T22:46:03.790405+0000","last_undegraded":"2024-04-19T22:46:03.790405+0000","last_fullsized":"2024-04-19T22:46:03.790405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:13:18.547106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"68'12","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787758+0000","last_change":"2024-04-19T22:45:10.798642+0000","last_active":"2024-04-19T22:46:03.787758+0000","last_peered":"2024-04-19T22:46:03.787758+0000","last_clean":"2024-04-19T22:46:03.787758+0000","last_became_active":"2024-04-19T22:45:10.797811+0000","last_became_peered":"2024-04-19T22:45:10.797811+0000","last_unstale":"2024-04-19T22:46:03.787758+0000","last_undegraded":"2024-04-19T22:46:03.787758+0000","last_fullsized":"2024-04-19T22:46:03.787758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:02:04.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589915+0000","last_change":"2024-04-19T22:45:21.498838+0000","last_active":"2024-04-19T22:46:03.589915+0000","last_peered":"2024-04-19T22:46:03.589915+0000","last_clean":"2024-04-19T22:46:03.589915+0000","last_became_active":"2024-04-19T22:45:12.160572+0000","last_became_peered":"2024-04-19T22:45:12.160572+0000","last_unstale":"2024-04-19T22:46:03.589915+0000","last_undegraded":"2024-04-19T22:46:03.589915+0000","last_fullsized":"2024-04-19T22:46:03.589915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:50:38.492771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010698560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'11","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767706+0000","last_change":"2024-04-19T22:45:13.168548+0000","last_active":"2024-04-19T22:47:53.767706+0000","last_peered":"2024-04-19T22:47:53.767706+0000","last_clean":"2024-04-19T22:47:53.767706+0000","last_became_active":"2024-04-19T22:45:13.167708+0000","last_became_peered":"2024-04-19T22:45:13.167708+0000","last_unstale":"2024-04-19T22:47:53.767706+0000","last_undegraded":"2024-04-19T22:47:53.767706+0000","last_fullsized":"2024-04-19T22:47:53.767706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:14:51.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726261+0000","last_change":"2024-04-19T22:45:15.533998+0000","last_active":"2024-04-19T22:46:03.726261+0000","last_peered":"2024-04-19T22:46:03.726261+0000","last_clean":"2024-04-19T22:46:03.726261+0000","last_became_active":"2024-04-19T22:45:15.533062+0000","last_became_peered":"2024-04-19T22:45:15.533062+0000","last_unstale":"2024-04-19T22:46:03.726261+0000","last_undegraded":"2024-04-19T22:46:03.726261+0000","last_fullsized":"2024-04-19T22:46:03.726261+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:25:59.762569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789106+0000","last_change":"2024-04-19T22:45:13.170009+0000","last_active":"2024-04-19T22:46:03.789106+0000","last_peered":"2024-04-19T22:46:03.789106+0000","last_clean":"2024-04-19T22:46:03.789106+0000","last_became_active":"2024-04-19T22:45:13.169682+0000","last_became_peered":"2024-04-19T22:45:13.169682+0000","last_unstale":"2024-04-19T22:46:03.789106+0000","last_undegraded":"2024-04-19T22:46:03.789106+0000","last_fullsized":"2024-04-19T22:46:03.789106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:51:46.962364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787823+0000","last_change":"2024-04-19T22:45:08.574434+0000","last_active":"2024-04-19T22:46:03.787823+0000","last_peered":"2024-04-19T22:46:03.787823+0000","last_clean":"2024-04-19T22:46:03.787823+0000","last_became_active":"2024-04-19T22:45:08.573862+0000","last_became_peered":"2024-04-19T22:45:08.573862+0000","last_unstale":"2024-04-19T22:46:03.787823+0000","last_undegraded":"2024-04-19T22:46:03.787823+0000","last_fullsized":"2024-04-19T22:46:03.787823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:59:35.683110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"68'12","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589683+0000","last_change":"2024-04-19T22:45:10.806111+0000","last_active":"2024-04-19T22:46:03.589683+0000","last_peered":"2024-04-19T22:46:03.589683+0000","last_clean":"2024-04-19T22:46:03.589683+0000","last_became_active":"2024-04-19T22:45:10.805740+0000","last_became_peered":"2024-04-19T22:45:10.805740+0000","last_unstale":"2024-04-19T22:46:03.589683+0000","last_undegraded":"2024-04-19T22:46:03.589683+0000","last_fullsized":"2024-04-19T22:46:03.589683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:06:03.895450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788005+0000","last_change":"2024-04-19T22:45:15.218564+0000","last_active":"2024-04-19T22:46:03.788005+0000","last_peered":"2024-04-19T22:46:03.788005+0000","last_clean":"2024-04-19T22:46:03.788005+0000","last_became_active":"2024-04-19T22:45:15.217940+0000","last_became_peered":"2024-04-19T22:45:15.217940+0000","last_unstale":"2024-04-19T22:46:03.788005+0000","last_undegraded":"2024-04-19T22:46:03.788005+0000","last_fullsized":"2024-04-19T22:46:03.788005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:27:14.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'11","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767815+0000","last_change":"2024-04-19T22:45:13.172388+0000","last_active":"2024-04-19T22:47:53.767815+0000","last_peered":"2024-04-19T22:47:53.767815+0000","last_clean":"2024-04-19T22:47:53.767815+0000","last_became_active":"2024-04-19T22:45:13.171492+0000","last_became_peered":"2024-04-19T22:45:13.171492+0000","last_unstale":"2024-04-19T22:47:53.767815+0000","last_undegraded":"2024-04-19T22:47:53.767815+0000","last_fullsized":"2024-04-19T22:47:53.767815+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:31:20.593984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591922+0000","last_change":"2024-04-19T22:45:08.584017+0000","last_active":"2024-04-19T22:46:03.591922+0000","last_peered":"2024-04-19T22:46:03.591922+0000","last_clean":"2024-04-19T22:46:03.591922+0000","last_became_active":"2024-04-19T22:45:08.583691+0000","last_became_peered":"2024-04-19T22:45:08.583691+0000","last_unstale":"2024-04-19T22:46:03.591922+0000","last_undegraded":"2024-04-19T22:46:03.591922+0000","last_fullsized":"2024-04-19T22:46:03.591922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:42:35.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725341+0000","last_change":"2024-04-19T22:45:10.803292+0000","last_active":"2024-04-19T22:46:03.725341+0000","last_peered":"2024-04-19T22:46:03.725341+0000","last_clean":"2024-04-19T22:46:03.725341+0000","last_became_active":"2024-04-19T22:45:10.802069+0000","last_became_peered":"2024-04-19T22:45:10.802069+0000","last_unstale":"2024-04-19T22:46:03.725341+0000","last_undegraded":"2024-04-19T22:46:03.725341+0000","last_fullsized":"2024-04-19T22:46:03.725341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:48:41.777106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591131+0000","last_change":"2024-04-19T22:45:15.196735+0000","last_active":"2024-04-19T22:46:03.591131+0000","last_peered":"2024-04-19T22:46:03.591131+0000","last_clean":"2024-04-19T22:46:03.591131+0000","last_became_active":"2024-04-19T22:45:15.195807+0000","last_became_peered":"2024-04-19T22:45:15.195807+0000","last_unstale":"2024-04-19T22:46:03.591131+0000","last_undegraded":"2024-04-19T22:46:03.591131+0000","last_fullsized":"2024-04-19T22:46:03.591131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:20:58.410671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'11","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767852+0000","last_change":"2024-04-19T22:45:13.184843+0000","last_active":"2024-04-19T22:47:53.767852+0000","last_peered":"2024-04-19T22:47:53.767852+0000","last_clean":"2024-04-19T22:47:53.767852+0000","last_became_active":"2024-04-19T22:45:13.184458+0000","last_became_peered":"2024-04-19T22:45:13.184458+0000","last_unstale":"2024-04-19T22:47:53.767852+0000","last_undegraded":"2024-04-19T22:47:53.767852+0000","last_fullsized":"2024-04-19T22:47:53.767852+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:58:19.851672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593925+0000","last_change":"2024-04-19T22:45:08.586810+0000","last_active":"2024-04-19T22:46:03.593925+0000","last_peered":"2024-04-19T22:46:03.593925+0000","last_clean":"2024-04-19T22:46:03.593925+0000","last_became_active":"2024-04-19T22:45:08.586278+0000","last_became_peered":"2024-04-19T22:45:08.586278+0000","last_unstale":"2024-04-19T22:46:03.593925+0000","last_undegraded":"2024-04-19T22:46:03.593925+0000","last_fullsized":"2024-04-19T22:46:03.593925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:42:00.014417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725886+0000","last_change":"2024-04-19T22:45:10.807672+0000","last_active":"2024-04-19T22:46:03.725886+0000","last_peered":"2024-04-19T22:46:03.725886+0000","last_clean":"2024-04-19T22:46:03.725886+0000","last_became_active":"2024-04-19T22:45:10.807278+0000","last_became_peered":"2024-04-19T22:45:10.807278+0000","last_unstale":"2024-04-19T22:46:03.725886+0000","last_undegraded":"2024-04-19T22:46:03.725886+0000","last_fullsized":"2024-04-19T22:46:03.725886+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:37:06.162764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589294+0000","last_change":"2024-04-19T22:45:15.197262+0000","last_active":"2024-04-19T22:46:03.589294+0000","last_peered":"2024-04-19T22:46:03.589294+0000","last_clean":"2024-04-19T22:46:03.589294+0000","last_became_active":"2024-04-19T22:45:15.195224+0000","last_became_peered":"2024-04-19T22:45:15.195224+0000","last_unstale":"2024-04-19T22:46:03.589294+0000","last_undegraded":"2024-04-19T22:46:03.589294+0000","last_fullsized":"2024-04-19T22:46:03.589294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:59:48.743587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593434+0000","last_change":"2024-04-19T22:45:13.184508+0000","last_active":"2024-04-19T22:46:03.593434+0000","last_peered":"2024-04-19T22:46:03.593434+0000","last_clean":"2024-04-19T22:46:03.593434+0000","last_became_active":"2024-04-19T22:45:13.183687+0000","last_became_peered":"2024-04-19T22:45:13.183687+0000","last_unstale":"2024-04-19T22:46:03.593434+0000","last_undegraded":"2024-04-19T22:46:03.593434+0000","last_fullsized":"2024-04-19T22:46:03.593434+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:27:02.178581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789059+0000","last_change":"2024-04-19T22:45:08.575952+0000","last_active":"2024-04-19T22:46:03.789059+0000","last_peered":"2024-04-19T22:46:03.789059+0000","last_clean":"2024-04-19T22:46:03.789059+0000","last_became_active":"2024-04-19T22:45:08.575647+0000","last_became_peered":"2024-04-19T22:45:08.575647+0000","last_unstale":"2024-04-19T22:46:03.789059+0000","last_undegraded":"2024-04-19T22:46:03.789059+0000","last_fullsized":"2024-04-19T22:46:03.789059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:43:05.305763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"68'19","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789464+0000","last_change":"2024-04-19T22:45:10.800597+0000","last_active":"2024-04-19T22:46:03.789464+0000","last_peered":"2024-04-19T22:46:03.789464+0000","last_clean":"2024-04-19T22:46:03.789464+0000","last_became_active":"2024-04-19T22:45:10.795431+0000","last_became_peered":"2024-04-19T22:45:10.795431+0000","last_unstale":"2024-04-19T22:46:03.789464+0000","last_undegraded":"2024-04-19T22:46:03.789464+0000","last_fullsized":"2024-04-19T22:46:03.789464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:55:22.290003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787322+0000","last_change":"2024-04-19T22:45:15.212581+0000","last_active":"2024-04-19T22:46:03.787322+0000","last_peered":"2024-04-19T22:46:03.787322+0000","last_clean":"2024-04-19T22:46:03.787322+0000","last_became_active":"2024-04-19T22:45:15.211865+0000","last_became_peered":"2024-04-19T22:45:15.211865+0000","last_unstale":"2024-04-19T22:46:03.787322+0000","last_undegraded":"2024-04-19T22:46:03.787322+0000","last_fullsized":"2024-04-19T22:46:03.787322+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T22:53:41.075174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588812+0000","last_change":"2024-04-19T22:45:13.176955+0000","last_active":"2024-04-19T22:46:03.588812+0000","last_peered":"2024-04-19T22:46:03.588812+0000","last_clean":"2024-04-19T22:46:03.588812+0000","last_became_active":"2024-04-19T22:45:13.176166+0000","last_became_peered":"2024-04-19T22:45:13.176166+0000","last_unstale":"2024-04-19T22:46:03.588812+0000","last_undegraded":"2024-04-19T22:46:03.588812+0000","last_fullsized":"2024-04-19T22:46:03.588812+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:35:39.002914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589331+0000","last_change":"2024-04-19T22:45:08.583606+0000","last_active":"2024-04-19T22:46:03.589331+0000","last_peered":"2024-04-19T22:46:03.589331+0000","last_clean":"2024-04-19T22:46:03.589331+0000","last_became_active":"2024-04-19T22:45:08.583202+0000","last_became_peered":"2024-04-19T22:45:08.583202+0000","last_unstale":"2024-04-19T22:46:03.589331+0000","last_undegraded":"2024-04-19T22:46:03.589331+0000","last_fullsized":"2024-04-19T22:46:03.589331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:37:22.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"68'17","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790649+0000","last_change":"2024-04-19T22:45:10.793858+0000","last_active":"2024-04-19T22:46:03.790649+0000","last_peered":"2024-04-19T22:46:03.790649+0000","last_clean":"2024-04-19T22:46:03.790649+0000","last_became_active":"2024-04-19T22:45:10.792368+0000","last_became_peered":"2024-04-19T22:45:10.792368+0000","last_unstale":"2024-04-19T22:46:03.790649+0000","last_undegraded":"2024-04-19T22:46:03.790649+0000","last_fullsized":"2024-04-19T22:46:03.790649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:36:50.659842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786934+0000","last_change":"2024-04-19T22:45:15.216432+0000","last_active":"2024-04-19T22:46:03.786934+0000","last_peered":"2024-04-19T22:46:03.786934+0000","last_clean":"2024-04-19T22:46:03.786934+0000","last_became_active":"2024-04-19T22:45:15.215625+0000","last_became_peered":"2024-04-19T22:45:15.215625+0000","last_unstale":"2024-04-19T22:46:03.786934+0000","last_undegraded":"2024-04-19T22:46:03.786934+0000","last_fullsized":"2024-04-19T22:46:03.786934+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:53:38.076776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588722+0000","last_change":"2024-04-19T22:45:13.182847+0000","last_active":"2024-04-19T22:46:03.588722+0000","last_peered":"2024-04-19T22:46:03.588722+0000","last_clean":"2024-04-19T22:46:03.588722+0000","last_became_active":"2024-04-19T22:45:13.181909+0000","last_became_peered":"2024-04-19T22:45:13.181909+0000","last_unstale":"2024-04-19T22:46:03.588722+0000","last_undegraded":"2024-04-19T22:46:03.588722+0000","last_fullsized":"2024-04-19T22:46:03.588722+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:10:32.825530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593428+0000","last_change":"2024-04-19T22:45:08.586121+0000","last_active":"2024-04-19T22:46:03.593428+0000","last_peered":"2024-04-19T22:46:03.593428+0000","last_clean":"2024-04-19T22:46:03.593428+0000","last_became_active":"2024-04-19T22:45:08.585379+0000","last_became_peered":"2024-04-19T22:45:08.585379+0000","last_unstale":"2024-04-19T22:46:03.593428+0000","last_undegraded":"2024-04-19T22:46:03.593428+0000","last_fullsized":"2024-04-19T22:46:03.593428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:37:39.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788023+0000","last_change":"2024-04-19T22:45:10.796749+0000","last_active":"2024-04-19T22:46:03.788023+0000","last_peered":"2024-04-19T22:46:03.788023+0000","last_clean":"2024-04-19T22:46:03.788023+0000","last_became_active":"2024-04-19T22:45:10.796444+0000","last_became_peered":"2024-04-19T22:45:10.796444+0000","last_unstale":"2024-04-19T22:46:03.788023+0000","last_undegraded":"2024-04-19T22:46:03.788023+0000","last_fullsized":"2024-04-19T22:46:03.788023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:48:22.903908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787282+0000","last_change":"2024-04-19T22:45:15.534754+0000","last_active":"2024-04-19T22:46:03.787282+0000","last_peered":"2024-04-19T22:46:03.787282+0000","last_clean":"2024-04-19T22:46:03.787282+0000","last_became_active":"2024-04-19T22:45:15.533596+0000","last_became_peered":"2024-04-19T22:45:15.533596+0000","last_unstale":"2024-04-19T22:46:03.787282+0000","last_undegraded":"2024-04-19T22:46:03.787282+0000","last_fullsized":"2024-04-19T22:46:03.787282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:50:54.428536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589093+0000","last_change":"2024-04-19T22:45:08.583247+0000","last_active":"2024-04-19T22:46:03.589093+0000","last_peered":"2024-04-19T22:46:03.589093+0000","last_clean":"2024-04-19T22:46:03.589093+0000","last_became_active":"2024-04-19T22:45:08.582063+0000","last_became_peered":"2024-04-19T22:45:08.582063+0000","last_unstale":"2024-04-19T22:46:03.589093+0000","last_undegraded":"2024-04-19T22:46:03.589093+0000","last_fullsized":"2024-04-19T22:46:03.589093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:58:01.352583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.791329+0000","last_change":"2024-04-19T22:45:10.791544+0000","last_active":"2024-04-19T22:46:03.791329+0000","last_peered":"2024-04-19T22:46:03.791329+0000","last_clean":"2024-04-19T22:46:03.791329+0000","last_became_active":"2024-04-19T22:45:10.789207+0000","last_became_peered":"2024-04-19T22:45:10.789207+0000","last_unstale":"2024-04-19T22:46:03.791329+0000","last_undegraded":"2024-04-19T22:46:03.791329+0000","last_fullsized":"2024-04-19T22:46:03.791329+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:46:31.278050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"68'11","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:47:53.767913+0000","last_change":"2024-04-19T22:45:13.177223+0000","last_active":"2024-04-19T22:47:53.767913+0000","last_peered":"2024-04-19T22:47:53.767913+0000","last_clean":"2024-04-19T22:47:53.767913+0000","last_became_active":"2024-04-19T22:45:13.176434+0000","last_became_peered":"2024-04-19T22:45:13.176434+0000","last_unstale":"2024-04-19T22:47:53.767913+0000","last_undegraded":"2024-04-19T22:47:53.767913+0000","last_fullsized":"2024-04-19T22:47:53.767913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:25:47.497170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201324,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36672,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708480,"statfs":{"total":95995035648,"available":95957483520,"internally_reserved":0,"allocated":1368064,"data_stored":888347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32480,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712672,"statfs":{"total":95995035648,"available":95961776128,"internally_reserved":0,"allocated":1335296,"data_stored":886012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717392,"statfs":{"total":95995035648,"available":95966609408,"internally_reserved":0,"allocated":757760,"data_stored":296398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1351680,"data_stored":887090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717400,"statfs":{"total":95995035648,"available":95966617600,"internally_reserved":0,"allocated":749568,"data_stored":297553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149782,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27744,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717408,"statfs":{"total":95995035648,"available":95966625792,"internally_reserved":0,"allocated":741376,"data_stored":296031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":296576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717404,"statfs":{"total":95995035648,"available":95966621696,"internally_reserved":0,"allocated":745472,"data_stored":297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T22:48:04.020 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph pg dump --format=json 2024-04-19T22:48:04.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:03 smithi178 bash[23441]: audit 2024-04-19T22:48:03.133659+0000 mgr.y (mgr.24389) 107 : audit 0 from='client.14685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:04 smithi113 bash[28910]: cluster 2024-04-19T22:48:03.659957+0000 mgr.y (mgr.24389) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:05.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:04 smithi113 bash[28910]: audit 2024-04-19T22:48:03.941887+0000 mon.a (mon.0) 904 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:04 smithi113 bash[21528]: cluster 2024-04-19T22:48:03.659957+0000 mgr.y (mgr.24389) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:05.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:04 smithi113 bash[21528]: audit 2024-04-19T22:48:03.941887+0000 mon.a (mon.0) 904 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:05.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:04 smithi178 bash[23441]: cluster 2024-04-19T22:48:03.659957+0000 mgr.y (mgr.24389) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:48:05.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:04 smithi178 bash[23441]: audit 2024-04-19T22:48:03.941887+0000 mon.a (mon.0) 904 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:06.044 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:05 smithi113 bash[21528]: audit 2024-04-19T22:48:04.693434+0000 mgr.y (mgr.24389) 109 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:06.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:05 smithi113 bash[28910]: audit 2024-04-19T22:48:04.693434+0000 mgr.y (mgr.24389) 109 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:06.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:05 smithi178 bash[23441]: audit 2024-04-19T22:48:04.693434+0000 mgr.y (mgr.24389) 109 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:07.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:06 smithi113 bash[21528]: cluster 2024-04-19T22:48:05.661311+0000 mgr.y (mgr.24389) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:07.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:06 smithi113 bash[28910]: cluster 2024-04-19T22:48:05.661311+0000 mgr.y (mgr.24389) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:07.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:06 smithi178 bash[23441]: cluster 2024-04-19T22:48:05.661311+0000 mgr.y (mgr.24389) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:07.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:08.799 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:48:09.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:08 smithi113 bash[28910]: cluster 2024-04-19T22:48:07.661980+0000 mgr.y (mgr.24389) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:09.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:08 smithi113 bash[21528]: cluster 2024-04-19T22:48:07.661980+0000 mgr.y (mgr.24389) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:09.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:08 smithi178 bash[23441]: cluster 2024-04-19T22:48:07.661980+0000 mgr.y (mgr.24389) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:11.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:10 smithi113 bash[28910]: cluster 2024-04-19T22:48:09.663381+0000 mgr.y (mgr.24389) 112 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:11.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:10 smithi113 bash[21528]: cluster 2024-04-19T22:48:09.663381+0000 mgr.y (mgr.24389) 112 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:11.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:10 smithi178 bash[23441]: cluster 2024-04-19T22:48:09.663381+0000 mgr.y (mgr.24389) 112 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/4042157968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd41410a5c0 msgr2=0x7fd41410a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:11.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- 172.21.15.113:0/4042157968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd41410a5c0 0x7fd41410a9a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4040099c0 tx=0x7fd404009cd0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/4042157968 shutdown_connections 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- 172.21.15.113:0/4042157968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd414104ed0 0x7fd414111390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- 172.21.15.113:0/4042157968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd41410a5c0 0x7fd41410a9a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- 172.21.15.113:0/4042157968 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104510 0x7fd414104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/4042157968 >> 172.21.15.113:0/4042157968 conn(0x7fd414100000 msgr2=0x7fd414102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/4042157968 shutdown_connections 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/4042157968 wait complete. 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 Processor -- start 2024-04-19T22:48:11.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- start start 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 0x7fd41419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd41410a5c0 0x7fd41419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd414113f10 con 0x7fd414104510 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd414113d90 con 0x7fd41410a5c0 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fd414114090 con 0x7fd414104ed0 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40512/0 (socket says 172.21.15.113:40512) 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 -- 172.21.15.113:0/1517405391 learned_addr learned my addr 172.21.15.113:0/1517405391 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:48:11.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd40affd700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 0x7fd41419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd413fff700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd41410a5c0 0x7fd41419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 -- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 msgr2=0x7fd41419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 0x7fd41419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 -- 172.21.15.113:0/1517405391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd41410a5c0 msgr2=0x7fd41419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd41410a5c0 0x7fd41419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 -- 172.21.15.113:0/1517405391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41419f380 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd40affd700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 0x7fd41419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4137fe700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd404005910 tx=0x7fd40400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404027070 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd40400fb80 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41419f610 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040173f0 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.851+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141a6ef0 con 0x7fd414104510 2024-04-19T22:48:11.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41404ff50 con 0x7fd414104510 2024-04-19T22:48:11.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fd404022470 con 0x7fd414104510 2024-04-19T22:48:11.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd4117fa700 1 --2- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 0x7fd400070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:11.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7fd40408ecb0 con 0x7fd414104510 2024-04-19T22:48:11.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd40affd700 1 --2- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 0x7fd400070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:11.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.855+0000 7fd40affd700 1 --2- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 0x7fd400070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd414114960 tx=0x7fd3fc009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:11.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:11.859+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd404013070 con 0x7fd414104510 2024-04-19T22:48:12.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.067+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 --> v2:172.21.15.113:6800/3719359025 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4141097e0 con 0x7fd40006e0a0 2024-04-19T22:48:12.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.083+0000 7fd4117fa700 1 -- 172.21.15.113:0/1517405391 <== mgr.24389 v2:172.21.15.113:6800/3719359025 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346505 (secure 0 0 0) 0x7fd4141097e0 con 0x7fd40006e0a0 2024-04-19T22:48:12.087 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:48:12.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 msgr2=0x7fd400070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:12.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 0x7fd400070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd414114960 tx=0x7fd3fc009260 comp rx=0 tx=0).stop 2024-04-19T22:48:12.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 msgr2=0x7fd41419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:12.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd404005910 tx=0x7fd40400f690 comp rx=0 tx=0).stop 2024-04-19T22:48:12.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 shutdown_connections 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd40006e0a0 0x7fd400070560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd41410a5c0 0x7fd41419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd414104510 0x7fd41419a370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 --2- 172.21.15.113:0/1517405391 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd414104ed0 0x7fd41419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 >> 172.21.15.113:0/1517405391 conn(0x7fd414100000 msgr2=0x7fd4141080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 shutdown_connections 2024-04-19T22:48:12.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:12.087+0000 7fd419dd8700 1 -- 172.21.15.113:0/1517405391 wait complete. 2024-04-19T22:48:12.092 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-19T22:48:12.869 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-19T22:48:11.663617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1110,"num_read_kb":956,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":236272,"kb_used_data":7644,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":749724944,"statfs":{"total":767960285184,"available":767718342656,"internally_reserved":0,"allocated":7827456,"data_stored":4145033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006123"},"pg_stats":[{"pgid":"6.1b","version":"68'1","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725595+0000","last_change":"2024-04-19T22:45:15.537133+0000","last_active":"2024-04-19T22:46:03.725595+0000","last_peered":"2024-04-19T22:46:03.725595+0000","last_clean":"2024-04-19T22:46:03.725595+0000","last_became_active":"2024-04-19T22:45:15.536240+0000","last_became_peered":"2024-04-19T22:45:15.536240+0000","last_unstale":"2024-04-19T22:46:03.725595+0000","last_undegraded":"2024-04-19T22:46:03.725595+0000","last_fullsized":"2024-04-19T22:46:03.725595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:16:00.752553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589811+0000","last_change":"2024-04-19T22:45:13.189643+0000","last_active":"2024-04-19T22:46:03.589811+0000","last_peered":"2024-04-19T22:46:03.589811+0000","last_clean":"2024-04-19T22:46:03.589811+0000","last_became_active":"2024-04-19T22:45:13.188568+0000","last_became_peered":"2024-04-19T22:45:13.188568+0000","last_unstale":"2024-04-19T22:46:03.589811+0000","last_undegraded":"2024-04-19T22:46:03.589811+0000","last_fullsized":"2024-04-19T22:46:03.589811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:37:03.414597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787741+0000","last_change":"2024-04-19T22:45:56.773957+0000","last_active":"2024-04-19T22:46:03.787741+0000","last_peered":"2024-04-19T22:46:03.787741+0000","last_clean":"2024-04-19T22:46:03.787741+0000","last_became_active":"2024-04-19T22:45:56.772983+0000","last_became_peered":"2024-04-19T22:45:56.772983+0000","last_unstale":"2024-04-19T22:46:03.787741+0000","last_undegraded":"2024-04-19T22:46:03.787741+0000","last_fullsized":"2024-04-19T22:46:03.787741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:42:02.461796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725997+0000","last_change":"2024-04-19T22:45:10.803875+0000","last_active":"2024-04-19T22:46:03.725997+0000","last_peered":"2024-04-19T22:46:03.725997+0000","last_clean":"2024-04-19T22:46:03.725997+0000","last_became_active":"2024-04-19T22:45:10.803345+0000","last_became_peered":"2024-04-19T22:45:10.803345+0000","last_unstale":"2024-04-19T22:46:03.725997+0000","last_undegraded":"2024-04-19T22:46:03.725997+0000","last_fullsized":"2024-04-19T22:46:03.725997+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:47:54.732753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589778+0000","last_change":"2024-04-19T22:45:15.203489+0000","last_active":"2024-04-19T22:46:03.589778+0000","last_peered":"2024-04-19T22:46:03.589778+0000","last_clean":"2024-04-19T22:46:03.589778+0000","last_became_active":"2024-04-19T22:45:15.202603+0000","last_became_peered":"2024-04-19T22:45:15.202603+0000","last_unstale":"2024-04-19T22:46:03.589778+0000","last_undegraded":"2024-04-19T22:46:03.589778+0000","last_fullsized":"2024-04-19T22:46:03.589778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:00:46.472922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591694+0000","last_change":"2024-04-19T22:45:13.178550+0000","last_active":"2024-04-19T22:46:03.591694+0000","last_peered":"2024-04-19T22:46:03.591694+0000","last_clean":"2024-04-19T22:46:03.591694+0000","last_became_active":"2024-04-19T22:45:13.178015+0000","last_became_peered":"2024-04-19T22:45:13.178015+0000","last_unstale":"2024-04-19T22:46:03.591694+0000","last_undegraded":"2024-04-19T22:46:03.591694+0000","last_fullsized":"2024-04-19T22:46:03.591694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:52:43.608099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726561+0000","last_change":"2024-04-19T22:45:08.580974+0000","last_active":"2024-04-19T22:46:03.726561+0000","last_peered":"2024-04-19T22:46:03.726561+0000","last_clean":"2024-04-19T22:46:03.726561+0000","last_became_active":"2024-04-19T22:45:08.580512+0000","last_became_peered":"2024-04-19T22:45:08.580512+0000","last_unstale":"2024-04-19T22:46:03.726561+0000","last_undegraded":"2024-04-19T22:46:03.726561+0000","last_fullsized":"2024-04-19T22:46:03.726561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:42:31.681990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787839+0000","last_change":"2024-04-19T22:45:10.804508+0000","last_active":"2024-04-19T22:46:03.787839+0000","last_peered":"2024-04-19T22:46:03.787839+0000","last_clean":"2024-04-19T22:46:03.787839+0000","last_became_active":"2024-04-19T22:45:10.804245+0000","last_became_peered":"2024-04-19T22:45:10.804245+0000","last_unstale":"2024-04-19T22:46:03.787839+0000","last_undegraded":"2024-04-19T22:46:03.787839+0000","last_fullsized":"2024-04-19T22:46:03.787839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:49:05.720219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787602+0000","last_change":"2024-04-19T22:45:15.218720+0000","last_active":"2024-04-19T22:46:03.787602+0000","last_peered":"2024-04-19T22:46:03.787602+0000","last_clean":"2024-04-19T22:46:03.787602+0000","last_became_active":"2024-04-19T22:45:15.217965+0000","last_became_peered":"2024-04-19T22:45:15.217965+0000","last_unstale":"2024-04-19T22:46:03.787602+0000","last_undegraded":"2024-04-19T22:46:03.787602+0000","last_fullsized":"2024-04-19T22:46:03.787602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:27:30.329420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788901+0000","last_change":"2024-04-19T22:45:13.183705+0000","last_active":"2024-04-19T22:46:03.788901+0000","last_peered":"2024-04-19T22:46:03.788901+0000","last_clean":"2024-04-19T22:46:03.788901+0000","last_became_active":"2024-04-19T22:45:13.182998+0000","last_became_peered":"2024-04-19T22:45:13.182998+0000","last_unstale":"2024-04-19T22:46:03.788901+0000","last_undegraded":"2024-04-19T22:46:03.788901+0000","last_fullsized":"2024-04-19T22:46:03.788901+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:35:31.957708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790523+0000","last_change":"2024-04-19T22:45:08.573062+0000","last_active":"2024-04-19T22:46:03.790523+0000","last_peered":"2024-04-19T22:46:03.790523+0000","last_clean":"2024-04-19T22:46:03.790523+0000","last_became_active":"2024-04-19T22:45:08.572630+0000","last_became_peered":"2024-04-19T22:45:08.572630+0000","last_unstale":"2024-04-19T22:46:03.790523+0000","last_undegraded":"2024-04-19T22:46:03.790523+0000","last_fullsized":"2024-04-19T22:46:03.790523+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:19:52.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788336+0000","last_change":"2024-04-19T22:45:10.793078+0000","last_active":"2024-04-19T22:46:03.788336+0000","last_peered":"2024-04-19T22:46:03.788336+0000","last_clean":"2024-04-19T22:46:03.788336+0000","last_became_active":"2024-04-19T22:45:10.792634+0000","last_became_peered":"2024-04-19T22:45:10.792634+0000","last_unstale":"2024-04-19T22:46:03.788336+0000","last_undegraded":"2024-04-19T22:46:03.788336+0000","last_fullsized":"2024-04-19T22:46:03.788336+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:01:26.012319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786878+0000","last_change":"2024-04-19T22:45:15.207174+0000","last_active":"2024-04-19T22:46:03.786878+0000","last_peered":"2024-04-19T22:46:03.786878+0000","last_clean":"2024-04-19T22:46:03.786878+0000","last_became_active":"2024-04-19T22:45:15.206413+0000","last_became_peered":"2024-04-19T22:45:15.206413+0000","last_unstale":"2024-04-19T22:46:03.786878+0000","last_undegraded":"2024-04-19T22:46:03.786878+0000","last_fullsized":"2024-04-19T22:46:03.786878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:34:53.780597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787743+0000","last_change":"2024-04-19T22:45:13.188828+0000","last_active":"2024-04-19T22:46:03.787743+0000","last_peered":"2024-04-19T22:46:03.787743+0000","last_clean":"2024-04-19T22:46:03.787743+0000","last_became_active":"2024-04-19T22:45:13.187218+0000","last_became_peered":"2024-04-19T22:45:13.187218+0000","last_unstale":"2024-04-19T22:46:03.787743+0000","last_undegraded":"2024-04-19T22:46:03.787743+0000","last_fullsized":"2024-04-19T22:46:03.787743+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:31:20.720958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789414+0000","last_change":"2024-04-19T22:45:08.580915+0000","last_active":"2024-04-19T22:46:03.789414+0000","last_peered":"2024-04-19T22:46:03.789414+0000","last_clean":"2024-04-19T22:46:03.789414+0000","last_became_active":"2024-04-19T22:45:08.580559+0000","last_became_peered":"2024-04-19T22:45:08.580559+0000","last_unstale":"2024-04-19T22:46:03.789414+0000","last_undegraded":"2024-04-19T22:46:03.789414+0000","last_fullsized":"2024-04-19T22:46:03.789414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:18:26.442689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"68'12","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788838+0000","last_change":"2024-04-19T22:45:10.790439+0000","last_active":"2024-04-19T22:46:03.788838+0000","last_peered":"2024-04-19T22:46:03.788838+0000","last_clean":"2024-04-19T22:46:03.788838+0000","last_became_active":"2024-04-19T22:45:10.790056+0000","last_became_peered":"2024-04-19T22:45:10.790056+0000","last_unstale":"2024-04-19T22:46:03.788838+0000","last_undegraded":"2024-04-19T22:46:03.788838+0000","last_fullsized":"2024-04-19T22:46:03.788838+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:48:34.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726746+0000","last_change":"2024-04-19T22:45:15.536971+0000","last_active":"2024-04-19T22:46:03.726746+0000","last_peered":"2024-04-19T22:46:03.726746+0000","last_clean":"2024-04-19T22:46:03.726746+0000","last_became_active":"2024-04-19T22:45:15.536061+0000","last_became_peered":"2024-04-19T22:45:15.536061+0000","last_unstale":"2024-04-19T22:46:03.726746+0000","last_undegraded":"2024-04-19T22:46:03.726746+0000","last_fullsized":"2024-04-19T22:46:03.726746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:17:56.043477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590678+0000","last_change":"2024-04-19T22:45:13.190587+0000","last_active":"2024-04-19T22:46:03.590678+0000","last_peered":"2024-04-19T22:46:03.590678+0000","last_clean":"2024-04-19T22:46:03.590678+0000","last_became_active":"2024-04-19T22:45:13.190305+0000","last_became_peered":"2024-04-19T22:45:13.190305+0000","last_unstale":"2024-04-19T22:46:03.590678+0000","last_undegraded":"2024-04-19T22:46:03.590678+0000","last_fullsized":"2024-04-19T22:46:03.590678+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:07:02.420271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725816+0000","last_change":"2024-04-19T22:45:08.575706+0000","last_active":"2024-04-19T22:46:03.725816+0000","last_peered":"2024-04-19T22:46:03.725816+0000","last_clean":"2024-04-19T22:46:03.725816+0000","last_became_active":"2024-04-19T22:45:08.575143+0000","last_became_peered":"2024-04-19T22:45:08.575143+0000","last_unstale":"2024-04-19T22:46:03.725816+0000","last_undegraded":"2024-04-19T22:46:03.725816+0000","last_fullsized":"2024-04-19T22:46:03.725816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:44:24.089974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"68'9","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590324+0000","last_change":"2024-04-19T22:45:10.805253+0000","last_active":"2024-04-19T22:46:03.590324+0000","last_peered":"2024-04-19T22:46:03.590324+0000","last_clean":"2024-04-19T22:46:03.590324+0000","last_became_active":"2024-04-19T22:45:10.804957+0000","last_became_peered":"2024-04-19T22:45:10.804957+0000","last_unstale":"2024-04-19T22:46:03.590324+0000","last_undegraded":"2024-04-19T22:46:03.590324+0000","last_fullsized":"2024-04-19T22:46:03.590324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:42:53.969414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591336+0000","last_change":"2024-04-19T22:45:15.537899+0000","last_active":"2024-04-19T22:46:03.591336+0000","last_peered":"2024-04-19T22:46:03.591336+0000","last_clean":"2024-04-19T22:46:03.591336+0000","last_became_active":"2024-04-19T22:45:15.536160+0000","last_became_peered":"2024-04-19T22:45:15.536160+0000","last_unstale":"2024-04-19T22:46:03.591336+0000","last_undegraded":"2024-04-19T22:46:03.591336+0000","last_fullsized":"2024-04-19T22:46:03.591336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:38:45.059706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593531+0000","last_change":"2024-04-19T22:45:13.188082+0000","last_active":"2024-04-19T22:46:03.593531+0000","last_peered":"2024-04-19T22:46:03.593531+0000","last_clean":"2024-04-19T22:46:03.593531+0000","last_became_active":"2024-04-19T22:45:13.187509+0000","last_became_peered":"2024-04-19T22:45:13.187509+0000","last_unstale":"2024-04-19T22:46:03.593531+0000","last_undegraded":"2024-04-19T22:46:03.593531+0000","last_fullsized":"2024-04-19T22:46:03.593531+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:45:19.191880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789572+0000","last_change":"2024-04-19T22:45:08.570475+0000","last_active":"2024-04-19T22:46:03.789572+0000","last_peered":"2024-04-19T22:46:03.789572+0000","last_clean":"2024-04-19T22:46:03.789572+0000","last_became_active":"2024-04-19T22:45:08.570137+0000","last_became_peered":"2024-04-19T22:45:08.570137+0000","last_unstale":"2024-04-19T22:46:03.789572+0000","last_undegraded":"2024-04-19T22:46:03.789572+0000","last_fullsized":"2024-04-19T22:46:03.789572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:45:02.194976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"68'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787273+0000","last_change":"2024-04-19T22:45:10.801455+0000","last_active":"2024-04-19T22:46:03.787273+0000","last_peered":"2024-04-19T22:46:03.787273+0000","last_clean":"2024-04-19T22:46:03.787273+0000","last_became_active":"2024-04-19T22:45:10.794030+0000","last_became_peered":"2024-04-19T22:45:10.794030+0000","last_unstale":"2024-04-19T22:46:03.787273+0000","last_undegraded":"2024-04-19T22:46:03.787273+0000","last_fullsized":"2024-04-19T22:46:03.787273+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:06:54.545123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.594164+0000","last_change":"2024-04-19T22:45:15.209381+0000","last_active":"2024-04-19T22:46:03.594164+0000","last_peered":"2024-04-19T22:46:03.594164+0000","last_clean":"2024-04-19T22:46:03.594164+0000","last_became_active":"2024-04-19T22:45:15.208523+0000","last_became_peered":"2024-04-19T22:45:15.208523+0000","last_unstale":"2024-04-19T22:46:03.594164+0000","last_undegraded":"2024-04-19T22:46:03.594164+0000","last_fullsized":"2024-04-19T22:46:03.594164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:59:37.938189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787662+0000","last_change":"2024-04-19T22:45:13.187539+0000","last_active":"2024-04-19T22:46:03.787662+0000","last_peered":"2024-04-19T22:46:03.787662+0000","last_clean":"2024-04-19T22:46:03.787662+0000","last_became_active":"2024-04-19T22:45:13.186175+0000","last_became_peered":"2024-04-19T22:45:13.186175+0000","last_unstale":"2024-04-19T22:46:03.787662+0000","last_undegraded":"2024-04-19T22:46:03.787662+0000","last_fullsized":"2024-04-19T22:46:03.787662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:45:52.958637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"61'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725367+0000","last_change":"2024-04-19T22:45:08.571757+0000","last_active":"2024-04-19T22:46:03.725367+0000","last_peered":"2024-04-19T22:46:03.725367+0000","last_clean":"2024-04-19T22:46:03.725367+0000","last_became_active":"2024-04-19T22:45:08.571126+0000","last_became_peered":"2024-04-19T22:45:08.571126+0000","last_unstale":"2024-04-19T22:46:03.725367+0000","last_undegraded":"2024-04-19T22:46:03.725367+0000","last_fullsized":"2024-04-19T22:46:03.725367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:29:22.098141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725472+0000","last_change":"2024-04-19T22:45:10.803550+0000","last_active":"2024-04-19T22:46:03.725472+0000","last_peered":"2024-04-19T22:46:03.725472+0000","last_clean":"2024-04-19T22:46:03.725472+0000","last_became_active":"2024-04-19T22:45:10.802958+0000","last_became_peered":"2024-04-19T22:45:10.802958+0000","last_unstale":"2024-04-19T22:46:03.725472+0000","last_undegraded":"2024-04-19T22:46:03.725472+0000","last_fullsized":"2024-04-19T22:46:03.725472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:29:31.355784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790807+0000","last_change":"2024-04-19T22:45:15.212835+0000","last_active":"2024-04-19T22:46:03.790807+0000","last_peered":"2024-04-19T22:46:03.790807+0000","last_clean":"2024-04-19T22:46:03.790807+0000","last_became_active":"2024-04-19T22:45:15.211943+0000","last_became_peered":"2024-04-19T22:45:15.211943+0000","last_unstale":"2024-04-19T22:46:03.790807+0000","last_undegraded":"2024-04-19T22:46:03.790807+0000","last_fullsized":"2024-04-19T22:46:03.790807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:27:16.672767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'11","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775910+0000","last_change":"2024-04-19T22:45:13.181624+0000","last_active":"2024-04-19T22:48:03.775910+0000","last_peered":"2024-04-19T22:48:03.775910+0000","last_clean":"2024-04-19T22:48:03.775910+0000","last_became_active":"2024-04-19T22:45:13.180784+0000","last_became_peered":"2024-04-19T22:45:13.180784+0000","last_unstale":"2024-04-19T22:48:03.775910+0000","last_undegraded":"2024-04-19T22:48:03.775910+0000","last_fullsized":"2024-04-19T22:48:03.775910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:15:57.618023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787597+0000","last_change":"2024-04-19T22:45:08.576386+0000","last_active":"2024-04-19T22:46:03.787597+0000","last_peered":"2024-04-19T22:46:03.787597+0000","last_clean":"2024-04-19T22:46:03.787597+0000","last_became_active":"2024-04-19T22:45:08.576060+0000","last_became_peered":"2024-04-19T22:45:08.576060+0000","last_unstale":"2024-04-19T22:46:03.787597+0000","last_undegraded":"2024-04-19T22:46:03.787597+0000","last_fullsized":"2024-04-19T22:46:03.787597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:18:30.943836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593945+0000","last_change":"2024-04-19T22:45:10.787344+0000","last_active":"2024-04-19T22:46:03.593945+0000","last_peered":"2024-04-19T22:46:03.593945+0000","last_clean":"2024-04-19T22:46:03.593945+0000","last_became_active":"2024-04-19T22:45:10.786172+0000","last_became_peered":"2024-04-19T22:45:10.786172+0000","last_unstale":"2024-04-19T22:46:03.593945+0000","last_undegraded":"2024-04-19T22:46:03.593945+0000","last_fullsized":"2024-04-19T22:46:03.593945+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:18:48.195734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726078+0000","last_change":"2024-04-19T22:45:15.537066+0000","last_active":"2024-04-19T22:46:03.726078+0000","last_peered":"2024-04-19T22:46:03.726078+0000","last_clean":"2024-04-19T22:46:03.726078+0000","last_became_active":"2024-04-19T22:45:15.536196+0000","last_became_peered":"2024-04-19T22:45:15.536196+0000","last_unstale":"2024-04-19T22:46:03.726078+0000","last_undegraded":"2024-04-19T22:46:03.726078+0000","last_fullsized":"2024-04-19T22:46:03.726078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:59:19.506164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788291+0000","last_change":"2024-04-19T22:45:13.177065+0000","last_active":"2024-04-19T22:46:03.788291+0000","last_peered":"2024-04-19T22:46:03.788291+0000","last_clean":"2024-04-19T22:46:03.788291+0000","last_became_active":"2024-04-19T22:45:13.176514+0000","last_became_peered":"2024-04-19T22:45:13.176514+0000","last_unstale":"2024-04-19T22:46:03.788291+0000","last_undegraded":"2024-04-19T22:46:03.788291+0000","last_fullsized":"2024-04-19T22:46:03.788291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:48:23.928099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790496+0000","last_change":"2024-04-19T22:45:08.579693+0000","last_active":"2024-04-19T22:46:03.790496+0000","last_peered":"2024-04-19T22:46:03.790496+0000","last_clean":"2024-04-19T22:46:03.790496+0000","last_became_active":"2024-04-19T22:45:08.579366+0000","last_became_peered":"2024-04-19T22:45:08.579366+0000","last_unstale":"2024-04-19T22:46:03.790496+0000","last_undegraded":"2024-04-19T22:46:03.790496+0000","last_fullsized":"2024-04-19T22:46:03.790496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:23:10.449029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788737+0000","last_change":"2024-04-19T22:45:10.791679+0000","last_active":"2024-04-19T22:46:03.788737+0000","last_peered":"2024-04-19T22:46:03.788737+0000","last_clean":"2024-04-19T22:46:03.788737+0000","last_became_active":"2024-04-19T22:45:10.791234+0000","last_became_peered":"2024-04-19T22:45:10.791234+0000","last_unstale":"2024-04-19T22:46:03.788737+0000","last_undegraded":"2024-04-19T22:46:03.788737+0000","last_fullsized":"2024-04-19T22:46:03.788737+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:37:17.248283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788277+0000","last_change":"2024-04-19T22:45:15.213323+0000","last_active":"2024-04-19T22:46:03.788277+0000","last_peered":"2024-04-19T22:46:03.788277+0000","last_clean":"2024-04-19T22:46:03.788277+0000","last_became_active":"2024-04-19T22:45:15.212105+0000","last_became_peered":"2024-04-19T22:45:15.212105+0000","last_unstale":"2024-04-19T22:46:03.788277+0000","last_undegraded":"2024-04-19T22:46:03.788277+0000","last_fullsized":"2024-04-19T22:46:03.788277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:01:26.244813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789299+0000","last_change":"2024-04-19T22:45:13.178930+0000","last_active":"2024-04-19T22:46:03.789299+0000","last_peered":"2024-04-19T22:46:03.789299+0000","last_clean":"2024-04-19T22:46:03.789299+0000","last_became_active":"2024-04-19T22:45:13.178567+0000","last_became_peered":"2024-04-19T22:45:13.178567+0000","last_unstale":"2024-04-19T22:46:03.789299+0000","last_undegraded":"2024-04-19T22:46:03.789299+0000","last_fullsized":"2024-04-19T22:46:03.789299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:28:39.786737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789055+0000","last_change":"2024-04-19T22:45:08.581386+0000","last_active":"2024-04-19T22:46:03.789055+0000","last_peered":"2024-04-19T22:46:03.789055+0000","last_clean":"2024-04-19T22:46:03.789055+0000","last_became_active":"2024-04-19T22:45:08.581007+0000","last_became_peered":"2024-04-19T22:45:08.581007+0000","last_unstale":"2024-04-19T22:46:03.789055+0000","last_undegraded":"2024-04-19T22:46:03.789055+0000","last_fullsized":"2024-04-19T22:46:03.789055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:58:24.784876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"68'6","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787685+0000","last_change":"2024-04-19T22:45:10.798536+0000","last_active":"2024-04-19T22:46:03.787685+0000","last_peered":"2024-04-19T22:46:03.787685+0000","last_clean":"2024-04-19T22:46:03.787685+0000","last_became_active":"2024-04-19T22:45:10.797695+0000","last_became_peered":"2024-04-19T22:45:10.797695+0000","last_unstale":"2024-04-19T22:46:03.787685+0000","last_undegraded":"2024-04-19T22:46:03.787685+0000","last_fullsized":"2024-04-19T22:46:03.787685+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:38:40.127531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725262+0000","last_change":"2024-04-19T22:45:15.202400+0000","last_active":"2024-04-19T22:46:03.725262+0000","last_peered":"2024-04-19T22:46:03.725262+0000","last_clean":"2024-04-19T22:46:03.725262+0000","last_became_active":"2024-04-19T22:45:15.201407+0000","last_became_peered":"2024-04-19T22:45:15.201407+0000","last_unstale":"2024-04-19T22:46:03.725262+0000","last_undegraded":"2024-04-19T22:46:03.725262+0000","last_fullsized":"2024-04-19T22:46:03.725262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:18:42.909753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593769+0000","last_change":"2024-04-19T22:45:13.173257+0000","last_active":"2024-04-19T22:46:03.593769+0000","last_peered":"2024-04-19T22:46:03.593769+0000","last_clean":"2024-04-19T22:46:03.593769+0000","last_became_active":"2024-04-19T22:45:13.172407+0000","last_became_peered":"2024-04-19T22:45:13.172407+0000","last_unstale":"2024-04-19T22:46:03.593769+0000","last_undegraded":"2024-04-19T22:46:03.593769+0000","last_fullsized":"2024-04-19T22:46:03.593769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:49:01.457142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593217+0000","last_change":"2024-04-19T22:45:08.581513+0000","last_active":"2024-04-19T22:46:03.593217+0000","last_peered":"2024-04-19T22:46:03.593217+0000","last_clean":"2024-04-19T22:46:03.593217+0000","last_became_active":"2024-04-19T22:45:08.580954+0000","last_became_peered":"2024-04-19T22:45:08.580954+0000","last_unstale":"2024-04-19T22:46:03.593217+0000","last_undegraded":"2024-04-19T22:46:03.593217+0000","last_fullsized":"2024-04-19T22:46:03.593217+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:53:41.071711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"68'10","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590510+0000","last_change":"2024-04-19T22:45:10.793990+0000","last_active":"2024-04-19T22:46:03.590510+0000","last_peered":"2024-04-19T22:46:03.590510+0000","last_clean":"2024-04-19T22:46:03.590510+0000","last_became_active":"2024-04-19T22:45:10.793691+0000","last_became_peered":"2024-04-19T22:45:10.793691+0000","last_unstale":"2024-04-19T22:46:03.590510+0000","last_undegraded":"2024-04-19T22:46:03.590510+0000","last_fullsized":"2024-04-19T22:46:03.590510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:16:40.334515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786785+0000","last_change":"2024-04-19T22:45:15.221323+0000","last_active":"2024-04-19T22:46:03.786785+0000","last_peered":"2024-04-19T22:46:03.786785+0000","last_clean":"2024-04-19T22:46:03.786785+0000","last_became_active":"2024-04-19T22:45:15.220645+0000","last_became_peered":"2024-04-19T22:45:15.220645+0000","last_unstale":"2024-04-19T22:46:03.786785+0000","last_undegraded":"2024-04-19T22:46:03.786785+0000","last_fullsized":"2024-04-19T22:46:03.786785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:35:07.017051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725968+0000","last_change":"2024-04-19T22:45:13.178344+0000","last_active":"2024-04-19T22:46:03.725968+0000","last_peered":"2024-04-19T22:46:03.725968+0000","last_clean":"2024-04-19T22:46:03.725968+0000","last_became_active":"2024-04-19T22:45:13.177442+0000","last_became_peered":"2024-04-19T22:45:13.177442+0000","last_unstale":"2024-04-19T22:46:03.725968+0000","last_undegraded":"2024-04-19T22:46:03.725968+0000","last_fullsized":"2024-04-19T22:46:03.725968+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:26:19.408048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789925+0000","last_change":"2024-04-19T22:45:08.574594+0000","last_active":"2024-04-19T22:46:03.789925+0000","last_peered":"2024-04-19T22:46:03.789925+0000","last_clean":"2024-04-19T22:46:03.789925+0000","last_became_active":"2024-04-19T22:45:08.574245+0000","last_became_peered":"2024-04-19T22:45:08.574245+0000","last_unstale":"2024-04-19T22:46:03.789925+0000","last_undegraded":"2024-04-19T22:46:03.789925+0000","last_fullsized":"2024-04-19T22:46:03.789925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:00:46.916795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790639+0000","last_change":"2024-04-19T22:45:10.793030+0000","last_active":"2024-04-19T22:46:03.790639+0000","last_peered":"2024-04-19T22:46:03.790639+0000","last_clean":"2024-04-19T22:46:03.790639+0000","last_became_active":"2024-04-19T22:45:10.790333+0000","last_became_peered":"2024-04-19T22:45:10.790333+0000","last_unstale":"2024-04-19T22:46:03.790639+0000","last_undegraded":"2024-04-19T22:46:03.790639+0000","last_fullsized":"2024-04-19T22:46:03.790639+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:31:51.423728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591426+0000","last_change":"2024-04-19T22:45:15.190590+0000","last_active":"2024-04-19T22:46:03.591426+0000","last_peered":"2024-04-19T22:46:03.591426+0000","last_clean":"2024-04-19T22:46:03.591426+0000","last_became_active":"2024-04-19T22:45:15.189426+0000","last_became_peered":"2024-04-19T22:45:15.189426+0000","last_unstale":"2024-04-19T22:46:03.591426+0000","last_undegraded":"2024-04-19T22:46:03.591426+0000","last_fullsized":"2024-04-19T22:46:03.591426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:36:13.965454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.776490+0000","last_change":"2024-04-19T22:45:13.183167+0000","last_active":"2024-04-19T22:48:03.776490+0000","last_peered":"2024-04-19T22:48:03.776490+0000","last_clean":"2024-04-19T22:48:03.776490+0000","last_became_active":"2024-04-19T22:45:13.182500+0000","last_became_peered":"2024-04-19T22:45:13.182500+0000","last_unstale":"2024-04-19T22:48:03.776490+0000","last_undegraded":"2024-04-19T22:48:03.776490+0000","last_fullsized":"2024-04-19T22:48:03.776490+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:33:48.757651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787333+0000","last_change":"2024-04-19T22:45:08.570026+0000","last_active":"2024-04-19T22:46:03.787333+0000","last_peered":"2024-04-19T22:46:03.787333+0000","last_clean":"2024-04-19T22:46:03.787333+0000","last_became_active":"2024-04-19T22:45:08.569519+0000","last_became_peered":"2024-04-19T22:45:08.569519+0000","last_unstale":"2024-04-19T22:46:03.787333+0000","last_undegraded":"2024-04-19T22:46:03.787333+0000","last_fullsized":"2024-04-19T22:46:03.787333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:59:14.019247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787124+0000","last_change":"2024-04-19T22:45:10.795326+0000","last_active":"2024-04-19T22:46:03.787124+0000","last_peered":"2024-04-19T22:46:03.787124+0000","last_clean":"2024-04-19T22:46:03.787124+0000","last_became_active":"2024-04-19T22:45:10.794964+0000","last_became_peered":"2024-04-19T22:45:10.794964+0000","last_unstale":"2024-04-19T22:46:03.787124+0000","last_undegraded":"2024-04-19T22:46:03.787124+0000","last_fullsized":"2024-04-19T22:46:03.787124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:20:55.390410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787573+0000","last_change":"2024-04-19T22:45:15.212590+0000","last_active":"2024-04-19T22:46:03.787573+0000","last_peered":"2024-04-19T22:46:03.787573+0000","last_clean":"2024-04-19T22:46:03.787573+0000","last_became_active":"2024-04-19T22:45:15.211573+0000","last_became_peered":"2024-04-19T22:45:15.211573+0000","last_unstale":"2024-04-19T22:46:03.787573+0000","last_undegraded":"2024-04-19T22:46:03.787573+0000","last_fullsized":"2024-04-19T22:46:03.787573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:49:00.256929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775714+0000","last_change":"2024-04-19T22:45:13.183652+0000","last_active":"2024-04-19T22:48:03.775714+0000","last_peered":"2024-04-19T22:48:03.775714+0000","last_clean":"2024-04-19T22:48:03.775714+0000","last_became_active":"2024-04-19T22:45:13.182802+0000","last_became_peered":"2024-04-19T22:45:13.182802+0000","last_unstale":"2024-04-19T22:48:03.775714+0000","last_undegraded":"2024-04-19T22:48:03.775714+0000","last_fullsized":"2024-04-19T22:48:03.775714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:08:51.867984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787390+0000","last_change":"2024-04-19T22:45:08.583782+0000","last_active":"2024-04-19T22:46:03.787390+0000","last_peered":"2024-04-19T22:46:03.787390+0000","last_clean":"2024-04-19T22:46:03.787390+0000","last_became_active":"2024-04-19T22:45:08.583218+0000","last_became_peered":"2024-04-19T22:45:08.583218+0000","last_unstale":"2024-04-19T22:46:03.787390+0000","last_undegraded":"2024-04-19T22:46:03.787390+0000","last_fullsized":"2024-04-19T22:46:03.787390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:03:57.931369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789183+0000","last_change":"2024-04-19T22:45:10.799112+0000","last_active":"2024-04-19T22:46:03.789183+0000","last_peered":"2024-04-19T22:46:03.789183+0000","last_clean":"2024-04-19T22:46:03.789183+0000","last_became_active":"2024-04-19T22:45:10.798841+0000","last_became_peered":"2024-04-19T22:45:10.798841+0000","last_unstale":"2024-04-19T22:46:03.789183+0000","last_undegraded":"2024-04-19T22:46:03.789183+0000","last_fullsized":"2024-04-19T22:46:03.789183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:58:26.687875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790244+0000","last_change":"2024-04-19T22:45:15.538294+0000","last_active":"2024-04-19T22:46:03.790244+0000","last_peered":"2024-04-19T22:46:03.790244+0000","last_clean":"2024-04-19T22:46:03.790244+0000","last_became_active":"2024-04-19T22:45:15.537443+0000","last_became_peered":"2024-04-19T22:45:15.537443+0000","last_unstale":"2024-04-19T22:46:03.790244+0000","last_undegraded":"2024-04-19T22:46:03.790244+0000","last_fullsized":"2024-04-19T22:46:03.790244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:02:19.167732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788854+0000","last_change":"2024-04-19T22:45:13.181699+0000","last_active":"2024-04-19T22:46:03.788854+0000","last_peered":"2024-04-19T22:46:03.788854+0000","last_clean":"2024-04-19T22:46:03.788854+0000","last_became_active":"2024-04-19T22:45:13.181359+0000","last_became_peered":"2024-04-19T22:45:13.181359+0000","last_unstale":"2024-04-19T22:46:03.788854+0000","last_undegraded":"2024-04-19T22:46:03.788854+0000","last_fullsized":"2024-04-19T22:46:03.788854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:23:36.577554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789356+0000","last_change":"2024-04-19T22:45:08.574040+0000","last_active":"2024-04-19T22:46:03.789356+0000","last_peered":"2024-04-19T22:46:03.789356+0000","last_clean":"2024-04-19T22:46:03.789356+0000","last_became_active":"2024-04-19T22:45:08.573701+0000","last_became_peered":"2024-04-19T22:45:08.573701+0000","last_unstale":"2024-04-19T22:46:03.789356+0000","last_undegraded":"2024-04-19T22:46:03.789356+0000","last_fullsized":"2024-04-19T22:46:03.789356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:56:47.846992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"68'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788757+0000","last_change":"2024-04-19T22:45:10.792743+0000","last_active":"2024-04-19T22:46:03.788757+0000","last_peered":"2024-04-19T22:46:03.788757+0000","last_clean":"2024-04-19T22:46:03.788757+0000","last_became_active":"2024-04-19T22:45:10.792301+0000","last_became_peered":"2024-04-19T22:45:10.792301+0000","last_unstale":"2024-04-19T22:46:03.788757+0000","last_undegraded":"2024-04-19T22:46:03.788757+0000","last_fullsized":"2024-04-19T22:46:03.788757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:55:19.296765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589854+0000","last_change":"2024-04-19T22:45:15.198388+0000","last_active":"2024-04-19T22:46:03.589854+0000","last_peered":"2024-04-19T22:46:03.589854+0000","last_clean":"2024-04-19T22:46:03.589854+0000","last_became_active":"2024-04-19T22:45:15.197451+0000","last_became_peered":"2024-04-19T22:45:15.197451+0000","last_unstale":"2024-04-19T22:46:03.589854+0000","last_undegraded":"2024-04-19T22:46:03.589854+0000","last_fullsized":"2024-04-19T22:46:03.589854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:01:42.729396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726763+0000","last_change":"2024-04-19T22:45:13.184849+0000","last_active":"2024-04-19T22:46:03.726763+0000","last_peered":"2024-04-19T22:46:03.726763+0000","last_clean":"2024-04-19T22:46:03.726763+0000","last_became_active":"2024-04-19T22:45:13.182034+0000","last_became_peered":"2024-04-19T22:45:13.182034+0000","last_unstale":"2024-04-19T22:46:03.726763+0000","last_undegraded":"2024-04-19T22:46:03.726763+0000","last_fullsized":"2024-04-19T22:46:03.726763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:44:41.890650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"61'1","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588389+0000","last_change":"2024-04-19T22:45:08.589344+0000","last_active":"2024-04-19T22:46:03.588389+0000","last_peered":"2024-04-19T22:46:03.588389+0000","last_clean":"2024-04-19T22:46:03.588389+0000","last_became_active":"2024-04-19T22:45:08.588563+0000","last_became_peered":"2024-04-19T22:45:08.588563+0000","last_unstale":"2024-04-19T22:46:03.588389+0000","last_undegraded":"2024-04-19T22:46:03.588389+0000","last_fullsized":"2024-04-19T22:46:03.588389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:15:14.474968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788382+0000","last_change":"2024-04-19T22:45:10.790471+0000","last_active":"2024-04-19T22:46:03.788382+0000","last_peered":"2024-04-19T22:46:03.788382+0000","last_clean":"2024-04-19T22:46:03.788382+0000","last_became_active":"2024-04-19T22:45:10.789657+0000","last_became_peered":"2024-04-19T22:45:10.789657+0000","last_unstale":"2024-04-19T22:46:03.788382+0000","last_undegraded":"2024-04-19T22:46:03.788382+0000","last_fullsized":"2024-04-19T22:46:03.788382+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:35:34.553065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726028+0000","last_change":"2024-04-19T22:45:15.206768+0000","last_active":"2024-04-19T22:46:03.726028+0000","last_peered":"2024-04-19T22:46:03.726028+0000","last_clean":"2024-04-19T22:46:03.726028+0000","last_became_active":"2024-04-19T22:45:15.205879+0000","last_became_peered":"2024-04-19T22:45:15.205879+0000","last_unstale":"2024-04-19T22:46:03.726028+0000","last_undegraded":"2024-04-19T22:46:03.726028+0000","last_fullsized":"2024-04-19T22:46:03.726028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:33:34.245992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"61'2","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591111+0000","last_change":"2024-04-19T22:45:08.571672+0000","last_active":"2024-04-19T22:46:03.591111+0000","last_peered":"2024-04-19T22:46:03.591111+0000","last_clean":"2024-04-19T22:46:03.591111+0000","last_became_active":"2024-04-19T22:45:08.571360+0000","last_became_peered":"2024-04-19T22:45:08.571360+0000","last_unstale":"2024-04-19T22:46:03.591111+0000","last_undegraded":"2024-04-19T22:46:03.591111+0000","last_fullsized":"2024-04-19T22:46:03.591111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:22:02.933144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"68'11","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790799+0000","last_change":"2024-04-19T22:45:10.785228+0000","last_active":"2024-04-19T22:46:03.790799+0000","last_peered":"2024-04-19T22:46:03.790799+0000","last_clean":"2024-04-19T22:46:03.790799+0000","last_became_active":"2024-04-19T22:45:10.784961+0000","last_became_peered":"2024-04-19T22:45:10.784961+0000","last_unstale":"2024-04-19T22:46:03.790799+0000","last_undegraded":"2024-04-19T22:46:03.790799+0000","last_fullsized":"2024-04-19T22:46:03.790799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:58:06.348119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588155+0000","last_change":"2024-04-19T22:45:13.157874+0000","last_active":"2024-04-19T22:46:03.588155+0000","last_peered":"2024-04-19T22:46:03.588155+0000","last_clean":"2024-04-19T22:46:03.588155+0000","last_became_active":"2024-04-19T22:45:13.157033+0000","last_became_peered":"2024-04-19T22:45:13.157033+0000","last_unstale":"2024-04-19T22:46:03.588155+0000","last_undegraded":"2024-04-19T22:46:03.588155+0000","last_fullsized":"2024-04-19T22:46:03.588155+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:03:34.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786814+0000","last_change":"2024-04-19T22:45:15.216345+0000","last_active":"2024-04-19T22:46:03.786814+0000","last_peered":"2024-04-19T22:46:03.786814+0000","last_clean":"2024-04-19T22:46:03.786814+0000","last_became_active":"2024-04-19T22:45:15.215676+0000","last_became_peered":"2024-04-19T22:45:15.215676+0000","last_unstale":"2024-04-19T22:46:03.786814+0000","last_undegraded":"2024-04-19T22:46:03.786814+0000","last_fullsized":"2024-04-19T22:46:03.786814+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:08:58.434011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593723+0000","last_change":"2024-04-19T22:45:08.587718+0000","last_active":"2024-04-19T22:46:03.593723+0000","last_peered":"2024-04-19T22:46:03.593723+0000","last_clean":"2024-04-19T22:46:03.593723+0000","last_became_active":"2024-04-19T22:45:08.587387+0000","last_became_peered":"2024-04-19T22:45:08.587387+0000","last_unstale":"2024-04-19T22:46:03.593723+0000","last_undegraded":"2024-04-19T22:46:03.593723+0000","last_fullsized":"2024-04-19T22:46:03.593723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:42:05.891402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"68'16","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775801+0000","last_change":"2024-04-19T22:45:10.804082+0000","last_active":"2024-04-19T22:48:03.775801+0000","last_peered":"2024-04-19T22:48:03.775801+0000","last_clean":"2024-04-19T22:48:03.775801+0000","last_became_active":"2024-04-19T22:45:10.803764+0000","last_became_peered":"2024-04-19T22:45:10.803764+0000","last_unstale":"2024-04-19T22:48:03.775801+0000","last_undegraded":"2024-04-19T22:48:03.775801+0000","last_fullsized":"2024-04-19T22:48:03.775801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:01:52.320135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"71'2","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593703+0000","last_change":"2024-04-19T22:45:21.495112+0000","last_active":"2024-04-19T22:46:03.593703+0000","last_peered":"2024-04-19T22:46:03.593703+0000","last_clean":"2024-04-19T22:46:03.593703+0000","last_became_active":"2024-04-19T22:45:12.150884+0000","last_became_peered":"2024-04-19T22:45:12.150884+0000","last_unstale":"2024-04-19T22:46:03.593703+0000","last_undegraded":"2024-04-19T22:46:03.593703+0000","last_fullsized":"2024-04-19T22:46:03.593703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:35:16.990888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031948419999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'11","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775675+0000","last_change":"2024-04-19T22:45:13.171218+0000","last_active":"2024-04-19T22:48:03.775675+0000","last_peered":"2024-04-19T22:48:03.775675+0000","last_clean":"2024-04-19T22:48:03.775675+0000","last_became_active":"2024-04-19T22:45:13.170495+0000","last_became_peered":"2024-04-19T22:45:13.170495+0000","last_unstale":"2024-04-19T22:48:03.775675+0000","last_undegraded":"2024-04-19T22:48:03.775675+0000","last_fullsized":"2024-04-19T22:48:03.775675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:57:06.341243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726569+0000","last_change":"2024-04-19T22:45:15.211461+0000","last_active":"2024-04-19T22:46:03.726569+0000","last_peered":"2024-04-19T22:46:03.726569+0000","last_clean":"2024-04-19T22:46:03.726569+0000","last_became_active":"2024-04-19T22:45:15.210210+0000","last_became_peered":"2024-04-19T22:45:15.210210+0000","last_unstale":"2024-04-19T22:46:03.726569+0000","last_undegraded":"2024-04-19T22:46:03.726569+0000","last_fullsized":"2024-04-19T22:46:03.726569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:29:31.981396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787486+0000","last_change":"2024-04-19T22:45:08.576884+0000","last_active":"2024-04-19T22:46:03.787486+0000","last_peered":"2024-04-19T22:46:03.787486+0000","last_clean":"2024-04-19T22:46:03.787486+0000","last_became_active":"2024-04-19T22:45:08.576467+0000","last_became_peered":"2024-04-19T22:45:08.576467+0000","last_unstale":"2024-04-19T22:46:03.787486+0000","last_undegraded":"2024-04-19T22:46:03.787486+0000","last_fullsized":"2024-04-19T22:46:03.787486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:41:43.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"68'19","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589897+0000","last_change":"2024-04-19T22:45:10.794461+0000","last_active":"2024-04-19T22:46:03.589897+0000","last_peered":"2024-04-19T22:46:03.589897+0000","last_clean":"2024-04-19T22:46:03.589897+0000","last_became_active":"2024-04-19T22:45:10.793389+0000","last_became_peered":"2024-04-19T22:45:10.793389+0000","last_unstale":"2024-04-19T22:46:03.589897+0000","last_undegraded":"2024-04-19T22:46:03.589897+0000","last_fullsized":"2024-04-19T22:46:03.589897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:16:42.577566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787616+0000","last_change":"2024-04-19T22:45:13.179853+0000","last_active":"2024-04-19T22:46:03.787616+0000","last_peered":"2024-04-19T22:46:03.787616+0000","last_clean":"2024-04-19T22:46:03.787616+0000","last_became_active":"2024-04-19T22:45:13.178891+0000","last_became_peered":"2024-04-19T22:45:13.178891+0000","last_unstale":"2024-04-19T22:46:03.787616+0000","last_undegraded":"2024-04-19T22:46:03.787616+0000","last_fullsized":"2024-04-19T22:46:03.787616+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:29:41.539574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790343+0000","last_change":"2024-04-19T22:45:15.534007+0000","last_active":"2024-04-19T22:46:03.790343+0000","last_peered":"2024-04-19T22:46:03.790343+0000","last_clean":"2024-04-19T22:46:03.790343+0000","last_became_active":"2024-04-19T22:45:15.533118+0000","last_became_peered":"2024-04-19T22:45:15.533118+0000","last_unstale":"2024-04-19T22:46:03.790343+0000","last_undegraded":"2024-04-19T22:46:03.790343+0000","last_fullsized":"2024-04-19T22:46:03.790343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:29:29.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"68'18","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591879+0000","last_change":"2024-04-19T22:45:10.784163+0000","last_active":"2024-04-19T22:46:03.591879+0000","last_peered":"2024-04-19T22:46:03.591879+0000","last_clean":"2024-04-19T22:46:03.591879+0000","last_became_active":"2024-04-19T22:45:10.783335+0000","last_became_peered":"2024-04-19T22:45:10.783335+0000","last_unstale":"2024-04-19T22:46:03.591879+0000","last_undegraded":"2024-04-19T22:46:03.591879+0000","last_fullsized":"2024-04-19T22:46:03.591879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:39:37.499618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588340+0000","last_change":"2024-04-19T22:45:08.586174+0000","last_active":"2024-04-19T22:46:03.588340+0000","last_peered":"2024-04-19T22:46:03.588340+0000","last_clean":"2024-04-19T22:46:03.588340+0000","last_became_active":"2024-04-19T22:45:08.585491+0000","last_became_peered":"2024-04-19T22:45:08.585491+0000","last_unstale":"2024-04-19T22:46:03.588340+0000","last_undegraded":"2024-04-19T22:46:03.588340+0000","last_fullsized":"2024-04-19T22:46:03.588340+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:23:25.459210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588964+0000","last_change":"2024-04-19T22:45:13.184745+0000","last_active":"2024-04-19T22:46:03.588964+0000","last_peered":"2024-04-19T22:46:03.588964+0000","last_clean":"2024-04-19T22:46:03.588964+0000","last_became_active":"2024-04-19T22:45:13.184391+0000","last_became_peered":"2024-04-19T22:45:13.184391+0000","last_unstale":"2024-04-19T22:46:03.588964+0000","last_undegraded":"2024-04-19T22:46:03.588964+0000","last_fullsized":"2024-04-19T22:46:03.588964+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:46:27.493399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789202+0000","last_change":"2024-04-19T22:45:15.202971+0000","last_active":"2024-04-19T22:46:03.789202+0000","last_peered":"2024-04-19T22:46:03.789202+0000","last_clean":"2024-04-19T22:46:03.789202+0000","last_became_active":"2024-04-19T22:45:15.200145+0000","last_became_peered":"2024-04-19T22:45:15.200145+0000","last_unstale":"2024-04-19T22:46:03.789202+0000","last_undegraded":"2024-04-19T22:46:03.789202+0000","last_fullsized":"2024-04-19T22:46:03.789202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:00:53.730301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725606+0000","last_change":"2024-04-19T22:45:10.797435+0000","last_active":"2024-04-19T22:46:03.725606+0000","last_peered":"2024-04-19T22:46:03.725606+0000","last_clean":"2024-04-19T22:46:03.725606+0000","last_became_active":"2024-04-19T22:45:10.797150+0000","last_became_peered":"2024-04-19T22:45:10.797150+0000","last_unstale":"2024-04-19T22:46:03.725606+0000","last_undegraded":"2024-04-19T22:46:03.725606+0000","last_fullsized":"2024-04-19T22:46:03.725606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:53:31.228324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"61'1","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787638+0000","last_change":"2024-04-19T22:45:08.580008+0000","last_active":"2024-04-19T22:46:03.787638+0000","last_peered":"2024-04-19T22:46:03.787638+0000","last_clean":"2024-04-19T22:46:03.787638+0000","last_became_active":"2024-04-19T22:45:08.579669+0000","last_became_peered":"2024-04-19T22:45:08.579669+0000","last_unstale":"2024-04-19T22:46:03.787638+0000","last_undegraded":"2024-04-19T22:46:03.787638+0000","last_fullsized":"2024-04-19T22:46:03.787638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:52:48.205465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:05.766074+0000","last_change":"2024-04-19T22:44:29.412383+0000","last_active":"2024-04-19T22:46:05.766074+0000","last_peered":"2024-04-19T22:46:05.766074+0000","last_clean":"2024-04-19T22:46:05.766074+0000","last_became_active":"2024-04-19T22:44:29.411199+0000","last_became_peered":"2024-04-19T22:44:29.411199+0000","last_unstale":"2024-04-19T22:46:05.766074+0000","last_undegraded":"2024-04-19T22:46:05.766074+0000","last_fullsized":"2024-04-19T22:46:05.766074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:40:10.912232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:40:10.912232+0000","last_clean_scrub_stamp":"2024-04-19T22:40:10.912232+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:11:30.618778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790296+0000","last_change":"2024-04-19T22:45:13.185834+0000","last_active":"2024-04-19T22:46:03.790296+0000","last_peered":"2024-04-19T22:46:03.790296+0000","last_clean":"2024-04-19T22:46:03.790296+0000","last_became_active":"2024-04-19T22:45:13.185121+0000","last_became_peered":"2024-04-19T22:45:13.185121+0000","last_unstale":"2024-04-19T22:46:03.790296+0000","last_undegraded":"2024-04-19T22:46:03.790296+0000","last_fullsized":"2024-04-19T22:46:03.790296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T22:59:19.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593169+0000","last_change":"2024-04-19T22:45:15.205058+0000","last_active":"2024-04-19T22:46:03.593169+0000","last_peered":"2024-04-19T22:46:03.593169+0000","last_clean":"2024-04-19T22:46:03.593169+0000","last_became_active":"2024-04-19T22:45:15.204198+0000","last_became_peered":"2024-04-19T22:45:15.204198+0000","last_unstale":"2024-04-19T22:46:03.593169+0000","last_undegraded":"2024-04-19T22:46:03.593169+0000","last_fullsized":"2024-04-19T22:46:03.593169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:46:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"68'14","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787022+0000","last_change":"2024-04-19T22:45:10.796383+0000","last_active":"2024-04-19T22:46:03.787022+0000","last_peered":"2024-04-19T22:46:03.787022+0000","last_clean":"2024-04-19T22:46:03.787022+0000","last_became_active":"2024-04-19T22:45:10.795603+0000","last_became_peered":"2024-04-19T22:45:10.795603+0000","last_unstale":"2024-04-19T22:46:03.787022+0000","last_undegraded":"2024-04-19T22:46:03.787022+0000","last_fullsized":"2024-04-19T22:46:03.787022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:46:24.756510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787493+0000","last_change":"2024-04-19T22:45:08.574983+0000","last_active":"2024-04-19T22:46:03.787493+0000","last_peered":"2024-04-19T22:46:03.787493+0000","last_clean":"2024-04-19T22:46:03.787493+0000","last_became_active":"2024-04-19T22:45:08.574693+0000","last_became_peered":"2024-04-19T22:45:08.574693+0000","last_unstale":"2024-04-19T22:46:03.787493+0000","last_undegraded":"2024-04-19T22:46:03.787493+0000","last_fullsized":"2024-04-19T22:46:03.787493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:45:52.857747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789000+0000","last_change":"2024-04-19T22:45:13.185771+0000","last_active":"2024-04-19T22:46:03.789000+0000","last_peered":"2024-04-19T22:46:03.789000+0000","last_clean":"2024-04-19T22:46:03.789000+0000","last_became_active":"2024-04-19T22:45:13.184829+0000","last_became_peered":"2024-04-19T22:45:13.184829+0000","last_unstale":"2024-04-19T22:46:03.789000+0000","last_undegraded":"2024-04-19T22:46:03.789000+0000","last_fullsized":"2024-04-19T22:46:03.789000+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:52:45.006551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591454+0000","last_change":"2024-04-19T22:45:15.534086+0000","last_active":"2024-04-19T22:46:03.591454+0000","last_peered":"2024-04-19T22:46:03.591454+0000","last_clean":"2024-04-19T22:46:03.591454+0000","last_became_active":"2024-04-19T22:45:15.533046+0000","last_became_peered":"2024-04-19T22:45:15.533046+0000","last_unstale":"2024-04-19T22:46:03.591454+0000","last_undegraded":"2024-04-19T22:46:03.591454+0000","last_fullsized":"2024-04-19T22:46:03.591454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:53:39.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790436+0000","last_change":"2024-04-19T22:45:08.573042+0000","last_active":"2024-04-19T22:46:03.790436+0000","last_peered":"2024-04-19T22:46:03.790436+0000","last_clean":"2024-04-19T22:46:03.790436+0000","last_became_active":"2024-04-19T22:45:08.572719+0000","last_became_peered":"2024-04-19T22:45:08.572719+0000","last_unstale":"2024-04-19T22:46:03.790436+0000","last_undegraded":"2024-04-19T22:46:03.790436+0000","last_fullsized":"2024-04-19T22:46:03.790436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:40:16.786026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"68'30","reported_seq":123,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775648+0000","last_change":"2024-04-19T22:45:10.799881+0000","last_active":"2024-04-19T22:48:03.775648+0000","last_peered":"2024-04-19T22:48:03.775648+0000","last_clean":"2024-04-19T22:48:03.775648+0000","last_became_active":"2024-04-19T22:45:10.799601+0000","last_became_peered":"2024-04-19T22:45:10.799601+0000","last_unstale":"2024-04-19T22:48:03.775648+0000","last_undegraded":"2024-04-19T22:48:03.775648+0000","last_fullsized":"2024-04-19T22:48:03.775648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:44:33.151939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789625+0000","last_change":"2024-04-19T22:45:13.174687+0000","last_active":"2024-04-19T22:46:03.789625+0000","last_peered":"2024-04-19T22:46:03.789625+0000","last_clean":"2024-04-19T22:46:03.789625+0000","last_became_active":"2024-04-19T22:45:13.174353+0000","last_became_peered":"2024-04-19T22:45:13.174353+0000","last_unstale":"2024-04-19T22:46:03.789625+0000","last_undegraded":"2024-04-19T22:46:03.789625+0000","last_fullsized":"2024-04-19T22:46:03.789625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:28:49.246240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.590002+0000","last_change":"2024-04-19T22:45:15.191752+0000","last_active":"2024-04-19T22:46:03.590002+0000","last_peered":"2024-04-19T22:46:03.590002+0000","last_clean":"2024-04-19T22:46:03.590002+0000","last_became_active":"2024-04-19T22:45:15.190921+0000","last_became_peered":"2024-04-19T22:45:15.190921+0000","last_unstale":"2024-04-19T22:46:03.590002+0000","last_undegraded":"2024-04-19T22:46:03.590002+0000","last_fullsized":"2024-04-19T22:46:03.590002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:19:01.101620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"61'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.594328+0000","last_change":"2024-04-19T22:45:08.574027+0000","last_active":"2024-04-19T22:46:03.594328+0000","last_peered":"2024-04-19T22:46:03.594328+0000","last_clean":"2024-04-19T22:46:03.594328+0000","last_became_active":"2024-04-19T22:45:08.573497+0000","last_became_peered":"2024-04-19T22:45:08.573497+0000","last_unstale":"2024-04-19T22:46:03.594328+0000","last_undegraded":"2024-04-19T22:46:03.594328+0000","last_fullsized":"2024-04-19T22:46:03.594328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:19:03.801274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"68'13","reported_seq":63,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726851+0000","last_change":"2024-04-19T22:45:10.802370+0000","last_active":"2024-04-19T22:46:03.726851+0000","last_peered":"2024-04-19T22:46:03.726851+0000","last_clean":"2024-04-19T22:46:03.726851+0000","last_became_active":"2024-04-19T22:45:10.801830+0000","last_became_peered":"2024-04-19T22:45:10.801830+0000","last_unstale":"2024-04-19T22:46:03.726851+0000","last_undegraded":"2024-04-19T22:46:03.726851+0000","last_fullsized":"2024-04-19T22:46:03.726851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:14:30.869808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"72'5","reported_seq":204,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:07.648151+0000","last_change":"2024-04-19T22:45:21.487345+0000","last_active":"2024-04-19T22:48:07.648151+0000","last_peered":"2024-04-19T22:48:07.648151+0000","last_clean":"2024-04-19T22:48:07.648151+0000","last_became_active":"2024-04-19T22:45:12.165190+0000","last_became_peered":"2024-04-19T22:45:12.165190+0000","last_unstale":"2024-04-19T22:48:07.648151+0000","last_undegraded":"2024-04-19T22:48:07.648151+0000","last_fullsized":"2024-04-19T22:48:07.648151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:43:34.571579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001858104,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589695+0000","last_change":"2024-04-19T22:45:13.191051+0000","last_active":"2024-04-19T22:46:03.589695+0000","last_peered":"2024-04-19T22:46:03.589695+0000","last_clean":"2024-04-19T22:46:03.589695+0000","last_became_active":"2024-04-19T22:45:13.189856+0000","last_became_peered":"2024-04-19T22:45:13.189856+0000","last_unstale":"2024-04-19T22:46:03.589695+0000","last_undegraded":"2024-04-19T22:46:03.589695+0000","last_fullsized":"2024-04-19T22:46:03.589695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:39:03.791901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788951+0000","last_change":"2024-04-19T22:45:15.541480+0000","last_active":"2024-04-19T22:46:03.788951+0000","last_peered":"2024-04-19T22:46:03.788951+0000","last_clean":"2024-04-19T22:46:03.788951+0000","last_became_active":"2024-04-19T22:45:15.540211+0000","last_became_peered":"2024-04-19T22:45:15.540211+0000","last_unstale":"2024-04-19T22:46:03.788951+0000","last_undegraded":"2024-04-19T22:46:03.788951+0000","last_fullsized":"2024-04-19T22:46:03.788951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:12:04.634444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790405+0000","last_change":"2024-04-19T22:45:08.579866+0000","last_active":"2024-04-19T22:46:03.790405+0000","last_peered":"2024-04-19T22:46:03.790405+0000","last_clean":"2024-04-19T22:46:03.790405+0000","last_became_active":"2024-04-19T22:45:08.579548+0000","last_became_peered":"2024-04-19T22:45:08.579548+0000","last_unstale":"2024-04-19T22:46:03.790405+0000","last_undegraded":"2024-04-19T22:46:03.790405+0000","last_fullsized":"2024-04-19T22:46:03.790405+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:13:18.547106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"68'12","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787758+0000","last_change":"2024-04-19T22:45:10.798642+0000","last_active":"2024-04-19T22:46:03.787758+0000","last_peered":"2024-04-19T22:46:03.787758+0000","last_clean":"2024-04-19T22:46:03.787758+0000","last_became_active":"2024-04-19T22:45:10.797811+0000","last_became_peered":"2024-04-19T22:45:10.797811+0000","last_unstale":"2024-04-19T22:46:03.787758+0000","last_undegraded":"2024-04-19T22:46:03.787758+0000","last_fullsized":"2024-04-19T22:46:03.787758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:02:04.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589915+0000","last_change":"2024-04-19T22:45:21.498838+0000","last_active":"2024-04-19T22:46:03.589915+0000","last_peered":"2024-04-19T22:46:03.589915+0000","last_clean":"2024-04-19T22:46:03.589915+0000","last_became_active":"2024-04-19T22:45:12.160572+0000","last_became_peered":"2024-04-19T22:45:12.160572+0000","last_unstale":"2024-04-19T22:46:03.589915+0000","last_undegraded":"2024-04-19T22:46:03.589915+0000","last_fullsized":"2024-04-19T22:46:03.589915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:10.760847+0000","last_clean_scrub_stamp":"2024-04-19T22:45:10.760847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:50:38.492771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010698560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.776343+0000","last_change":"2024-04-19T22:45:13.168548+0000","last_active":"2024-04-19T22:48:03.776343+0000","last_peered":"2024-04-19T22:48:03.776343+0000","last_clean":"2024-04-19T22:48:03.776343+0000","last_became_active":"2024-04-19T22:45:13.167708+0000","last_became_peered":"2024-04-19T22:45:13.167708+0000","last_unstale":"2024-04-19T22:48:03.776343+0000","last_undegraded":"2024-04-19T22:48:03.776343+0000","last_fullsized":"2024-04-19T22:48:03.776343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:14:51.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.726261+0000","last_change":"2024-04-19T22:45:15.533998+0000","last_active":"2024-04-19T22:46:03.726261+0000","last_peered":"2024-04-19T22:46:03.726261+0000","last_clean":"2024-04-19T22:46:03.726261+0000","last_became_active":"2024-04-19T22:45:15.533062+0000","last_became_peered":"2024-04-19T22:45:15.533062+0000","last_unstale":"2024-04-19T22:46:03.726261+0000","last_undegraded":"2024-04-19T22:46:03.726261+0000","last_fullsized":"2024-04-19T22:46:03.726261+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:25:59.762569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789106+0000","last_change":"2024-04-19T22:45:13.170009+0000","last_active":"2024-04-19T22:46:03.789106+0000","last_peered":"2024-04-19T22:46:03.789106+0000","last_clean":"2024-04-19T22:46:03.789106+0000","last_became_active":"2024-04-19T22:45:13.169682+0000","last_became_peered":"2024-04-19T22:45:13.169682+0000","last_unstale":"2024-04-19T22:46:03.789106+0000","last_undegraded":"2024-04-19T22:46:03.789106+0000","last_fullsized":"2024-04-19T22:46:03.789106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:51:46.962364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787823+0000","last_change":"2024-04-19T22:45:08.574434+0000","last_active":"2024-04-19T22:46:03.787823+0000","last_peered":"2024-04-19T22:46:03.787823+0000","last_clean":"2024-04-19T22:46:03.787823+0000","last_became_active":"2024-04-19T22:45:08.573862+0000","last_became_peered":"2024-04-19T22:45:08.573862+0000","last_unstale":"2024-04-19T22:46:03.787823+0000","last_undegraded":"2024-04-19T22:46:03.787823+0000","last_fullsized":"2024-04-19T22:46:03.787823+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:59:35.683110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"68'12","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589683+0000","last_change":"2024-04-19T22:45:10.806111+0000","last_active":"2024-04-19T22:46:03.589683+0000","last_peered":"2024-04-19T22:46:03.589683+0000","last_clean":"2024-04-19T22:46:03.589683+0000","last_became_active":"2024-04-19T22:45:10.805740+0000","last_became_peered":"2024-04-19T22:45:10.805740+0000","last_unstale":"2024-04-19T22:46:03.589683+0000","last_undegraded":"2024-04-19T22:46:03.589683+0000","last_fullsized":"2024-04-19T22:46:03.589683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:06:03.895450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788005+0000","last_change":"2024-04-19T22:45:15.218564+0000","last_active":"2024-04-19T22:46:03.788005+0000","last_peered":"2024-04-19T22:46:03.788005+0000","last_clean":"2024-04-19T22:46:03.788005+0000","last_became_active":"2024-04-19T22:45:15.217940+0000","last_became_peered":"2024-04-19T22:45:15.217940+0000","last_unstale":"2024-04-19T22:46:03.788005+0000","last_undegraded":"2024-04-19T22:46:03.788005+0000","last_fullsized":"2024-04-19T22:46:03.788005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:27:14.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'11","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775557+0000","last_change":"2024-04-19T22:45:13.172388+0000","last_active":"2024-04-19T22:48:03.775557+0000","last_peered":"2024-04-19T22:48:03.775557+0000","last_clean":"2024-04-19T22:48:03.775557+0000","last_became_active":"2024-04-19T22:45:13.171492+0000","last_became_peered":"2024-04-19T22:45:13.171492+0000","last_unstale":"2024-04-19T22:48:03.775557+0000","last_undegraded":"2024-04-19T22:48:03.775557+0000","last_fullsized":"2024-04-19T22:48:03.775557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:31:20.593984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591922+0000","last_change":"2024-04-19T22:45:08.584017+0000","last_active":"2024-04-19T22:46:03.591922+0000","last_peered":"2024-04-19T22:46:03.591922+0000","last_clean":"2024-04-19T22:46:03.591922+0000","last_became_active":"2024-04-19T22:45:08.583691+0000","last_became_peered":"2024-04-19T22:45:08.583691+0000","last_unstale":"2024-04-19T22:46:03.591922+0000","last_undegraded":"2024-04-19T22:46:03.591922+0000","last_fullsized":"2024-04-19T22:46:03.591922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:42:35.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725341+0000","last_change":"2024-04-19T22:45:10.803292+0000","last_active":"2024-04-19T22:46:03.725341+0000","last_peered":"2024-04-19T22:46:03.725341+0000","last_clean":"2024-04-19T22:46:03.725341+0000","last_became_active":"2024-04-19T22:45:10.802069+0000","last_became_peered":"2024-04-19T22:45:10.802069+0000","last_unstale":"2024-04-19T22:46:03.725341+0000","last_undegraded":"2024-04-19T22:46:03.725341+0000","last_fullsized":"2024-04-19T22:46:03.725341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:48:41.777106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.591131+0000","last_change":"2024-04-19T22:45:15.196735+0000","last_active":"2024-04-19T22:46:03.591131+0000","last_peered":"2024-04-19T22:46:03.591131+0000","last_clean":"2024-04-19T22:46:03.591131+0000","last_became_active":"2024-04-19T22:45:15.195807+0000","last_became_peered":"2024-04-19T22:45:15.195807+0000","last_unstale":"2024-04-19T22:46:03.591131+0000","last_undegraded":"2024-04-19T22:46:03.591131+0000","last_fullsized":"2024-04-19T22:46:03.591131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T23:20:58.410671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.775706+0000","last_change":"2024-04-19T22:45:13.184843+0000","last_active":"2024-04-19T22:48:03.775706+0000","last_peered":"2024-04-19T22:48:03.775706+0000","last_clean":"2024-04-19T22:48:03.775706+0000","last_became_active":"2024-04-19T22:45:13.184458+0000","last_became_peered":"2024-04-19T22:45:13.184458+0000","last_unstale":"2024-04-19T22:48:03.775706+0000","last_undegraded":"2024-04-19T22:48:03.775706+0000","last_fullsized":"2024-04-19T22:48:03.775706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:58:19.851672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593925+0000","last_change":"2024-04-19T22:45:08.586810+0000","last_active":"2024-04-19T22:46:03.593925+0000","last_peered":"2024-04-19T22:46:03.593925+0000","last_clean":"2024-04-19T22:46:03.593925+0000","last_became_active":"2024-04-19T22:45:08.586278+0000","last_became_peered":"2024-04-19T22:45:08.586278+0000","last_unstale":"2024-04-19T22:46:03.593925+0000","last_undegraded":"2024-04-19T22:46:03.593925+0000","last_fullsized":"2024-04-19T22:46:03.593925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:42:00.014417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"68'9","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.725886+0000","last_change":"2024-04-19T22:45:10.807672+0000","last_active":"2024-04-19T22:46:03.725886+0000","last_peered":"2024-04-19T22:46:03.725886+0000","last_clean":"2024-04-19T22:46:03.725886+0000","last_became_active":"2024-04-19T22:45:10.807278+0000","last_became_peered":"2024-04-19T22:45:10.807278+0000","last_unstale":"2024-04-19T22:46:03.725886+0000","last_undegraded":"2024-04-19T22:46:03.725886+0000","last_fullsized":"2024-04-19T22:46:03.725886+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:37:06.162764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589294+0000","last_change":"2024-04-19T22:45:15.197262+0000","last_active":"2024-04-19T22:46:03.589294+0000","last_peered":"2024-04-19T22:46:03.589294+0000","last_clean":"2024-04-19T22:46:03.589294+0000","last_became_active":"2024-04-19T22:45:15.195224+0000","last_became_peered":"2024-04-19T22:45:15.195224+0000","last_unstale":"2024-04-19T22:46:03.589294+0000","last_undegraded":"2024-04-19T22:46:03.589294+0000","last_fullsized":"2024-04-19T22:46:03.589294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:59:48.743587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593434+0000","last_change":"2024-04-19T22:45:13.184508+0000","last_active":"2024-04-19T22:46:03.593434+0000","last_peered":"2024-04-19T22:46:03.593434+0000","last_clean":"2024-04-19T22:46:03.593434+0000","last_became_active":"2024-04-19T22:45:13.183687+0000","last_became_peered":"2024-04-19T22:45:13.183687+0000","last_unstale":"2024-04-19T22:46:03.593434+0000","last_undegraded":"2024-04-19T22:46:03.593434+0000","last_fullsized":"2024-04-19T22:46:03.593434+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:27:02.178581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789059+0000","last_change":"2024-04-19T22:45:08.575952+0000","last_active":"2024-04-19T22:46:03.789059+0000","last_peered":"2024-04-19T22:46:03.789059+0000","last_clean":"2024-04-19T22:46:03.789059+0000","last_became_active":"2024-04-19T22:45:08.575647+0000","last_became_peered":"2024-04-19T22:45:08.575647+0000","last_unstale":"2024-04-19T22:46:03.789059+0000","last_undegraded":"2024-04-19T22:46:03.789059+0000","last_fullsized":"2024-04-19T22:46:03.789059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:43:05.305763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"68'19","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.789464+0000","last_change":"2024-04-19T22:45:10.800597+0000","last_active":"2024-04-19T22:46:03.789464+0000","last_peered":"2024-04-19T22:46:03.789464+0000","last_clean":"2024-04-19T22:46:03.789464+0000","last_became_active":"2024-04-19T22:45:10.795431+0000","last_became_peered":"2024-04-19T22:45:10.795431+0000","last_unstale":"2024-04-19T22:46:03.789464+0000","last_undegraded":"2024-04-19T22:46:03.789464+0000","last_fullsized":"2024-04-19T22:46:03.789464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:55:22.290003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787322+0000","last_change":"2024-04-19T22:45:15.212581+0000","last_active":"2024-04-19T22:46:03.787322+0000","last_peered":"2024-04-19T22:46:03.787322+0000","last_clean":"2024-04-19T22:46:03.787322+0000","last_became_active":"2024-04-19T22:45:15.211865+0000","last_became_peered":"2024-04-19T22:45:15.211865+0000","last_unstale":"2024-04-19T22:46:03.787322+0000","last_undegraded":"2024-04-19T22:46:03.787322+0000","last_fullsized":"2024-04-19T22:46:03.787322+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T22:53:41.075174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588812+0000","last_change":"2024-04-19T22:45:13.176955+0000","last_active":"2024-04-19T22:46:03.588812+0000","last_peered":"2024-04-19T22:46:03.588812+0000","last_clean":"2024-04-19T22:46:03.588812+0000","last_became_active":"2024-04-19T22:45:13.176166+0000","last_became_peered":"2024-04-19T22:45:13.176166+0000","last_unstale":"2024-04-19T22:46:03.588812+0000","last_undegraded":"2024-04-19T22:46:03.588812+0000","last_fullsized":"2024-04-19T22:46:03.588812+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:35:39.002914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589331+0000","last_change":"2024-04-19T22:45:08.583606+0000","last_active":"2024-04-19T22:46:03.589331+0000","last_peered":"2024-04-19T22:46:03.589331+0000","last_clean":"2024-04-19T22:46:03.589331+0000","last_became_active":"2024-04-19T22:45:08.583202+0000","last_became_peered":"2024-04-19T22:45:08.583202+0000","last_unstale":"2024-04-19T22:46:03.589331+0000","last_undegraded":"2024-04-19T22:46:03.589331+0000","last_fullsized":"2024-04-19T22:46:03.589331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:37:22.038275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"68'17","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.790649+0000","last_change":"2024-04-19T22:45:10.793858+0000","last_active":"2024-04-19T22:46:03.790649+0000","last_peered":"2024-04-19T22:46:03.790649+0000","last_clean":"2024-04-19T22:46:03.790649+0000","last_became_active":"2024-04-19T22:45:10.792368+0000","last_became_peered":"2024-04-19T22:45:10.792368+0000","last_unstale":"2024-04-19T22:46:03.790649+0000","last_undegraded":"2024-04-19T22:46:03.790649+0000","last_fullsized":"2024-04-19T22:46:03.790649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:36:50.659842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.786934+0000","last_change":"2024-04-19T22:45:15.216432+0000","last_active":"2024-04-19T22:46:03.786934+0000","last_peered":"2024-04-19T22:46:03.786934+0000","last_clean":"2024-04-19T22:46:03.786934+0000","last_became_active":"2024-04-19T22:45:15.215625+0000","last_became_peered":"2024-04-19T22:45:15.215625+0000","last_unstale":"2024-04-19T22:46:03.786934+0000","last_undegraded":"2024-04-19T22:46:03.786934+0000","last_fullsized":"2024-04-19T22:46:03.786934+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:53:38.076776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.588722+0000","last_change":"2024-04-19T22:45:13.182847+0000","last_active":"2024-04-19T22:46:03.588722+0000","last_peered":"2024-04-19T22:46:03.588722+0000","last_clean":"2024-04-19T22:46:03.588722+0000","last_became_active":"2024-04-19T22:45:13.181909+0000","last_became_peered":"2024-04-19T22:45:13.181909+0000","last_unstale":"2024-04-19T22:46:03.588722+0000","last_undegraded":"2024-04-19T22:46:03.588722+0000","last_fullsized":"2024-04-19T22:46:03.588722+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:10:32.825530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.593428+0000","last_change":"2024-04-19T22:45:08.586121+0000","last_active":"2024-04-19T22:46:03.593428+0000","last_peered":"2024-04-19T22:46:03.593428+0000","last_clean":"2024-04-19T22:46:03.593428+0000","last_became_active":"2024-04-19T22:45:08.585379+0000","last_became_peered":"2024-04-19T22:45:08.585379+0000","last_unstale":"2024-04-19T22:46:03.593428+0000","last_undegraded":"2024-04-19T22:46:03.593428+0000","last_fullsized":"2024-04-19T22:46:03.593428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:37:39.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"68'10","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.788023+0000","last_change":"2024-04-19T22:45:10.796749+0000","last_active":"2024-04-19T22:46:03.788023+0000","last_peered":"2024-04-19T22:46:03.788023+0000","last_clean":"2024-04-19T22:46:03.788023+0000","last_became_active":"2024-04-19T22:45:10.796444+0000","last_became_peered":"2024-04-19T22:45:10.796444+0000","last_unstale":"2024-04-19T22:46:03.788023+0000","last_undegraded":"2024-04-19T22:46:03.788023+0000","last_fullsized":"2024-04-19T22:46:03.788023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:48:22.903908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.787282+0000","last_change":"2024-04-19T22:45:15.534754+0000","last_active":"2024-04-19T22:46:03.787282+0000","last_peered":"2024-04-19T22:46:03.787282+0000","last_clean":"2024-04-19T22:46:03.787282+0000","last_became_active":"2024-04-19T22:45:15.533596+0000","last_became_peered":"2024-04-19T22:45:15.533596+0000","last_unstale":"2024-04-19T22:46:03.787282+0000","last_undegraded":"2024-04-19T22:46:03.787282+0000","last_fullsized":"2024-04-19T22:46:03.787282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:14.161709+0000","last_clean_scrub_stamp":"2024-04-19T22:45:14.161709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:50:54.428536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.589093+0000","last_change":"2024-04-19T22:45:08.583247+0000","last_active":"2024-04-19T22:46:03.589093+0000","last_peered":"2024-04-19T22:46:03.589093+0000","last_clean":"2024-04-19T22:46:03.589093+0000","last_became_active":"2024-04-19T22:45:08.582063+0000","last_became_peered":"2024-04-19T22:45:08.582063+0000","last_unstale":"2024-04-19T22:46:03.589093+0000","last_undegraded":"2024-04-19T22:46:03.589093+0000","last_fullsized":"2024-04-19T22:46:03.589093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:07.542935+0000","last_clean_scrub_stamp":"2024-04-19T22:45:07.542935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:58:01.352583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"68'15","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:46:03.791329+0000","last_change":"2024-04-19T22:45:10.791544+0000","last_active":"2024-04-19T22:46:03.791329+0000","last_peered":"2024-04-19T22:46:03.791329+0000","last_clean":"2024-04-19T22:46:03.791329+0000","last_became_active":"2024-04-19T22:45:10.789207+0000","last_became_peered":"2024-04-19T22:45:10.789207+0000","last_unstale":"2024-04-19T22:46:03.791329+0000","last_undegraded":"2024-04-19T22:46:03.791329+0000","last_fullsized":"2024-04-19T22:46:03.791329+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:09.558300+0000","last_clean_scrub_stamp":"2024-04-19T22:45:09.558300+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T00:46:31.278050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"68'11","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-19T22:48:03.776022+0000","last_change":"2024-04-19T22:45:13.177223+0000","last_active":"2024-04-19T22:48:03.776022+0000","last_peered":"2024-04-19T22:48:03.776022+0000","last_clean":"2024-04-19T22:48:03.776022+0000","last_became_active":"2024-04-19T22:45:13.176434+0000","last_became_peered":"2024-04-19T22:45:13.176434+0000","last_unstale":"2024-04-19T22:48:03.776022+0000","last_undegraded":"2024-04-19T22:48:03.776022+0000","last_fullsized":"2024-04-19T22:48:03.776022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T22:45:12.133543+0000","last_clean_scrub_stamp":"2024-04-19T22:45:12.133543+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:25:47.497170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201326,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36672,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708480,"statfs":{"total":95995035648,"available":95957483520,"internally_reserved":0,"allocated":1368064,"data_stored":888347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462968,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32480,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712672,"statfs":{"total":95995035648,"available":95961776128,"internally_reserved":0,"allocated":1335296,"data_stored":886012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717392,"statfs":{"total":95995035648,"available":95966609408,"internally_reserved":0,"allocated":757760,"data_stored":296398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28336,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716816,"statfs":{"total":95995035648,"available":95966019584,"internally_reserved":0,"allocated":1351680,"data_stored":887090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717400,"statfs":{"total":95995035648,"available":95966617600,"internally_reserved":0,"allocated":749568,"data_stored":297553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149784,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27744,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717408,"statfs":{"total":95995035648,"available":95966625792,"internally_reserved":0,"allocated":741376,"data_stored":296031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986253,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717372,"statfs":{"total":95995035648,"available":95966588928,"internally_reserved":0,"allocated":778240,"data_stored":296576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717404,"statfs":{"total":95995035648,"available":95966621696,"internally_reserved":0,"allocated":745472,"data_stored":297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T22:48:12.874 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-19T22:48:12.874 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T22:48:12.874 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-19T22:48:12.875 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d0bf63dd179c05751e4be49477389aa290c73089 shell --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 -- ceph health --format=json 2024-04-19T22:48:13.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:12 smithi113 bash[21528]: cluster 2024-04-19T22:48:11.664000+0000 mgr.y (mgr.24389) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:13.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:12 smithi113 bash[21528]: audit 2024-04-19T22:48:12.072715+0000 mgr.y (mgr.24389) 114 : audit 0 from='client.14691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:13.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:12 smithi113 bash[28910]: cluster 2024-04-19T22:48:11.664000+0000 mgr.y (mgr.24389) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:13.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:12 smithi113 bash[28910]: audit 2024-04-19T22:48:12.072715+0000 mgr.y (mgr.24389) 114 : audit 0 from='client.14691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:13.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:12 smithi178 bash[23441]: cluster 2024-04-19T22:48:11.664000+0000 mgr.y (mgr.24389) 113 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:13.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:12 smithi178 bash[23441]: audit 2024-04-19T22:48:12.072715+0000 mgr.y (mgr.24389) 114 : audit 0 from='client.14691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-19T22:48:15.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:14 smithi113 bash[21528]: cluster 2024-04-19T22:48:13.664624+0000 mgr.y (mgr.24389) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:15.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:14 smithi113 bash[28910]: cluster 2024-04-19T22:48:13.664624+0000 mgr.y (mgr.24389) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:15.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:15.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:14 smithi178 bash[23441]: cluster 2024-04-19T22:48:13.664624+0000 mgr.y (mgr.24389) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:16.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:15 smithi178 bash[23441]: audit 2024-04-19T22:48:14.704843+0000 mgr.y (mgr.24389) 116 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:16.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:15 smithi113 bash[21528]: audit 2024-04-19T22:48:14.704843+0000 mgr.y (mgr.24389) 116 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:16.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:15 smithi113 bash[28910]: audit 2024-04-19T22:48:14.704843+0000 mgr.y (mgr.24389) 116 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:17.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:16 smithi178 bash[23441]: cluster 2024-04-19T22:48:15.665558+0000 mgr.y (mgr.24389) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:17.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:16 smithi113 bash[21528]: cluster 2024-04-19T22:48:15.665558+0000 mgr.y (mgr.24389) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:17.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:16 smithi113 bash[28910]: cluster 2024-04-19T22:48:15.665558+0000 mgr.y (mgr.24389) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:17.690 INFO:teuthology.orchestra.run.smithi113.stderr:Inferring config /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/mon.a/config 2024-04-19T22:48:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:19.031 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:18 smithi113 bash[28910]: cluster 2024-04-19T22:48:17.666208+0000 mgr.y (mgr.24389) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:19.031 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:18 smithi113 bash[21528]: cluster 2024-04-19T22:48:17.666208+0000 mgr.y (mgr.24389) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:19.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:18 smithi178 bash[23441]: cluster 2024-04-19T22:48:17.666208+0000 mgr.y (mgr.24389) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:20.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:19 smithi113 bash[28910]: audit 2024-04-19T22:48:18.973420+0000 mon.a (mon.0) 905 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:20.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:19 smithi113 bash[21528]: audit 2024-04-19T22:48:18.973420+0000 mon.a (mon.0) 905 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:20.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:19 smithi178 bash[23441]: audit 2024-04-19T22:48:18.973420+0000 mon.a (mon.0) 905 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/1282099043 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 msgr2=0x7f03e8108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- 172.21.15.113:0/1282099043 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e8108730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03d80098f0 tx=0x7f03d8009c00 comp rx=0 tx=0).stop 2024-04-19T22:48:20.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/1282099043 shutdown_connections 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- 172.21.15.113:0/1282099043 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e8102d70 0x7f03e810f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- 172.21.15.113:0/1282099043 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e8108730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- 172.21.15.113:0/1282099043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e81023b0 0x7f03e8102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/1282099043 >> 172.21.15.113:0/1282099043 conn(0x7f03e8079390 msgr2=0x7f03e80797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/1282099043 shutdown_connections 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/1282099043 wait complete. 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 Processor -- start 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- start start 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 0x7f03e8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:20.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8111ca0 con 0x7f03e81023b0 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8111b20 con 0x7f03e8102d70 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f03e8111e20 con 0x7f03e8108350 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53982/0 (socket says 172.21.15.113:53982) 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 -- 172.21.15.113:0/789106489 learned_addr learned my addr 172.21.15.113:0/789106489 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03eed6f700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03edd6d700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 0x7f03e8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 -- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 msgr2=0x7f03e819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 -- 172.21.15.113:0/789106489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 msgr2=0x7f03e8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 0x7f03e8198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 -- 172.21.15.113:0/789106489 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e819d160 con 0x7f03e81023b0 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03edd6d700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 0x7f03e8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T22:48:20.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03ee56e700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03d800fb40 tx=0x7f03d800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8027070 con 0x7f03e81023b0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f03d800b560 con 0x7f03e81023b0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e819d3f0 con 0x7f03e81023b0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8004ac0 con 0x7f03e81023b0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.691+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e81a4cd0 con 0x7f03e81023b0 2024-04-19T22:48:20.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e804ff50 con 0x7f03e81023b0 2024-04-19T22:48:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f03d802a070 con 0x7f03e81023b0 2024-04-19T22:48:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03e77fe700 1 --2- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 0x7f03d0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T22:48:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6201+0+0 (secure 0 0 0) 0x7f03d808eba0 con 0x7f03e81023b0 2024-04-19T22:48:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03edd6d700 1 --2- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 0x7f03d0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T22:48:20.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.695+0000 7f03edd6d700 1 --2- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 0x7f03d0070560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03e81127d0 tx=0x7f03dc008040 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T22:48:20.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.699+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f03d8013030 con 0x7f03e81023b0 2024-04-19T22:48:20.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.955+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03e81a4ea0 con 0x7f03e81023b0 2024-04-19T22:48:20.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.955+0000 7f03e77fe700 1 -- 172.21.15.113:0/789106489 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f03d805c4e0 con 0x7f03e81023b0 2024-04-19T22:48:20.956 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-19T22:48:20.957 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 msgr2=0x7f03d0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 0x7f03d0070560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03e81127d0 tx=0x7f03dc008040 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 msgr2=0x7f03e8198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03d800fb40 tx=0x7f03d800fb70 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 shutdown_connections 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03d006e0a0 0x7f03d0070560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f03e8108350 0x7f03e819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f03e81023b0 0x7f03e8198150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 --2- 172.21.15.113:0/789106489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e8102d70 0x7f03e8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 >> 172.21.15.113:0/789106489 conn(0x7f03e8079390 msgr2=0x7f03e8105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 shutdown_connections 2024-04-19T22:48:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-19T22:48:20.959+0000 7f03f07d2700 1 -- 172.21.15.113:0/789106489 wait complete. 2024-04-19T22:48:21.181 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:20 smithi113 bash[28910]: cluster 2024-04-19T22:48:19.667039+0000 mgr.y (mgr.24389) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:21.181 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:20 smithi113 bash[21528]: cluster 2024-04-19T22:48:19.667039+0000 mgr.y (mgr.24389) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:21.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:20 smithi178 bash[23441]: cluster 2024-04-19T22:48:19.667039+0000 mgr.y (mgr.24389) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:21.709 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-19T22:48:21.709 INFO:tasks.cephadm:Setup complete, yielding 2024-04-19T22:48:21.710 INFO:teuthology.run_tasks:Running task workunit... 2024-04-19T22:48:21.724 INFO:tasks.workunit:Pulling workunits from ref e02d68a84525e0fa855f080a47dd96b350c21c42 2024-04-19T22:48:21.724 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-19T22:48:21.725 DEBUG:teuthology.orchestra.run.smithi113:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-19T22:48:21.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T22:48:21.732 INFO:teuthology.orchestra.run.smithi113.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-19T22:48:21.732 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-19T22:48:21.779 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-19T22:48:21.779 DEBUG:teuthology.orchestra.run.smithi113:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-19T22:48:21.827 INFO:tasks.workunit:timeout=3h 2024-04-19T22:48:21.828 INFO:tasks.workunit:cleanup=True 2024-04-19T22:48:21.828 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e02d68a84525e0fa855f080a47dd96b350c21c42 2024-04-19T22:48:21.878 INFO:tasks.workunit.client.0.smithi113.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-19T22:48:22.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:21 smithi113 bash[21528]: audit 2024-04-19T22:48:20.960971+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.113:0/789106489' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-19T22:48:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:21 smithi113 bash[28910]: audit 2024-04-19T22:48:20.960971+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.113:0/789106489' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-19T22:48:22.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:21 smithi178 bash[23441]: audit 2024-04-19T22:48:20.960971+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.113:0/789106489' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-19T22:48:23.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:22 smithi113 bash[21528]: cluster 2024-04-19T22:48:21.667828+0000 mgr.y (mgr.24389) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:23.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:22 smithi113 bash[28910]: cluster 2024-04-19T22:48:21.667828+0000 mgr.y (mgr.24389) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:23.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:22 smithi178 bash[23441]: cluster 2024-04-19T22:48:21.667828+0000 mgr.y (mgr.24389) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:25.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:24 smithi178 bash[23441]: cluster 2024-04-19T22:48:23.668492+0000 mgr.y (mgr.24389) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:48:25.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:24 smithi113 bash[28910]: cluster 2024-04-19T22:48:23.668492+0000 mgr.y (mgr.24389) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:48:25.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:24 smithi113 bash[21528]: cluster 2024-04-19T22:48:23.668492+0000 mgr.y (mgr.24389) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:48:26.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:25 smithi113 bash[28910]: audit 2024-04-19T22:48:24.716144+0000 mgr.y (mgr.24389) 122 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:26.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:25 smithi113 bash[21528]: audit 2024-04-19T22:48:24.716144+0000 mgr.y (mgr.24389) 122 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:26.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:25 smithi178 bash[23441]: audit 2024-04-19T22:48:24.716144+0000 mgr.y (mgr.24389) 122 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:27.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:26 smithi113 bash[28910]: cluster 2024-04-19T22:48:25.670355+0000 mgr.y (mgr.24389) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:27.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:26 smithi113 bash[21528]: cluster 2024-04-19T22:48:25.670355+0000 mgr.y (mgr.24389) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:27.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:26 smithi178 bash[23441]: cluster 2024-04-19T22:48:25.670355+0000 mgr.y (mgr.24389) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:29.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:28 smithi113 bash[28910]: cluster 2024-04-19T22:48:27.671213+0000 mgr.y (mgr.24389) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:29.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:28 smithi113 bash[21528]: cluster 2024-04-19T22:48:27.671213+0000 mgr.y (mgr.24389) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:29.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:28 smithi178 bash[23441]: cluster 2024-04-19T22:48:27.671213+0000 mgr.y (mgr.24389) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:31.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:30 smithi113 bash[28910]: cluster 2024-04-19T22:48:29.672703+0000 mgr.y (mgr.24389) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:31.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:30 smithi113 bash[21528]: cluster 2024-04-19T22:48:29.672703+0000 mgr.y (mgr.24389) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:31.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:30 smithi178 bash[23441]: cluster 2024-04-19T22:48:29.672703+0000 mgr.y (mgr.24389) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:32.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:31 smithi113 bash[28910]: audit 2024-04-19T22:48:31.532954+0000 mon.a (mon.0) 907 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:48:32.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:31 smithi113 bash[21528]: audit 2024-04-19T22:48:31.532954+0000 mon.a (mon.0) 907 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:48:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:31 smithi178 bash[23441]: audit 2024-04-19T22:48:31.532954+0000 mon.a (mon.0) 907 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:48:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[28910]: cluster 2024-04-19T22:48:31.673354+0000 mgr.y (mgr.24389) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:33.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[28910]: audit 2024-04-19T22:48:32.328482+0000 mon.a (mon.0) 908 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[28910]: audit 2024-04-19T22:48:32.330005+0000 mon.a (mon.0) 909 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[28910]: audit 2024-04-19T22:48:32.341478+0000 mon.a (mon.0) 910 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[21528]: cluster 2024-04-19T22:48:31.673354+0000 mgr.y (mgr.24389) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[21528]: audit 2024-04-19T22:48:32.328482+0000 mon.a (mon.0) 908 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[21528]: audit 2024-04-19T22:48:32.330005+0000 mon.a (mon.0) 909 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:48:33.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:32 smithi113 bash[21528]: audit 2024-04-19T22:48:32.341478+0000 mon.a (mon.0) 910 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:48:33.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:32 smithi178 bash[23441]: cluster 2024-04-19T22:48:31.673354+0000 mgr.y (mgr.24389) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:33.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:32 smithi178 bash[23441]: audit 2024-04-19T22:48:32.328482+0000 mon.a (mon.0) 908 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:48:33.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:32 smithi178 bash[23441]: audit 2024-04-19T22:48:32.330005+0000 mon.a (mon.0) 909 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:48:33.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:32 smithi178 bash[23441]: audit 2024-04-19T22:48:32.341478+0000 mon.a (mon.0) 910 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:48:35.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:35.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:34 smithi178 bash[23441]: cluster 2024-04-19T22:48:33.674060+0000 mgr.y (mgr.24389) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:35.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:34 smithi178 bash[23441]: audit 2024-04-19T22:48:34.004298+0000 mon.a (mon.0) 911 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:35.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:34 smithi113 bash[28910]: cluster 2024-04-19T22:48:33.674060+0000 mgr.y (mgr.24389) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:35.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:34 smithi113 bash[28910]: audit 2024-04-19T22:48:34.004298+0000 mon.a (mon.0) 911 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:35.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:34 smithi113 bash[21528]: cluster 2024-04-19T22:48:33.674060+0000 mgr.y (mgr.24389) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:35.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:34 smithi113 bash[21528]: audit 2024-04-19T22:48:34.004298+0000 mon.a (mon.0) 911 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:36.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:35 smithi113 bash[28910]: audit 2024-04-19T22:48:34.721515+0000 mgr.y (mgr.24389) 128 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:36.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:35 smithi113 bash[21528]: audit 2024-04-19T22:48:34.721515+0000 mgr.y (mgr.24389) 128 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:36.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:35 smithi178 bash[23441]: audit 2024-04-19T22:48:34.721515+0000 mgr.y (mgr.24389) 128 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:37.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:36 smithi113 bash[21528]: cluster 2024-04-19T22:48:35.675501+0000 mgr.y (mgr.24389) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:37.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:36 smithi113 bash[28910]: cluster 2024-04-19T22:48:35.675501+0000 mgr.y (mgr.24389) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:37.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:36 smithi178 bash[23441]: cluster 2024-04-19T22:48:35.675501+0000 mgr.y (mgr.24389) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:39.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:38 smithi113 bash[28910]: cluster 2024-04-19T22:48:37.676196+0000 mgr.y (mgr.24389) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:39.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:38 smithi113 bash[21528]: cluster 2024-04-19T22:48:37.676196+0000 mgr.y (mgr.24389) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:39.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:38 smithi178 bash[23441]: cluster 2024-04-19T22:48:37.676196+0000 mgr.y (mgr.24389) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:41.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:40 smithi113 bash[28910]: cluster 2024-04-19T22:48:39.677605+0000 mgr.y (mgr.24389) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:41.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:40 smithi113 bash[21528]: cluster 2024-04-19T22:48:39.677605+0000 mgr.y (mgr.24389) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:41.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:40 smithi178 bash[23441]: cluster 2024-04-19T22:48:39.677605+0000 mgr.y (mgr.24389) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:43.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:42 smithi113 bash[28910]: cluster 2024-04-19T22:48:41.678285+0000 mgr.y (mgr.24389) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:43.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:42 smithi113 bash[21528]: cluster 2024-04-19T22:48:41.678285+0000 mgr.y (mgr.24389) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:43.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:42 smithi178 bash[23441]: cluster 2024-04-19T22:48:41.678285+0000 mgr.y (mgr.24389) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:45.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:44 smithi178 bash[23441]: cluster 2024-04-19T22:48:43.678904+0000 mgr.y (mgr.24389) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:45.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:45.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:44 smithi113 bash[28910]: cluster 2024-04-19T22:48:43.678904+0000 mgr.y (mgr.24389) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:45.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:44 smithi113 bash[21528]: cluster 2024-04-19T22:48:43.678904+0000 mgr.y (mgr.24389) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:46.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:45 smithi113 bash[21528]: audit 2024-04-19T22:48:44.733022+0000 mgr.y (mgr.24389) 134 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:46.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:45 smithi113 bash[28910]: audit 2024-04-19T22:48:44.733022+0000 mgr.y (mgr.24389) 134 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:46.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:45 smithi178 bash[23441]: audit 2024-04-19T22:48:44.733022+0000 mgr.y (mgr.24389) 134 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:47.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:46 smithi113 bash[28910]: cluster 2024-04-19T22:48:45.680325+0000 mgr.y (mgr.24389) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:47.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:46 smithi113 bash[21528]: cluster 2024-04-19T22:48:45.680325+0000 mgr.y (mgr.24389) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:47.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:46 smithi178 bash[23441]: cluster 2024-04-19T22:48:45.680325+0000 mgr.y (mgr.24389) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:49.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:48 smithi113 bash[21528]: cluster 2024-04-19T22:48:47.680992+0000 mgr.y (mgr.24389) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:49.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:48 smithi113 bash[28910]: cluster 2024-04-19T22:48:47.680992+0000 mgr.y (mgr.24389) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:49.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:48 smithi178 bash[23441]: cluster 2024-04-19T22:48:47.680992+0000 mgr.y (mgr.24389) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:50.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:49 smithi113 bash[21528]: audit 2024-04-19T22:48:49.034901+0000 mon.a (mon.0) 912 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:50.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:49 smithi113 bash[28910]: audit 2024-04-19T22:48:49.034901+0000 mon.a (mon.0) 912 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:50.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:49 smithi178 bash[23441]: audit 2024-04-19T22:48:49.034901+0000 mon.a (mon.0) 912 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:48:51.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:50 smithi113 bash[21528]: cluster 2024-04-19T22:48:49.682446+0000 mgr.y (mgr.24389) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:51.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:50 smithi113 bash[28910]: cluster 2024-04-19T22:48:49.682446+0000 mgr.y (mgr.24389) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:51.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:50 smithi178 bash[23441]: cluster 2024-04-19T22:48:49.682446+0000 mgr.y (mgr.24389) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:53.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:52 smithi113 bash[28910]: cluster 2024-04-19T22:48:51.682927+0000 mgr.y (mgr.24389) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:53.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:52 smithi113 bash[21528]: cluster 2024-04-19T22:48:51.682927+0000 mgr.y (mgr.24389) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:53.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:52 smithi178 bash[23441]: cluster 2024-04-19T22:48:51.682927+0000 mgr.y (mgr.24389) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:55.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:48:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:48:55.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:54 smithi178 bash[23441]: cluster 2024-04-19T22:48:53.683544+0000 mgr.y (mgr.24389) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:55.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:54 smithi113 bash[28910]: cluster 2024-04-19T22:48:53.683544+0000 mgr.y (mgr.24389) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:55.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:54 smithi113 bash[21528]: cluster 2024-04-19T22:48:53.683544+0000 mgr.y (mgr.24389) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:56.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:55 smithi113 bash[21528]: audit 2024-04-19T22:48:54.744495+0000 mgr.y (mgr.24389) 140 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:56.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:55 smithi113 bash[28910]: audit 2024-04-19T22:48:54.744495+0000 mgr.y (mgr.24389) 140 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:56.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:55 smithi178 bash[23441]: audit 2024-04-19T22:48:54.744495+0000 mgr.y (mgr.24389) 140 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:48:57.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:56 smithi113 bash[28910]: cluster 2024-04-19T22:48:55.684883+0000 mgr.y (mgr.24389) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:57.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:56 smithi113 bash[21528]: cluster 2024-04-19T22:48:55.684883+0000 mgr.y (mgr.24389) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:57.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:56 smithi178 bash[23441]: cluster 2024-04-19T22:48:55.684883+0000 mgr.y (mgr.24389) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:48:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:48:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:48:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:48:59.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:48:58 smithi113 bash[21528]: cluster 2024-04-19T22:48:57.685611+0000 mgr.y (mgr.24389) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:59.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:48:58 smithi113 bash[28910]: cluster 2024-04-19T22:48:57.685611+0000 mgr.y (mgr.24389) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:48:59.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:48:58 smithi178 bash[23441]: cluster 2024-04-19T22:48:57.685611+0000 mgr.y (mgr.24389) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:01.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:00 smithi113 bash[28910]: cluster 2024-04-19T22:48:59.687131+0000 mgr.y (mgr.24389) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:01.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:00 smithi113 bash[21528]: cluster 2024-04-19T22:48:59.687131+0000 mgr.y (mgr.24389) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:01.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:00 smithi178 bash[23441]: cluster 2024-04-19T22:48:59.687131+0000 mgr.y (mgr.24389) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:03.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:02 smithi113 bash[28910]: cluster 2024-04-19T22:49:01.687882+0000 mgr.y (mgr.24389) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:03.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:02 smithi113 bash[21528]: cluster 2024-04-19T22:49:01.687882+0000 mgr.y (mgr.24389) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:03.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:02 smithi178 bash[23441]: cluster 2024-04-19T22:49:01.687882+0000 mgr.y (mgr.24389) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:05.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:05.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:04 smithi178 bash[23441]: cluster 2024-04-19T22:49:03.688577+0000 mgr.y (mgr.24389) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:05.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:04 smithi178 bash[23441]: audit 2024-04-19T22:49:04.064256+0000 mon.a (mon.0) 913 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:05.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:04 smithi113 bash[21528]: cluster 2024-04-19T22:49:03.688577+0000 mgr.y (mgr.24389) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:05.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:04 smithi113 bash[21528]: audit 2024-04-19T22:49:04.064256+0000 mon.a (mon.0) 913 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:05.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:04 smithi113 bash[28910]: cluster 2024-04-19T22:49:03.688577+0000 mgr.y (mgr.24389) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:05.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:04 smithi113 bash[28910]: audit 2024-04-19T22:49:04.064256+0000 mon.a (mon.0) 913 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:06.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:05 smithi113 bash[21528]: audit 2024-04-19T22:49:04.753447+0000 mgr.y (mgr.24389) 146 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:06.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:05 smithi113 bash[28910]: audit 2024-04-19T22:49:04.753447+0000 mgr.y (mgr.24389) 146 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:06.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:05 smithi178 bash[23441]: audit 2024-04-19T22:49:04.753447+0000 mgr.y (mgr.24389) 146 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:07.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:06 smithi113 bash[21528]: cluster 2024-04-19T22:49:05.689568+0000 mgr.y (mgr.24389) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:07.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:06 smithi113 bash[28910]: cluster 2024-04-19T22:49:05.689568+0000 mgr.y (mgr.24389) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:07.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:06 smithi178 bash[23441]: cluster 2024-04-19T22:49:05.689568+0000 mgr.y (mgr.24389) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:07.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:09.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:08 smithi113 bash[21528]: cluster 2024-04-19T22:49:07.690155+0000 mgr.y (mgr.24389) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:09.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:08 smithi113 bash[28910]: cluster 2024-04-19T22:49:07.690155+0000 mgr.y (mgr.24389) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:09.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:08 smithi178 bash[23441]: cluster 2024-04-19T22:49:07.690155+0000 mgr.y (mgr.24389) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:11.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:10 smithi113 bash[28910]: cluster 2024-04-19T22:49:09.690979+0000 mgr.y (mgr.24389) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:11.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:10 smithi113 bash[21528]: cluster 2024-04-19T22:49:09.690979+0000 mgr.y (mgr.24389) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:11.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:10 smithi178 bash[23441]: cluster 2024-04-19T22:49:09.690979+0000 mgr.y (mgr.24389) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:13.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:12 smithi113 bash[21528]: cluster 2024-04-19T22:49:11.691387+0000 mgr.y (mgr.24389) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:13.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:12 smithi113 bash[28910]: cluster 2024-04-19T22:49:11.691387+0000 mgr.y (mgr.24389) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:13.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:12 smithi178 bash[23441]: cluster 2024-04-19T22:49:11.691387+0000 mgr.y (mgr.24389) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:15.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:15.083 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:14 smithi178 bash[23441]: cluster 2024-04-19T22:49:13.691800+0000 mgr.y (mgr.24389) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:15.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:14 smithi113 bash[28910]: cluster 2024-04-19T22:49:13.691800+0000 mgr.y (mgr.24389) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:15.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:14 smithi113 bash[21528]: cluster 2024-04-19T22:49:13.691800+0000 mgr.y (mgr.24389) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:16.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:15 smithi113 bash[28910]: audit 2024-04-19T22:49:14.764777+0000 mgr.y (mgr.24389) 152 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:16.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:15 smithi113 bash[21528]: audit 2024-04-19T22:49:14.764777+0000 mgr.y (mgr.24389) 152 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:16.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:15 smithi178 bash[23441]: audit 2024-04-19T22:49:14.764777+0000 mgr.y (mgr.24389) 152 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:17.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:16 smithi113 bash[28910]: cluster 2024-04-19T22:49:15.692557+0000 mgr.y (mgr.24389) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:17.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:16 smithi113 bash[21528]: cluster 2024-04-19T22:49:15.692557+0000 mgr.y (mgr.24389) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:17.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:16 smithi178 bash[23441]: cluster 2024-04-19T22:49:15.692557+0000 mgr.y (mgr.24389) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:19.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:18 smithi113 bash[28910]: cluster 2024-04-19T22:49:17.692949+0000 mgr.y (mgr.24389) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:19.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:18 smithi113 bash[21528]: cluster 2024-04-19T22:49:17.692949+0000 mgr.y (mgr.24389) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:18 smithi178 bash[23441]: cluster 2024-04-19T22:49:17.692949+0000 mgr.y (mgr.24389) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:20.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:20 smithi113 bash[28910]: audit 2024-04-19T22:49:19.085093+0000 mon.a (mon.0) 914 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:20.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:20 smithi113 bash[21528]: audit 2024-04-19T22:49:19.085093+0000 mon.a (mon.0) 914 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:20.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:20 smithi178 bash[23441]: audit 2024-04-19T22:49:19.085093+0000 mon.a (mon.0) 914 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:21.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:21 smithi113 bash[28910]: cluster 2024-04-19T22:49:19.693700+0000 mgr.y (mgr.24389) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:21.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:21 smithi113 bash[21528]: cluster 2024-04-19T22:49:19.693700+0000 mgr.y (mgr.24389) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:21.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:21 smithi178 bash[23441]: cluster 2024-04-19T22:49:19.693700+0000 mgr.y (mgr.24389) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:23.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:23 smithi113 bash[28910]: cluster 2024-04-19T22:49:21.694106+0000 mgr.y (mgr.24389) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:23.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:23 smithi113 bash[21528]: cluster 2024-04-19T22:49:21.694106+0000 mgr.y (mgr.24389) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:23.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:23 smithi178 bash[23441]: cluster 2024-04-19T22:49:21.694106+0000 mgr.y (mgr.24389) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:25 smithi178 bash[23441]: cluster 2024-04-19T22:49:23.694529+0000 mgr.y (mgr.24389) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:25.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:25.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:25 smithi113 bash[28910]: cluster 2024-04-19T22:49:23.694529+0000 mgr.y (mgr.24389) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:25.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:25 smithi113 bash[21528]: cluster 2024-04-19T22:49:23.694529+0000 mgr.y (mgr.24389) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:26.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:26 smithi113 bash[21528]: audit 2024-04-19T22:49:24.775956+0000 mgr.y (mgr.24389) 158 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:26.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:26 smithi113 bash[28910]: audit 2024-04-19T22:49:24.775956+0000 mgr.y (mgr.24389) 158 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:26.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:26 smithi178 bash[23441]: audit 2024-04-19T22:49:24.775956+0000 mgr.y (mgr.24389) 158 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:27.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:27 smithi113 bash[21528]: cluster 2024-04-19T22:49:25.695284+0000 mgr.y (mgr.24389) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:27.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:27 smithi113 bash[28910]: cluster 2024-04-19T22:49:25.695284+0000 mgr.y (mgr.24389) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:27.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:27 smithi178 bash[23441]: cluster 2024-04-19T22:49:25.695284+0000 mgr.y (mgr.24389) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:28.169 INFO:tasks.workunit.client.0.smithi113.stderr:Note: switching to 'e02d68a84525e0fa855f080a47dd96b350c21c42'. 2024-04-19T22:49:28.169 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.169 INFO:tasks.workunit.client.0.smithi113.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:state without impacting any branches by switching back to a branch. 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: git switch -c 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:Or undo this operation with: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: git switch - 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.170 INFO:tasks.workunit.client.0.smithi113.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-19T22:49:28.171 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-19T22:49:28.171 INFO:tasks.workunit.client.0.smithi113.stderr:HEAD is now at e02d68a8452 Merge pull request #56992 from rosinL/wip-65577-squid 2024-04-19T22:49:28.174 DEBUG:teuthology.orchestra.run.smithi113:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-19T22:49:28.223 INFO:tasks.workunit.client.0.smithi113.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-19T22:49:28.227 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T22:49:28.227 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-19T22:49:28.994 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-19T22:49:29.068 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-19T22:49:29.122 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T22:49:29.123 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T22:49:29.123 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-19T22:49:29.165 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T22:49:29.169 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-19T22:49:29.169 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-19T22:49:29.215 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-19T22:49:29.216 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-19T22:49:29.216 DEBUG:teuthology.orchestra.run.smithi113:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e02d68a84525e0fa855f080a47dd96b350c21c42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ parallel=1 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' '' = --serial ']' 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ crimson=0 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' '' = --crimson ']' 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ color= 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -t 1 ']' 2024-04-19T22:49:29.266 INFO:tasks.workunit.client.0.smithi113.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-19T22:49:29.267 INFO:tasks.workunit.client.0.smithi113.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-19T22:49:29.267 INFO:tasks.workunit.client.0.smithi113.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:+ declare -A pids 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_aio 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_aio' 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_aio 2024-04-19T22:49:29.268 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.270 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_aio 2024-04-19T22:49:29.270 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63828 2024-04-19T22:49:29.270 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_aio on pid 63828' 2024-04-19T22:49:29.270 INFO:tasks.workunit.client.0.smithi113.stdout:test api_aio on pid 63828 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63828 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_aio_pp 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_aio_pp' 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_aio_pp 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.272 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-04-19T22:49:29.273 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_aio.log 2024-04-19T22:49:29.273 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_aio: /' 2024-04-19T22:49:29.273 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_aio_pp 2024-04-19T22:49:29.273 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63836 2024-04-19T22:49:29.274 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_aio_pp on pid 63836' 2024-04-19T22:49:29.274 INFO:tasks.workunit.client.0.smithi113.stdout:test api_aio_pp on pid 63836 2024-04-19T22:49:29.275 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63836 2024-04-19T22:49:29.275 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.275 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.275 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_io 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_io' 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_io 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_aio_pp: /' 2024-04-19T22:49:29.276 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_io 2024-04-19T22:49:29.277 INFO:tasks.workunit.client.0.smithi113.stdout:test api_io on pid 63844 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63844 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_io on pid 63844' 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63844 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.278 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_io_pp 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_io_pp' 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_io_pp 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_io.log 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_io: /' 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_io_pp 2024-04-19T22:49:29.279 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63852 2024-04-19T22:49:29.280 INFO:tasks.workunit.client.0.smithi113.stdout:test api_io_pp on pid 63852 2024-04-19T22:49:29.281 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_io_pp on pid 63852' 2024-04-19T22:49:29.281 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63852 2024-04-19T22:49:29.281 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_asio 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_asio' 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_asio 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.282 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_io_pp: /' 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_asio 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63860 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_asio on pid 63860' 2024-04-19T22:49:29.283 INFO:tasks.workunit.client.0.smithi113.stdout:test api_asio on pid 63860 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63860 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_list 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_list' 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.285 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_list 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_asio.log 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_asio: /' 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_list 2024-04-19T22:49:29.286 INFO:tasks.workunit.client.0.smithi113.stdout:test api_list on pid 63868 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63868 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_list on pid 63868' 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63868 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_lock 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_lock' 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_lock 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.288 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_list: /' 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_list.log 2024-04-19T22:49:29.289 INFO:tasks.workunit.client.0.smithi113.stdout:test api_lock on pid 63876 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_lock 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63876 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_lock on pid 63876' 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63876 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.290 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-04-19T22:49:29.291 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_lock.log 2024-04-19T22:49:29.292 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_lock: /' 2024-04-19T22:49:29.294 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_lock_pp 2024-04-19T22:49:29.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:29 smithi113 bash[21528]: cluster 2024-04-19T22:49:27.695937+0000 mgr.y (mgr.24389) 160 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:29.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:29 smithi113 bash[28910]: cluster 2024-04-19T22:49:27.695937+0000 mgr.y (mgr.24389) 160 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:29.295 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_lock_pp' 2024-04-19T22:49:29.301 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:29 smithi178 bash[23441]: cluster 2024-04-19T22:49:27.695937+0000 mgr.y (mgr.24389) 160 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-04-19T22:49:29.313 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.321 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_lock_pp 2024-04-19T22:49:29.323 INFO:tasks.workunit.client.0.smithi113.stdout:test api_lock_pp on pid 63947 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_lock_pp 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63947 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_lock_pp on pid 63947' 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63947 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-04-19T22:49:29.324 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_misc 2024-04-19T22:49:29.325 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_misc' 2024-04-19T22:49:29.325 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.325 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.325 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.325 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.326 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_misc 2024-04-19T22:49:29.326 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.327 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-04-19T22:49:29.328 INFO:tasks.workunit.client.0.smithi113.stdout:test api_misc on pid 63967 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_misc 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63967 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_misc on pid 63967' 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63967 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.329 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-04-19T22:49:29.330 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_misc_pp 2024-04-19T22:49:29.330 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-04-19T22:49:29.330 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_misc_pp' 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_misc.log 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_misc: /' 2024-04-19T22:49:29.331 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_misc_pp 2024-04-19T22:49:29.332 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.333 INFO:tasks.workunit.client.0.smithi113.stdout:test api_misc_pp on pid 63984 2024-04-19T22:49:29.333 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_misc_pp 2024-04-19T22:49:29.333 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63984 2024-04-19T22:49:29.333 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_misc_pp on pid 63984' 2024-04-19T22:49:29.333 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_lock_pp: /' 2024-04-19T22:49:29.334 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63984 2024-04-19T22:49:29.334 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.334 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.334 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_tier_pp 2024-04-19T22:49:29.335 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_tier_pp' 2024-04-19T22:49:29.336 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_misc_pp: /' 2024-04-19T22:49:29.336 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_tier_pp 2024-04-19T22:49:29.336 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.336 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-04-19T22:49:29.337 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_tier_pp 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stdout:test api_tier_pp on pid 63996 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63996 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_tier_pp on pid 63996' 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=63996 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-04-19T22:49:29.338 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.339 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.339 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.339 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.339 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.339 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-04-19T22:49:29.340 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_pool 2024-04-19T22:49:29.340 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_pool' 2024-04-19T22:49:29.340 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_pool 2024-04-19T22:49:29.341 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_tier_pp: /' 2024-04-19T22:49:29.343 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-04-19T22:49:29.345 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stdout:test api_pool on pid 64019 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_pool 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64019 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_pool on pid 64019' 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64019 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.353 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-04-19T22:49:29.354 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_snapshots 2024-04-19T22:49:29.354 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.354 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.354 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.354 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_snapshots' 2024-04-19T22:49:29.355 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.355 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-04-19T22:49:29.355 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_pool.log 2024-04-19T22:49:29.365 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_snapshots 2024-04-19T22:49:29.365 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.366 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_pool: /' 2024-04-19T22:49:29.367 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_snapshots 2024-04-19T22:49:29.367 INFO:tasks.workunit.client.0.smithi113.stdout:test api_snapshots on pid 64035 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64035 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_snapshots on pid 64035' 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64035 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_snapshots_pp 2024-04-19T22:49:29.368 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_snapshots_pp' 2024-04-19T22:49:29.369 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.369 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.369 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.369 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.369 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.370 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-04-19T22:49:29.371 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-04-19T22:49:29.372 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_snapshots: /' 2024-04-19T22:49:29.373 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_snapshots_pp 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stdout:test api_snapshots_pp on pid 64056 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_snapshots_pp 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64056 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_snapshots_pp on pid 64056' 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64056 2024-04-19T22:49:29.374 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.375 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.378 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_stat 2024-04-19T22:49:29.378 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_stat' 2024-04-19T22:49:29.379 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_stat 2024-04-19T22:49:29.379 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.382 INFO:tasks.workunit.client.0.smithi113.stdout:test api_stat on pid 64068 2024-04-19T22:49:29.382 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_stat 2024-04-19T22:49:29.382 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64068 2024-04-19T22:49:29.382 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_stat on pid 64068' 2024-04-19T22:49:29.383 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64068 2024-04-19T22:49:29.383 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.383 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.385 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-04-19T22:49:29.387 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.387 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.387 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.387 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.388 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-04-19T22:49:29.388 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-04-19T22:49:29.390 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.390 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.390 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-04-19T22:49:29.390 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.391 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.391 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_stat_pp 2024-04-19T22:49:29.391 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_stat_pp' 2024-04-19T22:49:29.392 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-04-19T22:49:29.392 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_stat.log 2024-04-19T22:49:29.392 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-04-19T22:49:29.392 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_stat: /' 2024-04-19T22:49:29.394 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.397 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_stat_pp 2024-04-19T22:49:29.399 INFO:tasks.workunit.client.0.smithi113.stdout:test api_stat_pp on pid 64105 2024-04-19T22:49:29.399 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_stat_pp 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64105 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_stat_pp on pid 64105' 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64105 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_watch_notify 2024-04-19T22:49:29.400 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_watch_notify' 2024-04-19T22:49:29.401 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_watch_notify 2024-04-19T22:49:29.401 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.403 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_watch_notify 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stdout:test api_watch_notify on pid 64120 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64120 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_watch_notify on pid 64120' 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64120 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.404 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.405 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.405 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.405 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.405 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.406 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_watch_notify_pp 2024-04-19T22:49:29.406 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-04-19T22:49:29.406 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-04-19T22:49:29.407 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_watch_notify_pp' 2024-04-19T22:49:29.408 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.409 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_watch_notify_pp 2024-04-19T22:49:29.410 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_watch_notify: /' 2024-04-19T22:49:29.410 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_watch_notify_pp 2024-04-19T22:49:29.411 INFO:tasks.workunit.client.0.smithi113.stdout:test api_watch_notify_pp on pid 64151 2024-04-19T22:49:29.411 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64151 2024-04-19T22:49:29.411 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_watch_notify_pp on pid 64151' 2024-04-19T22:49:29.411 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64151 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_cmd 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_cmd' 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_cmd 2024-04-19T22:49:29.412 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.413 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-04-19T22:49:29.414 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.414 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.414 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.414 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.415 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_cmd 2024-04-19T22:49:29.415 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-04-19T22:49:29.415 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64160 2024-04-19T22:49:29.415 INFO:tasks.workunit.client.0.smithi113.stdout:test api_cmd on pid 64160 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_cmd on pid 64160' 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64160 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_stat_pp: /' 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_cmd_pp 2024-04-19T22:49:29.416 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_cmd_pp' 2024-04-19T22:49:29.417 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-04-19T22:49:29.417 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.419 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.419 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.419 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.419 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.419 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_cmd.log 2024-04-19T22:49:29.420 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_cmd: /' 2024-04-19T22:49:29.420 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.420 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.421 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.421 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.421 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-04-19T22:49:29.421 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-04-19T22:49:29.422 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_cmd_pp 2024-04-19T22:49:29.423 INFO:tasks.workunit.client.0.smithi113.stdout:test api_cmd_pp on pid 64178 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_cmd_pp 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64178 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_cmd_pp on pid 64178' 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64178 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-04-19T22:49:29.424 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_service 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_service' 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-04-19T22:49:29.426 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-04-19T22:49:29.426 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-04-19T22:49:29.432 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.432 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_service 2024-04-19T22:49:29.433 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stdout:test api_service on pid 64190 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_service 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64190 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_service on pid 64190' 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64190 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.435 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.438 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_service_pp 2024-04-19T22:49:29.438 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_service_pp' 2024-04-19T22:49:29.441 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-04-19T22:49:29.443 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.443 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.443 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.443 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.443 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-04-19T22:49:29.451 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_service: /' 2024-04-19T22:49:29.452 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_service.log 2024-04-19T22:49:29.457 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_service_pp 2024-04-19T22:49:29.457 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.460 INFO:tasks.workunit.client.0.smithi113.stdout:test api_service_pp on pid 64230 2024-04-19T22:49:29.460 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_service_pp 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64230 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_service_pp on pid 64230' 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64230 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.461 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-04-19T22:49:29.462 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.462 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.462 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.462 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.462 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_service_pp: /' 2024-04-19T22:49:29.464 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-04-19T22:49:29.464 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-04-19T22:49:29.464 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_c_write_operations 2024-04-19T22:49:29.464 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_c_write_operations' 2024-04-19T22:49:29.466 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_c_write_operations 2024-04-19T22:49:29.467 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.474 INFO:tasks.workunit.client.0.smithi113.stdout:test api_c_write_operations on pid 64282 2024-04-19T22:49:29.474 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_c_write_operations 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64282 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_c_write_operations on pid 64282' 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64282 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.475 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_c_read_operations 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_c_read_operations' 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_c_read_operations 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.476 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.477 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.477 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-04-19T22:49:29.477 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-04-19T22:49:29.478 INFO:tasks.workunit.client.0.smithi113.stdout:test api_c_read_operations on pid 64298 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_c_read_operations 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64298 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_c_read_operations on pid 64298' 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64298 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s api_cls_remote_reads 2024-04-19T22:49:29.479 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-04-19T22:49:29.480 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.480 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.480 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.480 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.481 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-04-19T22:49:29.483 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' api_cls_remote_reads' 2024-04-19T22:49:29.483 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-04-19T22:49:29.484 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo api_cls_remote_reads 2024-04-19T22:49:29.484 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.484 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-04-19T22:49:29.486 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=api_cls_remote_reads 2024-04-19T22:49:29.486 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64315 2024-04-19T22:49:29.486 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test api_cls_remote_reads on pid 64315' 2024-04-19T22:49:29.486 INFO:tasks.workunit.client.0.smithi113.stdout:test api_cls_remote_reads on pid 64315 2024-04-19T22:49:29.487 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64315 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s list_parallel 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' list_parallel' 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo list_parallel 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.488 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-04-19T22:49:29.489 INFO:tasks.workunit.client.0.smithi113.stdout:test list_parallel on pid 64323 2024-04-19T22:49:29.489 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=list_parallel 2024-04-19T22:49:29.489 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64323 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test list_parallel on pid 64323' 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64323 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-04-19T22:49:29.490 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_list_parallel.log 2024-04-19T22:49:29.491 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ list_parallel: /' 2024-04-19T22:49:29.494 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s open_pools_parallel 2024-04-19T22:49:29.494 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' open_pools_parallel' 2024-04-19T22:49:29.495 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.498 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo open_pools_parallel 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stdout:test open_pools_parallel on pid 64331 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=open_pools_parallel 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64331 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test open_pools_parallel on pid 64331' 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64331 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.499 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-04-19T22:49:29.500 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.500 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.500 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.500 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.501 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-04-19T22:49:29.505 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-04-19T22:49:29.506 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s delete_pools_parallel 2024-04-19T22:49:29.506 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' delete_pools_parallel' 2024-04-19T22:49:29.507 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo delete_pools_parallel 2024-04-19T22:49:29.508 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.512 INFO:tasks.workunit.client.0.smithi113.stdout:test delete_pools_parallel on pid 64347 2024-04-19T22:49:29.512 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=delete_pools_parallel 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64347 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test delete_pools_parallel on pid 64347' 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64347 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-04-19T22:49:29.513 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-04-19T22:49:29.514 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.515 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.515 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.515 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.515 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s cls 2024-04-19T22:49:29.516 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' cls' 2024-04-19T22:49:29.517 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.520 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo cls 2024-04-19T22:49:29.521 INFO:tasks.workunit.client.0.smithi113.stdout:test cls on pid 64365 2024-04-19T22:49:29.521 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=cls 2024-04-19T22:49:29.521 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64365 2024-04-19T22:49:29.522 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test cls on pid 64365' 2024-04-19T22:49:29.522 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64365 2024-04-19T22:49:29.522 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.522 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.522 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-04-19T22:49:29.529 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s cmd 2024-04-19T22:49:29.529 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-04-19T22:49:29.530 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-04-19T22:49:29.530 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' cmd' 2024-04-19T22:49:29.533 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-04-19T22:49:29.535 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.537 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.537 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.537 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.537 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.537 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo cmd 2024-04-19T22:49:29.539 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=cmd 2024-04-19T22:49:29.539 INFO:tasks.workunit.client.0.smithi113.stdout:test cmd on pid 64414 2024-04-19T22:49:29.539 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64414 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test cmd on pid 64414' 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64414 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s handler_error 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' handler_error' 2024-04-19T22:49:29.540 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-04-19T22:49:29.541 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.541 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo handler_error 2024-04-19T22:49:29.543 INFO:tasks.workunit.client.0.smithi113.stdout:test handler_error on pid 64437 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=handler_error 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64437 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test handler_error on pid 64437' 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64437 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.544 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.545 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_cmd 2024-04-19T22:49:29.545 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_cls 2024-04-19T22:49:29.545 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ cmd: /' 2024-04-19T22:49:29.545 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_cmd.log 2024-04-19T22:49:29.546 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_cls.log 2024-04-19T22:49:29.546 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s io 2024-04-19T22:49:29.546 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-04-19T22:49:29.548 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.548 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.548 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.548 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.550 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ cls: /' 2024-04-19T22:49:29.550 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' io' 2024-04-19T22:49:29.552 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ handler_error: /' 2024-04-19T22:49:29.552 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_handler_error.log 2024-04-19T22:49:29.553 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_handler_error 2024-04-19T22:49:29.573 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.574 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo io 2024-04-19T22:49:29.576 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=io 2024-04-19T22:49:29.576 INFO:tasks.workunit.client.0.smithi113.stdout:test io on pid 64501 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64501 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test io on pid 64501' 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64501 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s ec_io 2024-04-19T22:49:29.577 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' ec_io' 2024-04-19T22:49:29.578 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.578 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.578 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.578 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.578 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_io 2024-04-19T22:49:29.586 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.589 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo ec_io 2024-04-19T22:49:29.595 INFO:tasks.workunit.client.0.smithi113.stdout:test ec_io on pid 64547 2024-04-19T22:49:29.595 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=ec_io 2024-04-19T22:49:29.595 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64547 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test ec_io on pid 64547' 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64547 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.596 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s list 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' list' 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_ec_io.log 2024-04-19T22:49:29.597 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_io.log 2024-04-19T22:49:29.601 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ io: /' 2024-04-19T22:49:29.606 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ ec_io: /' 2024-04-19T22:49:29.606 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_ec_io 2024-04-19T22:49:29.610 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo list 2024-04-19T22:49:29.614 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stdout:test list on pid 64604 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=list 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64604 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test list on pid 64604' 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64604 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.617 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-04-19T22:49:29.618 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_list 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_list.log 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ list: /' 2024-04-19T22:49:29.619 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s ec_list 2024-04-19T22:49:29.624 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' ec_list' 2024-04-19T22:49:29.627 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo ec_list 2024-04-19T22:49:29.627 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=ec_list 2024-04-19T22:49:29.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64647 2024-04-19T22:49:29.631 INFO:tasks.workunit.client.0.smithi113.stdout:test ec_list on pid 64647 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test ec_list on pid 64647' 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64647 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s misc 2024-04-19T22:49:29.632 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' misc' 2024-04-19T22:49:29.633 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo misc 2024-04-19T22:49:29.633 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=misc 2024-04-19T22:49:29.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64652 2024-04-19T22:49:29.635 INFO:tasks.workunit.client.0.smithi113.stdout:test misc on pid 64652 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test misc on pid 64652' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64652 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s pool 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' pool' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo pool 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.637 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_ec_list 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_misc 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_ec_list.log 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ misc: /' 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ ec_list: /' 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_misc.log 2024-04-19T22:49:29.638 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=pool 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stdout:test pool on pid 64663 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64663 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test pool on pid 64663' 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64663 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.639 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s read_operations 2024-04-19T22:49:29.642 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.642 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' read_operations' 2024-04-19T22:49:29.642 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.642 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_pool 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ pool: /' 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_pool.log 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo read_operations 2024-04-19T22:49:29.643 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.646 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=read_operations 2024-04-19T22:49:29.646 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64671 2024-04-19T22:49:29.646 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test read_operations on pid 64671' 2024-04-19T22:49:29.647 INFO:tasks.workunit.client.0.smithi113.stdout:test read_operations on pid 64671 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64671 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s snapshots 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' snapshots' 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo snapshots 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.648 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.649 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ read_operations: /' 2024-04-19T22:49:29.649 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_read_operations 2024-04-19T22:49:29.650 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=snapshots 2024-04-19T22:49:29.650 INFO:tasks.workunit.client.0.smithi113.stdout:test snapshots on pid 64685 2024-04-19T22:49:29.650 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64685 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test snapshots on pid 64685' 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64685 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-04-19T22:49:29.651 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_read_operations.log 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_snapshots 2024-04-19T22:49:29.652 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ snapshots: /' 2024-04-19T22:49:29.653 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s watch_notify 2024-04-19T22:49:29.661 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_snapshots.log 2024-04-19T22:49:29.662 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' watch_notify' 2024-04-19T22:49:29.663 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.664 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo watch_notify 2024-04-19T22:49:29.665 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=watch_notify 2024-04-19T22:49:29.665 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64718 2024-04-19T22:49:29.665 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test watch_notify on pid 64718' 2024-04-19T22:49:29.666 INFO:tasks.workunit.client.0.smithi113.stdout:test watch_notify on pid 64718 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64718 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:++ printf %25s write_operations 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:+ r=' write_operations' 2024-04-19T22:49:29.667 INFO:tasks.workunit.client.0.smithi113.stderr:++ echo write_operations 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_watch_notify 2024-04-19T22:49:29.668 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ watch_notify: /' 2024-04-19T22:49:29.670 INFO:tasks.workunit.client.0.smithi113.stderr:++ awk '{print $1}' 2024-04-19T22:49:29.670 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-04-19T22:49:29.672 INFO:tasks.workunit.client.0.smithi113.stderr:+ ff=write_operations 2024-04-19T22:49:29.672 INFO:tasks.workunit.client.0.smithi113.stdout:test write_operations on pid 64738 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64738 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo 'test write_operations on pid 64738' 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ pids[$f]=64738 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ ret=0 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' 1 -eq 1 ']' 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63996 2024-04-19T22:49:29.673 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63996 2024-04-19T22:49:29.674 INFO:tasks.workunit.client.0.smithi113.stderr:+ '[' -z '' ']' 2024-04-19T22:49:29.674 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.674 INFO:tasks.workunit.client.0.smithi113.stderr:+ case $- in 2024-04-19T22:49:29.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ return 2024-04-19T22:49:29.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph_test_neorados_write_operations 2024-04-19T22:49:29.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ tee ceph_test_neorados_write_operations.log 2024-04-19T22:49:29.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ sed 's/^/ write_operations: /' 2024-04-19T22:49:31.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:31 smithi113 bash[28910]: audit 2024-04-19T22:49:29.477047+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:31.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:31 smithi113 bash[28910]: audit 2024-04-19T22:49:29.683651+0000 mon.c (mon.2) 24 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:31.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:31 smithi113 bash[21528]: audit 2024-04-19T22:49:29.477047+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:31.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:31 smithi113 bash[21528]: audit 2024-04-19T22:49:29.683651+0000 mon.c (mon.2) 24 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:31.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:31 smithi178 bash[23441]: audit 2024-04-19T22:49:29.477047+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:31.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:31 smithi178 bash[23441]: audit 2024-04-19T22:49:29.683651+0000 mon.c (mon.2) 24 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:33.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[21528]: audit 2024-04-19T22:49:30.247282+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.113:0/1687051172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[21528]: cluster 2024-04-19T22:49:31.462302+0000 mon.a (mon.0) 915 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-04-19T22:49:33.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[21528]: audit 2024-04-19T22:49:31.488290+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.113:0/113188123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[21528]: cluster 2024-04-19T22:49:32.327671+0000 mon.a (mon.0) 916 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-04-19T22:49:33.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[28910]: audit 2024-04-19T22:49:30.247282+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.113:0/1687051172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[28910]: cluster 2024-04-19T22:49:31.462302+0000 mon.a (mon.0) 915 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-04-19T22:49:33.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[28910]: audit 2024-04-19T22:49:31.488290+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.113:0/113188123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:32 smithi113 bash[28910]: cluster 2024-04-19T22:49:32.327671+0000 mon.a (mon.0) 916 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-04-19T22:49:33.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:32 smithi178 bash[23441]: audit 2024-04-19T22:49:30.247282+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.113:0/1687051172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:32 smithi178 bash[23441]: cluster 2024-04-19T22:49:31.462302+0000 mon.a (mon.0) 915 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-04-19T22:49:33.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:32 smithi178 bash[23441]: audit 2024-04-19T22:49:31.488290+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.113:0/113188123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:33.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:32 smithi178 bash[23441]: cluster 2024-04-19T22:49:32.327671+0000 mon.a (mon.0) 916 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-04-19T22:49:34.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[21528]: cluster 2024-04-19T22:49:29.696857+0000 mgr.y (mgr.24389) 161 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[21528]: audit 2024-04-19T22:49:32.782192+0000 mon.a (mon.0) 917 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[21528]: audit 2024-04-19T22:49:32.802327+0000 mon.c (mon.2) 25 : audit 1 from='client.? 172.21.15.113:0/3015487677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[21528]: audit 2024-04-19T22:49:32.804445+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.113:0/3548164804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[21528]: cluster 2024-04-19T22:49:33.207434+0000 mon.a (mon.0) 918 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-04-19T22:49:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[28910]: cluster 2024-04-19T22:49:29.696857+0000 mgr.y (mgr.24389) 161 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[28910]: audit 2024-04-19T22:49:32.782192+0000 mon.a (mon.0) 917 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[28910]: audit 2024-04-19T22:49:32.802327+0000 mon.c (mon.2) 25 : audit 1 from='client.? 172.21.15.113:0/3015487677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[28910]: audit 2024-04-19T22:49:32.804445+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.113:0/3548164804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:34 smithi113 bash[28910]: cluster 2024-04-19T22:49:33.207434+0000 mon.a (mon.0) 918 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-04-19T22:49:34.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[23441]: cluster 2024-04-19T22:49:29.696857+0000 mgr.y (mgr.24389) 161 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:34.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[23441]: audit 2024-04-19T22:49:32.782192+0000 mon.a (mon.0) 917 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[23441]: audit 2024-04-19T22:49:32.802327+0000 mon.c (mon.2) 25 : audit 1 from='client.? 172.21.15.113:0/3015487677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[23441]: audit 2024-04-19T22:49:32.804445+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.113:0/3548164804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:34.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[23441]: cluster 2024-04-19T22:49:33.207434+0000 mon.a (mon.0) 918 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-04-19T22:49:35.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:38.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:37 smithi113 bash[21528]: audit 2024-04-19T22:49:34.092747+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:38.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:37 smithi113 bash[28910]: audit 2024-04-19T22:49:34.092747+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:38.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:37 smithi178 bash[23441]: audit 2024-04-19T22:49:34.092747+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[21528]: audit 2024-04-19T22:49:34.094546+0000 mon.a (mon.0) 920 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:39.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[21528]: audit 2024-04-19T22:49:34.115103+0000 mon.c (mon.2) 26 : audit 1 from='client.? 172.21.15.113:0/1649465702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[21528]: audit 2024-04-19T22:49:34.115477+0000 mon.c (mon.2) 27 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[21528]: cluster 2024-04-19T22:49:37.866569+0000 mon.a (mon.0) 921 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-04-19T22:49:39.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[28910]: audit 2024-04-19T22:49:34.094546+0000 mon.a (mon.0) 920 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:39.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[28910]: audit 2024-04-19T22:49:34.115103+0000 mon.c (mon.2) 26 : audit 1 from='client.? 172.21.15.113:0/1649465702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[28910]: audit 2024-04-19T22:49:34.115477+0000 mon.c (mon.2) 27 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:39 smithi113 bash[28910]: cluster 2024-04-19T22:49:37.866569+0000 mon.a (mon.0) 921 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-04-19T22:49:39.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:39 smithi178 bash[23441]: audit 2024-04-19T22:49:34.094546+0000 mon.a (mon.0) 920 : audit 1 from='client.? 172.21.15.113:0/183921974' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi113-63841-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:39.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:39 smithi178 bash[23441]: audit 2024-04-19T22:49:34.115103+0000 mon.c (mon.2) 26 : audit 1 from='client.? 172.21.15.113:0/1649465702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:39 smithi178 bash[23441]: audit 2024-04-19T22:49:34.115477+0000 mon.c (mon.2) 27 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:39.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:39 smithi178 bash[23441]: cluster 2024-04-19T22:49:37.866569+0000 mon.a (mon.0) 921 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-04-19T22:49:44.330 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-04-19T22:49:44.330 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [----------] Global test environment set-up. 2024-04-19T22:49:44.330 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [----------] 4 tests from LibRadosService 2024-04-19T22:49:44.330 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-04-19T22:49:44.330 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5062 ms) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ OK ] LibRadosService.RegisterLate (47 ms) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: cluster: 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: id: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: health: HEALTH_WARN 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 5 pool(s) do not have an application enabled 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: services: 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-19T22:49:44.331 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: data: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pools: 11 pools, 292 pgs 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: objects: 198 objects, 583 KiB 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: usage: 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pgs: 54.795% pgs unknown 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 160 unknown 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 132 active+clean 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: io: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: cluster: 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: id: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:49:44.332 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: health: HEALTH_WARN 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 5 pool(s) do not have an application enabled 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: services: 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: data: 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pools: 11 pools, 292 pgs 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: objects: 198 objects, 583 KiB 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: usage: 231 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:49:44.333 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pgs: 54.795% pgs unknown 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 160 unknown 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 132 active+clean 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: io: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: cluster: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: id: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: health: HEALTH_WARN 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 8 pool(s) do not have an application enabled 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: services: 2024-04-19T22:49:44.334 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: foo: 7 portals active (1 hosts, 3 zones) 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: data: 2024-04-19T22:49:44.335 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pools: 14 pools, 388 pgs 2024-04-19T22:49:44.512 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [----------] Global test environment set-up. 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [----------] 12 tests from AsioRados 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (3 ms) 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2 ms) 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2 ms) 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-04-19T22:49:44.513 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (5 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (2 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2024-04-19T22:49:44.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [----------] 12 tests from AsioRados (19 ms total) 2024-04-19T22:49:44.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: 2024-04-19T22:49:44.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [----------] Global test environment tear-down 2024-04-19T22:49:44.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (15163 ms total) 2024-04-19T22:49:44.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_asio: [ PASSED ] 12 tests. 2024-04-19T22:49:44.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:31.697620+0000 mgr.y (mgr.24389) 162 : cluster 0 pgmap v109: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:44.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:33.698502+0000 mgr.y (mgr.24389) 163 : cluster 0 pgmap v110: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T22:49:44.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:34.786753+0000 mgr.y (mgr.24389) 164 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:35.701277+0000 mgr.y (mgr.24389) 165 : cluster 0 pgmap v112: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:37.702398+0000 mgr.y (mgr.24389) 166 : cluster 0 pgmap v113: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 0 op/s 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:37.903846+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:38.756074+0000 mon.a (mon.0) 923 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: cluster 2024-04-19T22:49:39.197325+0000 mon.a (mon.0) 924 : cluster 3 Health check failed: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.215099+0000 mon.a (mon.0) 925 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.215350+0000 mon.a (mon.0) 926 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.216267+0000 mon.a (mon.0) 927 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.219509+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.219799+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.219984+0000 mon.a (mon.0) 930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.221298+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.221548+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:31.697620+0000 mgr.y (mgr.24389) 162 : cluster 0 pgmap v109: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:33.698502+0000 mgr.y (mgr.24389) 163 : cluster 0 pgmap v110: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:34.786753+0000 mgr.y (mgr.24389) 164 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:35.701277+0000 mgr.y (mgr.24389) 165 : cluster 0 pgmap v112: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:37.702398+0000 mgr.y (mgr.24389) 166 : cluster 0 pgmap v113: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 0 op/s 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:37.903846+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:38.756074+0000 mon.a (mon.0) 923 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: cluster 2024-04-19T22:49:39.197325+0000 mon.a (mon.0) 924 : cluster 3 Health check failed: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.215099+0000 mon.a (mon.0) 925 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.215350+0000 mon.a (mon.0) 926 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.216267+0000 mon.a (mon.0) 927 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.219509+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.219799+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.219984+0000 mon.a (mon.0) 930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.221298+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.221548+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.222292+0000 mon.a (mon.0) 933 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[21528]: audit 2024-04-19T22:49:39.222536+0000 mon.a (mon.0) 934 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.222292+0000 mon.a (mon.0) 933 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:44 smithi113 bash[28910]: audit 2024-04-19T22:49:39.222536+0000 mon.a (mon.0) 934 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:31.697620+0000 mgr.y (mgr.24389) 162 : cluster 0 pgmap v109: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:33.698502+0000 mgr.y (mgr.24389) 163 : cluster 0 pgmap v110: 292 pgs: 160 unknown, 132 active+clean; 583 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:34.786753+0000 mgr.y (mgr.24389) 164 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:35.701277+0000 mgr.y (mgr.24389) 165 : cluster 0 pgmap v112: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:37.702398+0000 mgr.y (mgr.24389) 166 : cluster 0 pgmap v113: 388 pgs: 196 creating+peering, 192 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 684 B/s rd, 0 op/s 2024-04-19T22:49:44.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:37.903846+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.113:0/1252054220' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi113-63833-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:38.756074+0000 mon.a (mon.0) 923 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: cluster 2024-04-19T22:49:39.197325+0000 mon.a (mon.0) 924 : cluster 3 Health check failed: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.215099+0000 mon.a (mon.0) 925 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.215350+0000 mon.a (mon.0) 926 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.216267+0000 mon.a (mon.0) 927 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.219509+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.219799+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.219984+0000 mon.a (mon.0) 930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.221298+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.221548+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.222292+0000 mon.a (mon.0) 933 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:44.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[23441]: audit 2024-04-19T22:49:39.222536+0000 mon.a (mon.0) 934 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:45.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:39.237497+0000 mon.c (mon.2) 28 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:39.248541+0000 mon.c (mon.2) 29 : audit 1 from='client.? 172.21.15.113:0/888506844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:39.274664+0000 mon.c (mon.2) 30 : audit 0 from='client.? 172.21.15.113:0/1854620682' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:39.705031+0000 mgr.y (mgr.24389) 167 : cluster 0 pgmap v115: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:41.308195+0000 mon.c (mon.2) 31 : audit 0 from='client.? 172.21.15.113:0/1538772352' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:41.706343+0000 mgr.y (mgr.24389) 168 : cluster 0 pgmap v116: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:43.707754+0000 mgr.y (mgr.24389) 169 : cluster 0 pgmap v117: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:44.221111+0000 mon.a (mon.0) 935 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:44.222916+0000 mon.a (mon.0) 936 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.265085+0000 mon.a (mon.0) 937 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.267552+0000 mon.a (mon.0) 938 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.268847+0000 mon.a (mon.0) 939 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.269450+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.270160+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.270396+0000 mon.a (mon.0) 942 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.270644+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.270895+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.271115+0000 mon.a (mon.0) 945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.271388+0000 mon.a (mon.0) 946 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.271513+0000 mon.a (mon.0) 947 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.284311+0000 mon.c (mon.2) 32 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: cluster 2024-04-19T22:49:44.289070+0000 mon.a (mon.0) 948 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.301648+0000 mon.c (mon.2) 33 : audit 1 from='client.? 172.21.15.113:0/2823885806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.302562+0000 mon.a (mon.0) 949 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.311403+0000 mon.a (mon.0) 950 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.311643+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.315811+0000 mon.a (mon.0) 952 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.323353+0000 mon.a (mon.0) 953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.323916+0000 mon.a (mon.0) 954 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.324148+0000 mon.a (mon.0) 955 : audit 0 from='client.? 172.21.15.113:0/4277978398' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.328220+0000 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.328811+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.332091+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.332529+0000 mon.a (mon.0) 959 : audit 0 from='client.? 172.21.15.113:0/4275406804' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.335408+0000 mon.c (mon.2) 34 : audit 1 from='client.? 172.21.15.113:0/1447710498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.335772+0000 mon.c (mon.2) 35 : audit 1 from='client.? 172.21.15.113:0/3984878359' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.336217+0000 mon.c (mon.2) 36 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.811401+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.811766+0000 mon.a (mon.0) 961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.812266+0000 mon.a (mon.0) 962 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.813138+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[21528]: audit 2024-04-19T22:49:44.813770+0000 mon.a (mon.0) 964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:39.237497+0000 mon.c (mon.2) 28 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:39.248541+0000 mon.c (mon.2) 29 : audit 1 from='client.? 172.21.15.113:0/888506844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:39.274664+0000 mon.c (mon.2) 30 : audit 0 from='client.? 172.21.15.113:0/1854620682' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:39.705031+0000 mgr.y (mgr.24389) 167 : cluster 0 pgmap v115: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:41.308195+0000 mon.c (mon.2) 31 : audit 0 from='client.? 172.21.15.113:0/1538772352' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:41.706343+0000 mgr.y (mgr.24389) 168 : cluster 0 pgmap v116: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:43.707754+0000 mgr.y (mgr.24389) 169 : cluster 0 pgmap v117: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:44.221111+0000 mon.a (mon.0) 935 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:44.222916+0000 mon.a (mon.0) 936 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.265085+0000 mon.a (mon.0) 937 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.267552+0000 mon.a (mon.0) 938 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.268847+0000 mon.a (mon.0) 939 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.269450+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.270160+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.270396+0000 mon.a (mon.0) 942 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.270644+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.270895+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.271115+0000 mon.a (mon.0) 945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.271388+0000 mon.a (mon.0) 946 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.271513+0000 mon.a (mon.0) 947 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.284311+0000 mon.c (mon.2) 32 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: cluster 2024-04-19T22:49:44.289070+0000 mon.a (mon.0) 948 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.301648+0000 mon.c (mon.2) 33 : audit 1 from='client.? 172.21.15.113:0/2823885806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.302562+0000 mon.a (mon.0) 949 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.311403+0000 mon.a (mon.0) 950 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.311643+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.315811+0000 mon.a (mon.0) 952 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.323353+0000 mon.a (mon.0) 953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.323916+0000 mon.a (mon.0) 954 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.324148+0000 mon.a (mon.0) 955 : audit 0 from='client.? 172.21.15.113:0/4277978398' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.328220+0000 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.328811+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.332091+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.332529+0000 mon.a (mon.0) 959 : audit 0 from='client.? 172.21.15.113:0/4275406804' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.335408+0000 mon.c (mon.2) 34 : audit 1 from='client.? 172.21.15.113:0/1447710498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.335772+0000 mon.c (mon.2) 35 : audit 1 from='client.? 172.21.15.113:0/3984878359' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.336217+0000 mon.c (mon.2) 36 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.811401+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.811766+0000 mon.a (mon.0) 961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:49:46.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.812266+0000 mon.a (mon.0) 962 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.813138+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:45 smithi113 bash[28910]: audit 2024-04-19T22:49:44.813770+0000 mon.a (mon.0) 964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:39.237497+0000 mon.c (mon.2) 28 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:39.248541+0000 mon.c (mon.2) 29 : audit 1 from='client.? 172.21.15.113:0/888506844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:39.274664+0000 mon.c (mon.2) 30 : audit 0 from='client.? 172.21.15.113:0/1854620682' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:39.705031+0000 mgr.y (mgr.24389) 167 : cluster 0 pgmap v115: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:41.308195+0000 mon.c (mon.2) 31 : audit 0 from='client.? 172.21.15.113:0/1538772352' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:41.706343+0000 mgr.y (mgr.24389) 168 : cluster 0 pgmap v116: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:43.707754+0000 mgr.y (mgr.24389) 169 : cluster 0 pgmap v117: 772 pgs: 573 creating+peering, 199 active+clean; 583 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:44.221111+0000 mon.a (mon.0) 935 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:44.222916+0000 mon.a (mon.0) 936 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.265085+0000 mon.a (mon.0) 937 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.267552+0000 mon.a (mon.0) 938 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.268847+0000 mon.a (mon.0) 939 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.269450+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.270160+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi113-64557-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.270396+0000 mon.a (mon.0) 942 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi113-63849-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.270644+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi113-64079-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.270895+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi113-64658-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.271115+0000 mon.a (mon.0) 945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.271388+0000 mon.a (mon.0) 946 : audit 1 from='client.? 172.21.15.113:0/117729790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi113-64156-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.271513+0000 mon.a (mon.0) 947 : audit 1 from='client.? 172.21.15.113:0/1547416176' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi113-64308-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.284311+0000 mon.c (mon.2) 32 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: cluster 2024-04-19T22:49:44.289070+0000 mon.a (mon.0) 948 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.301648+0000 mon.c (mon.2) 33 : audit 1 from='client.? 172.21.15.113:0/2823885806' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.302562+0000 mon.a (mon.0) 949 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.311403+0000 mon.a (mon.0) 950 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.311643+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.315811+0000 mon.a (mon.0) 952 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.323353+0000 mon.a (mon.0) 953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.323916+0000 mon.a (mon.0) 954 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.324148+0000 mon.a (mon.0) 955 : audit 0 from='client.? 172.21.15.113:0/4277978398' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.328220+0000 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.328811+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.332091+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.332529+0000 mon.a (mon.0) 959 : audit 0 from='client.? 172.21.15.113:0/4275406804' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.335408+0000 mon.c (mon.2) 34 : audit 1 from='client.? 172.21.15.113:0/1447710498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.335772+0000 mon.c (mon.2) 35 : audit 1 from='client.? 172.21.15.113:0/3984878359' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.336217+0000 mon.c (mon.2) 36 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.811401+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.811766+0000 mon.a (mon.0) 961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.812266+0000 mon.a (mon.0) 962 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.813138+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:45 smithi178 bash[23441]: audit 2024-04-19T22:49:44.813770+0000 mon.a (mon.0) 964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:46.247 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] Global test environment set-up. 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 7 tests from LibRadosList 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.ListObjects (333 ms) 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (24 ms) 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo1,foo2,foo3 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo1 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo2 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo3 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo1,foo4,foo5 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo4 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo5 2024-04-19T22:49:46.248 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo1 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo6,foo7 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo7 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo6 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo4 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo5 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns2:foo7 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns2:foo6 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo1 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo1 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo2 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo3 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (63 ms) 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-04-19T22:49:46.249 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 1 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 10 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 13 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 7 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 14 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 0 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 15 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 11 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 5 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 8 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 6 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 3 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 4 0 2024-04-19T22:49:46.250 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 12 0 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 9 0 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 2 0 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (60 ms) 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: x cursor=MIN 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=1 cursor=15:02547ec2:::1:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=10 cursor=15:52ea6a34:::10:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=13 cursor=15:566253c9:::13:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=7 cursor=15:5c6b0b28:::7:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=14 cursor=15:62a1935d:::14:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=0 cursor=15:6cac518f:::0:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=15 cursor=15:863748b0:::15:head 2024-04-19T22:49:46.251 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=11 cursor=15:89d3ae78:::11:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=5 cursor=15:b29083e3:::5:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=8 cursor=15:bd63b0f1:::8:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=6 cursor=15:c4fdafeb:::6:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=3 cursor=15:cfc208b3:::3:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=4 cursor=15:d83876eb:::4:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=12 cursor=15:de5d7c5f:::12:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=9 cursor=15:e960b815:::9:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > oid=2 cursor=15:f905c69b:::2:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: FIRST> seek to MIN oid=1 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=1 cursor=15:02547ec2:::1:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:02547ec2:::1:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:02547ec2:::1:head -> 1 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=10 cursor=15:52ea6a34:::10:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:52ea6a34:::10:head 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:52ea6a34:::10:head -> 10 2024-04-19T22:49:46.252 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=13 cursor=15:566253c9:::13:head 2024-04-19T22:49:46.253 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:566253c9:::13:head 2024-04-19T22:49:46.253 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:566253c9:::13:head -> 13 2024-04-19T22:49:46.253 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=7 cursor=15:5c6b0b28:::7:head 2024-04-19T22:49:46.253 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:5c6b0b28:::7:head 2024-04-19T22:49:46.253 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:5c6b0b28:::7:head -> 7 2024-04-19T22:49:46.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=14 cursor=15:62a1935d:::14:head 2024-04-19T22:49:46.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:62a1935d:::14:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:62a1935d:::14:head -> 14 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=0 cursor=15:6cac518f:::0:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:6cac518f:::0:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:6cac518f:::0:head -> 0 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=15 cursor=15:863748b0:::15:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:863748b0:::15:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:863748b0:::15:head -> 15 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=11 cursor=15:89d3ae78:::11:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:89d3ae78:::11:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:89d3ae78:::11:head -> 11 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=5 cursor=15:b29083e3:::5:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:b29083e3:::5:head 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:b29083e3:::5:head -> 5 2024-04-19T22:49:46.307 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=8 cursor=15:bd63b0f1:::8:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:bd63b0f1:::8:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:bd63b0f1:::8:head -> 8 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=6 cursor=15:c4fdafeb:::6:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:c4fdafeb:::6:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:c4fdafeb:::6:head -> 6 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=3 cursor=15:cfc208b3:::3:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:cfc208b3:::3:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:cfc208b3:::3:head -> 3 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=4 cursor=15:d83876eb:::4:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:d83876eb:::4:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:d83876eb:::4:head -> 4 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=12 cursor=15:de5d7c5f:::12:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:de5d7c5f:::12:head 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:de5d7c5f:::12:head -> 12 2024-04-19T22:49:46.308 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=9 cursor=15:e960b815:::9:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:e960b815:::9:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:e960b815:::9:head -> 9 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : oid=2 cursor=15:f905c69b:::2:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:f905c69b:::2:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:f905c69b:::2:head -> 2 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:d83876eb:::4:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:d83876eb:::4:head expected=15:d83876eb:::4:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:d83876eb:::4:head -> 4 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=4 expected=4 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:cfc208b3:::3:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:cfc208b3:::3:head expected=15:cfc208b3:::3:head 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:cfc208b3:::3:head -> 3 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=3 expected=3 2024-04-19T22:49:46.309 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:f905c69b:::2:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:f905c69b:::2:head expected=15:f905c69b:::2:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:f905c69b:::2:head -> 2 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=2 expected=2 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:e960b815:::9:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:e960b815:::9:head expected=15:e960b815:::9:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:e960b815:::9:head -> 9 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=9 expected=9 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:de5d7c5f:::12:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:de5d7c5f:::12:head expected=15:de5d7c5f:::12:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:de5d7c5f:::12:head -> 12 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=12 expected=12 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:c4fdafeb:::6:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:c4fdafeb:::6:head expected=15:c4fdafeb:::6:head 2024-04-19T22:49:46.310 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:c4fdafeb:::6:head -> 6 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=6 expected=6 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:bd63b0f1:::8:head 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:bd63b0f1:::8:head expected=15:bd63b0f1:::8:head 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:bd63b0f1:::8:head -> 8 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=8 expected=8 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:b29083e3:::5:head 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:b29083e3:::5:head expected=15:b29083e3:::5:head 2024-04-19T22:49:46.311 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:b29083e3:::5:head -> 5 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:44.798074+0000 mgr.y (mgr.24389) 170 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: cluster 2024-04-19T22:49:44.819926+0000 mgr.y (mgr.24389) 171 : cluster 0 pgmap v120: 1188 pgs: 1 unknown, 788 creating+peering, 399 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.658740+0000 mon.a (mon.0) 965 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.666226+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.666504+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.666740+0000 mon.a (mon.0) 968 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.666937+0000 mon.a (mon.0) 969 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667103+0000 mon.a (mon.0) 970 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667247+0000 mon.a (mon.0) 971 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667366+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667511+0000 mon.a (mon.0) 973 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667642+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667793+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.667940+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.668064+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.668196+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:45.680128+0000 mon.c (mon.2) 37 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:46.435553+0000 mon.c (mon.2) 38 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: cluster 2024-04-19T22:49:46.604765+0000 mon.a (mon.0) 979 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[28910]: audit 2024-04-19T22:49:46.612359+0000 mon.a (mon.0) 980 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:44.798074+0000 mgr.y (mgr.24389) 170 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: cluster 2024-04-19T22:49:44.819926+0000 mgr.y (mgr.24389) 171 : cluster 0 pgmap v120: 1188 pgs: 1 unknown, 788 creating+peering, 399 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.658740+0000 mon.a (mon.0) 965 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:49:47.476 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.666226+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.666504+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.666740+0000 mon.a (mon.0) 968 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.666937+0000 mon.a (mon.0) 969 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667103+0000 mon.a (mon.0) 970 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667247+0000 mon.a (mon.0) 971 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667366+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667511+0000 mon.a (mon.0) 973 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667642+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667793+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.667940+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.668064+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.668196+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:45.680128+0000 mon.c (mon.2) 37 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:46.435553+0000 mon.c (mon.2) 38 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: cluster 2024-04-19T22:49:46.604765+0000 mon.a (mon.0) 979 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-04-19T22:49:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21528]: audit 2024-04-19T22:49:46.612359+0000 mon.a (mon.0) 980 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:44.798074+0000 mgr.y (mgr.24389) 170 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: cluster 2024-04-19T22:49:44.819926+0000 mgr.y (mgr.24389) 171 : cluster 0 pgmap v120: 1188 pgs: 1 unknown, 788 creating+peering, 399 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.658740+0000 mon.a (mon.0) 965 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.666226+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.666504+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi113-63878-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.666740+0000 mon.a (mon.0) 968 : audit 1 from='client.? 172.21.15.113:0/213987194' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi113-63857-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.666937+0000 mon.a (mon.0) 969 : audit 1 from='client.? 172.21.15.113:0/3518434847' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667103+0000 mon.a (mon.0) 970 : audit 1 from='client.? 172.21.15.113:0/365504564' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64320-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667247+0000 mon.a (mon.0) 971 : audit 1 from='client.? 172.21.15.113:0/4218313900' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi113-64042-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667366+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi113-63955-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667511+0000 mon.a (mon.0) 973 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi113-63873-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667642+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi113-63998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667793+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64181-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.667940+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi113-64071-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.668064+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi113-64131-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.668196+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:45.680128+0000 mon.c (mon.2) 37 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:46.435553+0000 mon.c (mon.2) 38 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: cluster 2024-04-19T22:49:46.604765+0000 mon.a (mon.0) 979 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-04-19T22:49:47.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:47 smithi178 bash[23441]: audit 2024-04-19T22:49:46.612359+0000 mon.a (mon.0) 980 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:47.590 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=5 expecte api_c_read_operations: Running main() from gmock_main.cc 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (1604 ms) 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (57 ms) 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (21 ms) 2024-04-19T22:49:47.591 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (18 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (4 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (12 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (5 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (5 ms) 2024-04-19T22:49:47.592 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (4 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (8 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (9 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (7 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (3 ms) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (1772 ms total) 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-04-19T22:49:47.593 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (18080 ms total) 2024-04-19T22:49:47.594 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-04-19T22:49:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: starting. 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: creating pool ceph_test_rados_list_parallel.smithi113-64325 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: created object 0... 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: created object 25... 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: created object 49... 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: finishing. 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_1_[64336]: shutting down. 2024-04-19T22:49:47.968 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: starting. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: listing objects. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: listed object 0... 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: listed object 25... 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: saw 50 objects 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_2_[64337]: shutting down. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: starting. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: creating pool ceph_test_rados_list_parallel.smithi113-64325 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: created object 0... 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: created object 25... 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: created object 49... 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: finishing. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_3_[65487]: shutting down. 2024-04-19T22:49:47.969 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: starting. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: removed 25 objects... 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: removed half of the objects 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: removed 50 objects... 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: removed 50 objects 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_5_[65489]: shutting down. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_4_[65488]: starting. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_4_[65488]: listing objects. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_4_[65488]: saw 0 objects 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_4_[65488]: shutting down. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: starting. 2024-04-19T22:49:47.970 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: creating pool ceph_test_rados_list_parallel.smithi113-64325 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: created object 0... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: created object 25... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: created object 49... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: finishing. 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_6_[65586]: shutting down. 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: starting. 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: listing objects. 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: listed object 0... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: listed object 25... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: listed object 50... 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: saw 59 objects 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_7_[65587]: shutting down. 2024-04-19T22:49:47.971 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: starting. 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: added 25 objects... 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: added half of the objects 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: added 50 objects... 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: added 50 objects 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_8_[65588]: shutting down. 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:47.972 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: starting. 2024-04-19T22:49:48.449 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: creating pool ceph_test_rados_list_parallel.smithi113-64325 2024-04-19T22:49:48.449 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: created object 0... 2024-04-19T22:49:48.449 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: created object 25... 2024-04-19T22:49:48.449 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: created object 49... 2024-04-19T22:49:48.449 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: finishing. 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_9_[65634]: shutting down. 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: starting. 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: listing objects. 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: listed object 0... 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: listed object 25... 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: listed object 50... 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: listed object 75... 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: saw 97 objects 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_10_[65635]: shutting down. 2024-04-19T22:49:48.450 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: starting. 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: removed 25 objects... 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: removed half of the objects 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: removed 50 objects... 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: removed 50 objects 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_13_[65638]: shutting down. 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: starting. 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: added 25 objects... 2024-04-19T22:49:48.451 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: added half of the objects 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: added 50 objects... 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: added 50 objects 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_12_[65637]: shutting down. 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: starting. 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: added 25 objects... 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: added half of the objects 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: added 50 objects... 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: added 50 objects 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_11_[65636]: shutting down. 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.452 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: starting. 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: creating pool ceph_test_rados_list_parallel.smithi113-64325 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: created object 0... 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: created object 25... 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: created object 49... 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: finishing. 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_14_[65716]: shutting down. 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: starting. 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listing objects. 2024-04-19T22:49:48.453 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object 0... 2024-04-19T22:49:48.454 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object 25... 2024-04-19T22:49:48.454 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object 50... 2024-04-19T22:49:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: cluster 2024-04-19T22:49:46.821659+0000 mgr.y (mgr.24389) 172 : cluster 0 pgmap v122: 1188 pgs: 96 unknown, 725 creating+peering, 367 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-04-19T22:49:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: cluster 2024-04-19T22:49:47.065868+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-04-19T22:49:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.077218+0000 mon.a (mon.0) 982 : audit 0 from='client.? 172.21.15.113:0/2523296865' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.077722+0000 mon.a (mon.0) 983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.083417+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.083569+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.083675+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.115735+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: audit 2024-04-19T22:49:47.436765+0000 mon.c (mon.2) 39 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[21528]: cluster 2024-04-19T22:49:47.588479+0000 mon.a (mon.0) 987 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: cluster 2024-04-19T22:49:46.821659+0000 mgr.y (mgr.24389) 172 : cluster 0 pgmap v122: 1188 pgs: 96 unknown, 725 creating+peering, 367 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: cluster 2024-04-19T22:49:47.065868+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.077218+0000 mon.a (mon.0) 982 : audit 0 from='client.? 172.21.15.113:0/2523296865' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.077722+0000 mon.a (mon.0) 983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.083417+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:48.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.083569+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:49:48.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.083675+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:48.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.115735+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:48.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: audit 2024-04-19T22:49:47.436765+0000 mon.c (mon.2) 39 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:48.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:48 smithi113 bash[28910]: cluster 2024-04-19T22:49:47.588479+0000 mon.a (mon.0) 987 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: cluster 2024-04-19T22:49:46.821659+0000 mgr.y (mgr.24389) 172 : cluster 0 pgmap v122: 1188 pgs: 96 unknown, 725 creating+peering, 367 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: cluster 2024-04-19T22:49:47.065868+0000 mon.a (mon.0) 981 : cluster 3 Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.077218+0000 mon.a (mon.0) 982 : audit 0 from='client.? 172.21.15.113:0/2523296865' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.077722+0000 mon.a (mon.0) 983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.083417+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi113-64557-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:48.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.083569+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi113-64658-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:49:48.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.083675+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.113:0/424032424' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:48.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.115735+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:48.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: audit 2024-04-19T22:49:47.436765+0000 mon.c (mon.2) 39 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:48.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:48 smithi178 bash[23441]: cluster 2024-04-19T22:49:47.588479+0000 mon.a (mon.0) 987 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (19087 ms) 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (19087 ms total) 2024-04-19T22:49:48.608 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: 2024-04-19T22:49:48.609 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-04-19T22:49:48.609 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (19087 ms total) 2024-04-19T22:49:48.609 INFO:tasks.workunit.client.0.smithi113.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-04-19T22:49:49.579 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: Running main() from gmock_main.cc 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [----------] Global test environment set-up. 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (20000 ms) 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [----------] 1 test from neocls_handler_error (20001 ms total) 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [----------] Global test environment tear-down 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [==========] 1 test from 1 test suite ran. (20001 ms total) 2024-04-19T22:49:49.580 INFO:tasks.workunit.client.0.smithi113.stdout: handler_error: [ PASSED ] 1 test. 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (55 ms) 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (49 ms) 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (20033 ms) 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (20137 ms total) 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: 2024-04-19T22:49:49.601 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-04-19T22:49:49.602 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (20138 ms total) 2024-04-19T22:49:49.602 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-04-19T22:49:49.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[21528]: audit 2024-04-19T22:49:48.438302+0000 mon.c (mon.2) 40 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:49.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[21528]: audit 2024-04-19T22:49:48.605551+0000 mon.c (mon.2) 41 : audit 1 from='client.? 172.21.15.113:0/129407285' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:49.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[21528]: cluster 2024-04-19T22:49:48.605634+0000 mon.a (mon.0) 988 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-04-19T22:49:49.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[21528]: audit 2024-04-19T22:49:48.619183+0000 mon.a (mon.0) 989 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[21528]: audit 2024-04-19T22:49:48.649429+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[28910]: audit 2024-04-19T22:49:48.438302+0000 mon.c (mon.2) 40 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[28910]: audit 2024-04-19T22:49:48.605551+0000 mon.c (mon.2) 41 : audit 1 from='client.? 172.21.15.113:0/129407285' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[28910]: cluster 2024-04-19T22:49:48.605634+0000 mon.a (mon.0) 988 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[28910]: audit 2024-04-19T22:49:48.619183+0000 mon.a (mon.0) 989 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:49.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:49 smithi113 bash[28910]: audit 2024-04-19T22:49:48.649429+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:49.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:49 smithi178 bash[23441]: audit 2024-04-19T22:49:48.438302+0000 mon.c (mon.2) 40 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:49.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:49 smithi178 bash[23441]: audit 2024-04-19T22:49:48.605551+0000 mon.c (mon.2) 41 : audit 1 from='client.? 172.21.15.113:0/129407285' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:49.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:49 smithi178 bash[23441]: cluster 2024-04-19T22:49:48.605634+0000 mon.a (mon.0) 988 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-04-19T22:49:49.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:49 smithi178 bash[23441]: audit 2024-04-19T22:49:48.619183+0000 mon.a (mon.0) 989 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:49.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:49 smithi178 bash[23441]: audit 2024-04-19T22:49:48.649429+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: 75... 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object 100... 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: listed object 125... 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: saw 150 objects 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_15_[65717]: shutting down. 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.393 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: starting. 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: added 25 objects... 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: added half of the objects 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: added 50 objects... 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: added 50 objects 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: process_16_[65718]: shutting down. 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******************************* 2024-04-19T22:49:51.394 INFO:tasks.workunit.client.0.smithi113.stdout: list_parallel: ******* SUCCESS ********** 2024-04-19T22:49:51.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[21528]: cluster 2024-04-19T22:49:48.822506+0000 mgr.y (mgr.24389) 173 : cluster 0 pgmap v125: 908 pgs: 168 unknown, 421 creating+peering, 319 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 7 op/s 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[21528]: audit 2024-04-19T22:49:49.440403+0000 mon.c (mon.2) 42 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[21528]: cluster 2024-04-19T22:49:49.526472+0000 mon.a (mon.0) 990 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[21528]: audit 2024-04-19T22:49:49.550298+0000 mon.a (mon.0) 991 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[21528]: audit 2024-04-19T22:49:49.550815+0000 mon.a (mon.0) 992 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[28910]: cluster 2024-04-19T22:49:48.822506+0000 mgr.y (mgr.24389) 173 : cluster 0 pgmap v125: 908 pgs: 168 unknown, 421 creating+peering, 319 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 7 op/s 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[28910]: audit 2024-04-19T22:49:49.440403+0000 mon.c (mon.2) 42 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[28910]: cluster 2024-04-19T22:49:49.526472+0000 mon.a (mon.0) 990 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[28910]: audit 2024-04-19T22:49:49.550298+0000 mon.a (mon.0) 991 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:51.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:51 smithi113 bash[28910]: audit 2024-04-19T22:49:49.550815+0000 mon.a (mon.0) 992 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:51.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:51 smithi178 bash[23441]: cluster 2024-04-19T22:49:48.822506+0000 mgr.y (mgr.24389) 173 : cluster 0 pgmap v125: 908 pgs: 168 unknown, 421 creating+peering, 319 active+clean; 584 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 7 op/s 2024-04-19T22:49:51.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:51 smithi178 bash[23441]: audit 2024-04-19T22:49:49.440403+0000 mon.c (mon.2) 42 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:51.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:51 smithi178 bash[23441]: cluster 2024-04-19T22:49:49.526472+0000 mon.a (mon.0) 990 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:51.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:51 smithi178 bash[23441]: audit 2024-04-19T22:49:49.550298+0000 mon.a (mon.0) 991 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:51.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:51 smithi178 bash[23441]: audit 2024-04-19T22:49:49.550815+0000 mon.a (mon.0) 992 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:49.554520+0000 mon.a (mon.0) 993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:49.554595+0000 mon.a (mon.0) 994 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:49.587540+0000 mon.c (mon.2) 43 : audit 1 from='client.? 172.21.15.113:0/1064820259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:50.443829+0000 mon.c (mon.2) 44 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: cluster 2024-04-19T22:49:50.827401+0000 mgr.y (mgr.24389) 174 : cluster 0 pgmap v127: 820 pgs: 45 creating+activating, 126 creating+peering, 28 unknown, 621 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 9.3 MiB/s rd, 19 MiB/s wr, 556 op/s 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.339524+0000 mon.a (mon.0) 995 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.362755+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.363058+0000 mon.a (mon.0) 997 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.363255+0000 mgr.y (mgr.24389) 175 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.363330+0000 mon.a (mon.0) 998 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.363617+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.365047+0000 mon.a (mon.0) 1000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.373060+0000 mon.a (mon.0) 1001 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.384653+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.386955+0000 mon.a (mon.0) 1003 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:49.554520+0000 mon.a (mon.0) 993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:49.554595+0000 mon.a (mon.0) 994 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:49.587540+0000 mon.c (mon.2) 43 : audit 1 from='client.? 172.21.15.113:0/1064820259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:50.443829+0000 mon.c (mon.2) 44 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: cluster 2024-04-19T22:49:50.827401+0000 mgr.y (mgr.24389) 174 : cluster 0 pgmap v127: 820 pgs: 45 creating+activating, 126 creating+peering, 28 unknown, 621 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 9.3 MiB/s rd, 19 MiB/s wr, 556 op/s 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.339524+0000 mon.a (mon.0) 995 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.362755+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.363058+0000 mon.a (mon.0) 997 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.363255+0000 mgr.y (mgr.24389) 175 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.363330+0000 mon.a (mon.0) 998 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.363617+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.365047+0000 mon.a (mon.0) 1000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.373060+0000 mon.a (mon.0) 1001 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.384653+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.386955+0000 mon.a (mon.0) 1003 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.388137+0000 mon.a (mon.0) 1004 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.390590+0000 mgr.y (mgr.24389) 176 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.396991+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.398357+0000 mon.c (mon.2) 45 : audit 1 from='client.? 172.21.15.113:0/2218351160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.406019+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.406319+0000 mon.a (mon.0) 1007 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.406684+0000 mgr.y (mgr.24389) 177 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.406742+0000 mon.a (mon.0) 1008 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.410819+0000 osd.3 (osd.3) 3 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.453957+0000 mon.c (mon.2) 46 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.491716+0000 osd.3 (osd.3) 4 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.857369+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.858919+0000 mon.a (mon.0) 1010 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.863207+0000 mon.c (mon.2) 47 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:51.863383+0000 mon.c (mon.2) 48 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.264756+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.265147+0000 mon.a (mon.0) 1012 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.388137+0000 mon.a (mon.0) 1004 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.390590+0000 mgr.y (mgr.24389) 176 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.396991+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.398357+0000 mon.c (mon.2) 45 : audit 1 from='client.? 172.21.15.113:0/2218351160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.406019+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.406319+0000 mon.a (mon.0) 1007 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.406684+0000 mgr.y (mgr.24389) 177 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.406742+0000 mon.a (mon.0) 1008 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.410819+0000 osd.3 (osd.3) 3 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.453957+0000 mon.c (mon.2) 46 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.491716+0000 osd.3 (osd.3) 4 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.857369+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.858919+0000 mon.a (mon.0) 1010 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.863207+0000 mon.c (mon.2) 47 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:51.863383+0000 mon.c (mon.2) 48 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.264756+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:53.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.265147+0000 mon.a (mon.0) 1012 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.265573+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.266133+0000 mon.a (mon.0) 1014 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.266193+0000 mon.c (mon.2) 49 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.266897+0000 mon.c (mon.2) 50 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.266947+0000 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.267313+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.267578+0000 mon.a (mon.0) 1017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.267952+0000 mon.c (mon.2) 51 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.268251+0000 mon.c (mon.2) 52 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.268325+0000 mon.a (mon.0) 1018 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.268742+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.269051+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[21528]: audit 2024-04-19T22:49:52.269248+0000 mon.a (mon.0) 1021 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.265573+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.266133+0000 mon.a (mon.0) 1014 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.266193+0000 mon.c (mon.2) 49 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.266897+0000 mon.c (mon.2) 50 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.266947+0000 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.267313+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.267578+0000 mon.a (mon.0) 1017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.267952+0000 mon.c (mon.2) 51 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.268251+0000 mon.c (mon.2) 52 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.268325+0000 mon.a (mon.0) 1018 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.268742+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.269051+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:53 smithi113 bash[28910]: audit 2024-04-19T22:49:52.269248+0000 mon.a (mon.0) 1021 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:49.554520+0000 mon.a (mon.0) 993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:49:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:49.554595+0000 mon.a (mon.0) 994 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:49.587540+0000 mon.c (mon.2) 43 : audit 1 from='client.? 172.21.15.113:0/1064820259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:50.443829+0000 mon.c (mon.2) 44 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: cluster 2024-04-19T22:49:50.827401+0000 mgr.y (mgr.24389) 174 : cluster 0 pgmap v127: 820 pgs: 45 creating+activating, 126 creating+peering, 28 unknown, 621 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 9.3 MiB/s rd, 19 MiB/s wr, 556 op/s 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.339524+0000 mon.a (mon.0) 995 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.362755+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.363058+0000 mon.a (mon.0) 997 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.363255+0000 mgr.y (mgr.24389) 175 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.363330+0000 mon.a (mon.0) 998 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.363617+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.365047+0000 mon.a (mon.0) 1000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.373060+0000 mon.a (mon.0) 1001 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.384653+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.386955+0000 mon.a (mon.0) 1003 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.388137+0000 mon.a (mon.0) 1004 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.390590+0000 mgr.y (mgr.24389) 176 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.396991+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.398357+0000 mon.c (mon.2) 45 : audit 1 from='client.? 172.21.15.113:0/2218351160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.406019+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.406319+0000 mon.a (mon.0) 1007 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.406684+0000 mgr.y (mgr.24389) 177 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.406742+0000 mon.a (mon.0) 1008 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.410819+0000 osd.3 (osd.3) 3 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.453957+0000 mon.c (mon.2) 46 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.491716+0000 osd.3 (osd.3) 4 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.857369+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.858919+0000 mon.a (mon.0) 1010 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.863207+0000 mon.c (mon.2) 47 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:51.863383+0000 mon.c (mon.2) 48 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.264756+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.265147+0000 mon.a (mon.0) 1012 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.265573+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.266133+0000 mon.a (mon.0) 1014 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.266193+0000 mon.c (mon.2) 49 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.266897+0000 mon.c (mon.2) 50 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.266947+0000 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.267313+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.267578+0000 mon.a (mon.0) 1017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.267952+0000 mon.c (mon.2) 51 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.268251+0000 mon.c (mon.2) 52 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.268325+0000 mon.a (mon.0) 1018 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.268742+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.269051+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:53 smithi178 bash[23441]: audit 2024-04-19T22:49:52.269248+0000 mon.a (mon.0) 1021 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:53.617 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: Running main() from gmock_main.cc 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [----------] Global test environment set-up. 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (14886 ms) 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (110 ms) 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (8738 ms) 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:49.554520+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi113-64174-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:49:53.618 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:49.554595+0000 mon.a [INF] from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:49.587540+0000 mon.c [INF] from='client.? 172.21.15.113:0/1064820259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.362755+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.363058+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.363330+0000 mon.a [INF] from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.363617+0000 mon.a [INF] from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.365047+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi113-63833-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.384653+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.386955+0000 mon.a [INF] from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.388137+0000 mon.a [INF] from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.396991+0000 mon.a [INF] from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.398357+0000 mon.c [INF] from='client.? 172.21.15.113:0/2218351160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.406019+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.406319+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:49:53.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.406742+0000 mon.a [INF] from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.857369+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.858919+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.863207+0000 mon.c [INF] from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:51.863383+0000 mon.c [INF] from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.264756+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.265147+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.265573+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.266133+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.266193+0000 mon.c [INF] from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.266897+0000 mon.c [INF] from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.266947+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.267313+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.267578+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:53.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.267952+0000 mon.c [INF] from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:55.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:49:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:49:55.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.268251+0000 mon.c [INF] from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:55.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.268325+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:55.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.268742+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.269051+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.269248+0000 mon.a [INF] from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.720391+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722068+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722245+0000 mon.a [INF] from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722366+0000 mon.a [INF] from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722523+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722659+0000 mon.a [INF] from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.722894+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.723144+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.727752+0000 mon.c [INF] from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:55.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.733196+0000 mon.c [INF] from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:51.857677+0000 mgr.y (mgr.24389) 178 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:51.859205+0000 mgr.y (mgr.24389) 179 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.265010+0000 mgr.y (mgr.24389) 180 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.266388+0000 mgr.y (mgr.24389) 181 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.267498+0000 mgr.y (mgr.24389) 182 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.268460+0000 mgr.y (mgr.24389) 183 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.269398+0000 mgr.y (mgr.24389) 184 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.379410+0000 osd.0 (osd.0) 3 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.382205+0000 osd.0 (osd.0) 4 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.455390+0000 mon.c (mon.2) 53 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.720391+0000 mon.a (mon.0) 1022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722068+0000 mon.a (mon.0) 1023 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722245+0000 mon.a (mon.0) 1024 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722366+0000 mon.a (mon.0) 1025 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722523+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722659+0000 mon.a (mon.0) 1027 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.722894+0000 mon.a (mon.0) 1028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.723144+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.727752+0000 mon.c (mon.2) 54 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.733196+0000 mon.c (mon.2) 55 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.741566+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:52.768946+0000 mon.c (mon.2) 56 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.828393+0000 mgr.y (mgr.24389) 185 : cluster 0 pgmap v130: 788 pgs: 19 creating+activating, 90 creating+peering, 252 unknown, 427 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 20 MiB/s wr, 476 op/s 2024-04-19T22:49:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.180745+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.184246+0000 mon.a (mon.0) 1031 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.193975+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.194674+0000 mon.a (mon.0) 1033 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.199029+0000 mon.a (mon.0) 1034 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.200912+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.457393+0000 mon.c (mon.2) 57 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:53.621576+0000 mon.c (mon.2) 58 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:54.060066+0000 mon.a (mon.0) 1036 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:54.060348+0000 mon.a (mon.0) 1037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: audit 2024-04-19T22:49:54.073910+0000 mon.c (mon.2) 59 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:56.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[21528]: cluster 2024-04-19T22:49:55.810086+0000 mon.a (mon.0) 1038 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:51.857677+0000 mgr.y (mgr.24389) 178 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:51.859205+0000 mgr.y (mgr.24389) 179 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.265010+0000 mgr.y (mgr.24389) 180 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.266388+0000 mgr.y (mgr.24389) 181 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.267498+0000 mgr.y (mgr.24389) 182 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.268460+0000 mgr.y (mgr.24389) 183 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.269398+0000 mgr.y (mgr.24389) 184 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.379410+0000 osd.0 (osd.0) 3 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:49:56.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.382205+0000 osd.0 (osd.0) 4 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.455390+0000 mon.c (mon.2) 53 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.720391+0000 mon.a (mon.0) 1022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722068+0000 mon.a (mon.0) 1023 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722245+0000 mon.a (mon.0) 1024 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722366+0000 mon.a (mon.0) 1025 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722523+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722659+0000 mon.a (mon.0) 1027 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.722894+0000 mon.a (mon.0) 1028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.723144+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.727752+0000 mon.c (mon.2) 54 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.733196+0000 mon.c (mon.2) 55 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.741566+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:52.768946+0000 mon.c (mon.2) 56 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.828393+0000 mgr.y (mgr.24389) 185 : cluster 0 pgmap v130: 788 pgs: 19 creating+activating, 90 creating+peering, 252 unknown, 427 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 20 MiB/s wr, 476 op/s 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.180745+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.184246+0000 mon.a (mon.0) 1031 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.193975+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.194674+0000 mon.a (mon.0) 1033 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.199029+0000 mon.a (mon.0) 1034 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.200912+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.457393+0000 mon.c (mon.2) 57 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:53.621576+0000 mon.c (mon.2) 58 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:54.060066+0000 mon.a (mon.0) 1036 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:54.060348+0000 mon.a (mon.0) 1037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: audit 2024-04-19T22:49:54.073910+0000 mon.c (mon.2) 59 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:56.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:55 smithi113 bash[28910]: cluster 2024-04-19T22:49:55.810086+0000 mon.a (mon.0) 1038 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-04-19T22:49:56.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:51.857677+0000 mgr.y (mgr.24389) 178 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:49:56.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:51.859205+0000 mgr.y (mgr.24389) 179 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:49:56.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.265010+0000 mgr.y (mgr.24389) 180 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:49:56.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.266388+0000 mgr.y (mgr.24389) 181 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.267498+0000 mgr.y (mgr.24389) 182 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.268460+0000 mgr.y (mgr.24389) 183 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.269398+0000 mgr.y (mgr.24389) 184 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.379410+0000 osd.0 (osd.0) 3 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.382205+0000 osd.0 (osd.0) 4 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.455390+0000 mon.c (mon.2) 53 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.720391+0000 mon.a (mon.0) 1022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722068+0000 mon.a (mon.0) 1023 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722245+0000 mon.a (mon.0) 1024 : audit 1 from='client.? 172.21.15.113:0/832343333' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi113-64557-1"}]': finished 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722366+0000 mon.a (mon.0) 1025 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722523+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722659+0000 mon.a (mon.0) 1027 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi113-64079-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.722894+0000 mon.a (mon.0) 1028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi113-63878-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.723144+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.727752+0000 mon.c (mon.2) 54 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.733196+0000 mon.c (mon.2) 55 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.741566+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:52.768946+0000 mon.c (mon.2) 56 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.828393+0000 mgr.y (mgr.24389) 185 : cluster 0 pgmap v130: 788 pgs: 19 creating+activating, 90 creating+peering, 252 unknown, 427 active+clean; 97 MiB data, 333 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 20 MiB/s wr, 476 op/s 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.180745+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.184246+0000 mon.a (mon.0) 1031 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.193975+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.194674+0000 mon.a (mon.0) 1033 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.199029+0000 mon.a (mon.0) 1034 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.200912+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.457393+0000 mon.c (mon.2) 57 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:53.621576+0000 mon.c (mon.2) 58 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:54.060066+0000 mon.a (mon.0) 1036 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:54.060348+0000 mon.a (mon.0) 1037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: audit 2024-04-19T22:49:54.073910+0000 mon.c (mon.2) 59 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:55 smithi178 bash[23441]: cluster 2024-04-19T22:49:55.810086+0000 mon.a (mon.0) 1038 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.741566+0000 mon.b [INF] from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:52.768946+0000 mon.c [INF] from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.184246+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.193975+0000 mon.a [INF] from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.194674+0000 mon.a [INF] from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.199029+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.200912+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.621576+0000 mon.c [INF] from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:57.102 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:54.060066+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:54.060348+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi113-64557-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:54.073910+0000 mon.c [INF] from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:53.621791+0000 client.admin [INF] onexx 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.807133+0000 mon.c [INF] from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.812899+0000 mon.a [WRN] Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:57.103 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.821639+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.822602+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd poo cls: Running main() from gmock_main.cc 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [----------] Global test environment set-up. 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [ OK ] NeoRadosCls.DNE (18024 ms) 2024-04-19T22:49:57.130 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (9538 ms) 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [----------] 2 tests from NeoRadosCls (27562 ms total) 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [----------] Global test environment tear-down 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [==========] 2 tests from 1 test suite ran. (27562 ms total) 2024-04-19T22:49:57.131 INFO:tasks.workunit.client.0.smithi113.stdout: cls: [ PASSED ] 2 tests. 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.954409+0000 osd.1 (osd.1) 3 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.956477+0000 osd.1 (osd.1) 4 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.959670+0000 osd.1 (osd.1) 5 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.005125+0000 osd.1 (osd.1) 6 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.621791+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-04-19T22:49:57.475 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.927272+0000 osd.1 (osd.1) 7 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.949213+0000 osd.1 (osd.1) 8 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:54.459030+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:54.809532+0000 mgr.y (mgr.24389) 186 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:54.832535+0000 mgr.y (mgr.24389) 187 : cluster 0 pgmap v132: 756 pgs: 203 creating+peering, 36 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 426 op/s 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.460909+0000 mon.c (mon.2) 61 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.807133+0000 mon.c (mon.2) 62 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: cluster 2024-04-19T22:49:55.812899+0000 mon.a (mon.0) 1039 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.821639+0000 mon.a (mon.0) 1040 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.822602+0000 mon.a (mon.0) 1041 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.833656+0000 mon.c (mon.2) 63 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.834613+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.835723+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.476 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[28910]: audit 2024-04-19T22:49:55.836593+0000 mon.a (mon.0) 1044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.954409+0000 osd.1 (osd.1) 3 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.956477+0000 osd.1 (osd.1) 4 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.959670+0000 osd.1 (osd.1) 5 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.005125+0000 osd.1 (osd.1) 6 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.621791+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.927272+0000 osd.1 (osd.1) 7 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.949213+0000 osd.1 (osd.1) 8 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:54.459030+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:54.809532+0000 mgr.y (mgr.24389) 186 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:54.832535+0000 mgr.y (mgr.24389) 187 : cluster 0 pgmap v132: 756 pgs: 203 creating+peering, 36 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 426 op/s 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.460909+0000 mon.c (mon.2) 61 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.807133+0000 mon.c (mon.2) 62 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: cluster 2024-04-19T22:49:55.812899+0000 mon.a (mon.0) 1039 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.821639+0000 mon.a (mon.0) 1040 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.822602+0000 mon.a (mon.0) 1041 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.833656+0000 mon.c (mon.2) 63 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.834613+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.835723+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21528]: audit 2024-04-19T22:49:55.836593+0000 mon.a (mon.0) 1044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.954409+0000 osd.1 (osd.1) 3 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.956477+0000 osd.1 (osd.1) 4 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.959670+0000 osd.1 (osd.1) 5 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.005125+0000 osd.1 (osd.1) 6 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.621791+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.927272+0000 osd.1 (osd.1) 7 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.949213+0000 osd.1 (osd.1) 8 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:54.459030+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:54.809532+0000 mgr.y (mgr.24389) 186 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:54.832535+0000 mgr.y (mgr.24389) 187 : cluster 0 pgmap v132: 756 pgs: 203 creating+peering, 36 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 426 op/s 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.460909+0000 mon.c (mon.2) 61 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:57.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.807133+0000 mon.c (mon.2) 62 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: cluster 2024-04-19T22:49:55.812899+0000 mon.a (mon.0) 1039 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.821639+0000 mon.a (mon.0) 1040 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.822602+0000 mon.a (mon.0) 1041 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.833656+0000 mon.c (mon.2) 63 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.834613+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.835723+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:57 smithi178 bash[23441]: audit 2024-04-19T22:49:55.836593+0000 mon.a (mon.0) 1044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:49:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:49:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:49:58.489 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Running main() from gmock_main.cc 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [----------] Global test environment set-up. 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: handle_notify cookie 94201940455168 notify_id 356482285568 notifier_gid 24794 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (18920 ms) 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Trying... 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: handle_notify cookie 94201953151408 notify_id 377957122049 notifier_gid 25064 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Waiting for 3.000000000s 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Timed out. 2024-04-19T22:49:58.490 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Flushing... 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: Flushed... 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (9883 ms) 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (28803 ms total) 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [----------] Global test environment tear-down 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (28803 ms total) 2024-04-19T22:49:58.491 INFO:tasks.workunit.client.0.smithi113.stdout: watch_notify: [ PASSED ] 2 tests. 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.696007+0000 osd.7 (osd.7) 3 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: cluster 2024-04-19T22:49:51.698091+0000 osd.7 (osd.7) 4 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:55.837141+0000 mon.a (mon.0) 1045 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:55.837200+0000 mon.a (mon.0) 1046 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:55.837244+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:55.837291+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:56.278089+0000 mon.c (mon.2) 64 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:56.462764+0000 mon.c (mon.2) 65 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: cluster 2024-04-19T22:49:57.093685+0000 mon.a (mon.0) 1049 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.094530+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:58.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.103813+0000 mon.a (mon.0) 1050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.108723+0000 mon.c (mon.2) 66 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: cluster 2024-04-19T22:49:57.110086+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.111127+0000 mon.a (mon.0) 1051 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.112311+0000 mon.a (mon.0) 1052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.114385+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.696007+0000 osd.7 (osd.7) 3 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: cluster 2024-04-19T22:49:51.698091+0000 osd.7 (osd.7) 4 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:55.837141+0000 mon.a (mon.0) 1045 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:55.837200+0000 mon.a (mon.0) 1046 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:55.837244+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:49:58.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:55.837291+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:56.278089+0000 mon.c (mon.2) 64 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:56.462764+0000 mon.c (mon.2) 65 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: cluster 2024-04-19T22:49:57.093685+0000 mon.a (mon.0) 1049 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.094530+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.103813+0000 mon.a (mon.0) 1050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.108723+0000 mon.c (mon.2) 66 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: cluster 2024-04-19T22:49:57.110086+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.111127+0000 mon.a (mon.0) 1051 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.112311+0000 mon.a (mon.0) 1052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.114385+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.464751+0000 mon.c (mon.2) 67 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.570892+0000 mon.c (mon.2) 68 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.572170+0000 mon.c (mon.2) 69 : audit 1 from='client.? 172.21.15.113:0/3072786724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: audit 2024-04-19T22:49:57.572405+0000 mon.c (mon.2) 70 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[21528]: cluster 2024-04-19T22:49:58.008395+0000 mon.a (mon.0) 1054 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.464751+0000 mon.c (mon.2) 67 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.570892+0000 mon.c (mon.2) 68 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:58.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.572170+0000 mon.c (mon.2) 69 : audit 1 from='client.? 172.21.15.113:0/3072786724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:58.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: audit 2024-04-19T22:49:57.572405+0000 mon.c (mon.2) 70 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:58.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:58 smithi113 bash[28910]: cluster 2024-04-19T22:49:58.008395+0000 mon.a (mon.0) 1054 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-04-19T22:49:58.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.696007+0000 osd.7 (osd.7) 3 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:49:58.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: cluster 2024-04-19T22:49:51.698091+0000 osd.7 (osd.7) 4 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:49:58.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:55.837141+0000 mon.a (mon.0) 1045 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi113-63955-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:55.837200+0000 mon.a (mon.0) 1046 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi113-63857-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:55.837244+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi113-64079-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:55.837291+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi113-63878-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:56.278089+0000 mon.c (mon.2) 64 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:56.462764+0000 mon.c (mon.2) 65 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: cluster 2024-04-19T22:49:57.093685+0000 mon.a (mon.0) 1049 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.094530+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.103813+0000 mon.a (mon.0) 1050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.108723+0000 mon.c (mon.2) 66 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: cluster 2024-04-19T22:49:57.110086+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.111127+0000 mon.a (mon.0) 1051 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.112311+0000 mon.a (mon.0) 1052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.114385+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:49:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.464751+0000 mon.c (mon.2) 67 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:49:58.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.570892+0000 mon.c (mon.2) 68 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:49:58.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.572170+0000 mon.c (mon.2) 69 : audit 1 from='client.? 172.21.15.113:0/3072786724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:49:58.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: audit 2024-04-19T22:49:57.572405+0000 mon.c (mon.2) 70 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:49:58.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:58 smithi178 bash[23441]: cluster 2024-04-19T22:49:58.008395+0000 mon.a (mon.0) 1054 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.025149+0000 osd.6 (osd.6) 3 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.029204+0000 osd.6 (osd.6) 4 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.685637+0000 osd.7 (osd.7) 5 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.688308+0000 osd.7 (osd.7) 6 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.996960+0000 osd.6 (osd.6) 5 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:52.999266+0000 osd.6 (osd.6) 6 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.690643+0000 osd.7 (osd.7) 7 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:53.694421+0000 osd.7 (osd.7) 8 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:56.834047+0000 mgr.y (mgr.24389) 188 : cluster 0 pgmap v134: 788 pgs: 203 creating+peering, 68 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:00.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.463768+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.464617+0000 mon.a (mon.0) 1056 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.468953+0000 mon.c (mon.2) 71 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.474618+0000 mon.a (mon.0) 1057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.474840+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.475119+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: cluster 2024-04-19T22:49:58.928674+0000 mon.a (mon.0) 1060 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:58.929445+0000 mon.a (mon.0) 1061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:59.379929+0000 mon.a (mon.0) 1062 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[21528]: audit 2024-04-19T22:49:59.382105+0000 mon.a (mon.0) 1063 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.025149+0000 osd.6 (osd.6) 3 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.029204+0000 osd.6 (osd.6) 4 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.685637+0000 osd.7 (osd.7) 5 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.688308+0000 osd.7 (osd.7) 6 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.996960+0000 osd.6 (osd.6) 5 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:52.999266+0000 osd.6 (osd.6) 6 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.690643+0000 osd.7 (osd.7) 7 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:53.694421+0000 osd.7 (osd.7) 8 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:56.834047+0000 mgr.y (mgr.24389) 188 : cluster 0 pgmap v134: 788 pgs: 203 creating+peering, 68 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.463768+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.464617+0000 mon.a (mon.0) 1056 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.468953+0000 mon.c (mon.2) 71 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.474618+0000 mon.a (mon.0) 1057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.474840+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.475119+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:00.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: cluster 2024-04-19T22:49:58.928674+0000 mon.a (mon.0) 1060 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-04-19T22:50:00.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:58.929445+0000 mon.a (mon.0) 1061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:00.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:59.379929+0000 mon.a (mon.0) 1062 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:00.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:49:59 smithi113 bash[28910]: audit 2024-04-19T22:49:59.382105+0000 mon.a (mon.0) 1063 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:00.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.025149+0000 osd.6 (osd.6) 3 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.029204+0000 osd.6 (osd.6) 4 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.685637+0000 osd.7 (osd.7) 5 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.688308+0000 osd.7 (osd.7) 6 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.996960+0000 osd.6 (osd.6) 5 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:52.999266+0000 osd.6 (osd.6) 6 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.690643+0000 osd.7 (osd.7) 7 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:53.694421+0000 osd.7 (osd.7) 8 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:56.834047+0000 mgr.y (mgr.24389) 188 : cluster 0 pgmap v134: 788 pgs: 203 creating+peering, 68 unknown, 517 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.463768+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.464617+0000 mon.a (mon.0) 1056 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.468953+0000 mon.c (mon.2) 71 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.474618+0000 mon.a (mon.0) 1057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.474840+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.475119+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: cluster 2024-04-19T22:49:58.928674+0000 mon.a (mon.0) 1060 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-04-19T22:50:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:58.929445+0000 mon.a (mon.0) 1061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:59.379929+0000 mon.a (mon.0) 1062 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:49:59 smithi178 bash[23441]: audit 2024-04-19T22:49:59.382105+0000 mon.a (mon.0) 1063 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [----------] Global test environment set-up. 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5714 ms) 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (55 ms) 2024-04-19T22:50:00.385 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20018 ms) 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: attempt 0 of 20 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5088 ms) 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30875 ms total) 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [----------] Global test environment tear-down 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30875 ms total) 2024-04-19T22:50:00.386 INFO:tasks.workunit.client.0.smithi113.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-04-19T22:50:01.214 INFO:tasks.workunit.client.0.smithi113.stdout:l create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.833656+0000 mon.c [INF] from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.834613+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.835723+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:55.836593+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.463768+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.464617+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.474618+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.474840+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.475119+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi113-64557-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:58.929445+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.379929+0000 mon.a [INF] from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.822737+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:01.215 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.824108+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.824216+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.824311+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.824417+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.831867+0000 mon.c [INF] from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.833575+0000 mon.c [INF] from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.836569+0000 mon.b [INF] from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.838431+0000 mon.b [INF] from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.844994+0000 mon.c [INF] from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.855439+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.856064+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.856704+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.865226+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.865461+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.216 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:49:59.895973+0000 mon.c [INF] from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.014738+0000 mon.c [INF] from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.332974+0000 mon.a [WRN] Health detail: HEALTH_WARN 17 stray daemon(s) not managed by cephadm; 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.332997+0000 mon.a [WRN] [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333008+0000 mon.a [WRN] stray daemon foo.rbd/image0 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333017+0000 mon.a [WRN] stray daemon foo.rbd/image1 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333025+0000 mon.a [WRN] stray daemon foo.rbd/image10 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333031+0000 mon.a [WRN] stray daemon foo.rbd/image11 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333040+0000 mon.a [WRN] stray daemon foo.rbd/image12 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333047+0000 mon.a [WRN] stray daemon foo.rbd/image13 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333057+0000 mon.a [WRN] stray daemon foo.rbd/image14 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333067+0000 mon.a [WRN] stray daemon foo.rbd/image15 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333074+0000 mon.a [WRN] stray daemon foo.rbd/image2 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.217 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333088+0000 mon.a [WRN] stray daemon foo.rbd/image3 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333095+0000 mon.a [WRN] stray daemon foo.rbd/image4 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333105+0000 mon.a [WRN] stray daemon foo.rbd/image5 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333111+0000 mon.a [WRN] stray daemon foo.rbd/image6 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333118+0000 mon.a [WRN] stray daemon foo.rbd/image7 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333124+0000 mon.a [WRN] stray daemon foo.rbd/image8 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333133+0000 mon.a [WRN] stray daemon foo.rbd/image9 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333140+0000 mon.a [WRN] stray daemon laundry.pid64245 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333148+0000 mon.a [WRN] [WRN] POOL_APP_NOT_ENABLED: 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333159+0000 mon.a [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333169+0000 mon.a [WRN] application not enabled on pool 'LibRadosWatchNotifyECPP_smithi113-64174-1' 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333182+0000 mon.a [WRN] application not enabled on pool 'SimpleWritesmithi113-64504-2' 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333192+0000 mon.a [WRN] application not enabled on pool 'SnapRemovesmithi113-64687-2' 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333201+0000 mon.a [WRN] application not enabled on pool 'test-rados-api-smithi113-63998-4' 2024-04-19T22:50:01.218 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333209+0000 mon.a [WRN] application not enabled on pool 'OSDCmdsmithi113-64438-2' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333217+0000 mon.a [WRN] application not enabled on pool 'ListObjectsNSsmithi113-64612-2' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333225+0000 mon.a [WRN] application not enabled on pool 'LibRadosLockECPP_smithi113-63955-10' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333243+0000 mon.a [WRN] application not enabled on pool 'LibRadosIoECPP_smithi113-63857-22' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333253+0000 mon.a [WRN] application not enabled on pool 'LibRadosStatEC_smithi113-64079-7' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333262+0000 mon.a [WRN] application not enabled on pool 'LibRadosLockEC_smithi113-63878-10' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333271+0000 mon.a [WRN] application not enabled on pool 'test-rados-api-smithi113-64022-3' 2024-04-19T22:50:01.219 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333277+0000 mon.a [WRN] application not enabled on pool 'AssertExistssmithi113-64682-2' 2024-04-19T22:50:01.443 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.3 api_io_pp: Running main() from gmock_main.cc 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] Global test environment set-up. 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: seed 63857 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (27 ms) 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (19 ms) 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (4 ms) 2024-04-19T22:50:01.444 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (5 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (3 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (4 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (4 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3 ms) 2024-04-19T22:50:01.445 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (4 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (7 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (16 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (7 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-04-19T22:50:01.446 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (3 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (6 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (132 ms total) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (4309 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (16 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-19T22:50:01.447 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2024-04-19T22:50:01.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:49:58.835213+0000 mgr.y (mgr.24389) 189 : cluster 0 pgmap v137: 852 pgs: 174 creating+peering, 236 unknown, 442 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:50:01.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.470125+0000 mon.c (mon.2) 72 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.822737+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.824108+0000 mon.a (mon.0) 1065 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.824216+0000 mon.a (mon.0) 1066 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.824311+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.824417+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.831867+0000 mon.c (mon.2) 73 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.833575+0000 mon.c (mon.2) 74 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:49:59.834612+0000 mon.a (mon.0) 1069 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.836569+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.838431+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.844994+0000 mon.c (mon.2) 75 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.855439+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:49:58.835213+0000 mgr.y (mgr.24389) 189 : cluster 0 pgmap v137: 852 pgs: 174 creating+peering, 236 unknown, 442 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.470125+0000 mon.c (mon.2) 72 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.822737+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.824108+0000 mon.a (mon.0) 1065 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.824216+0000 mon.a (mon.0) 1066 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.824311+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.824417+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.831867+0000 mon.c (mon.2) 73 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.833575+0000 mon.c (mon.2) 74 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:49:59.834612+0000 mon.a (mon.0) 1069 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.836569+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.838431+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.844994+0000 mon.c (mon.2) 75 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.855439+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.856064+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.856704+0000 mon.a (mon.0) 1072 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.865226+0000 mon.a (mon.0) 1073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.865461+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:49:59.895973+0000 mon.c (mon.2) 76 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.009996+0000 mon.c (mon.2) 77 : audit 0 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.014738+0000 mon.c (mon.2) 78 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.332974+0000 mon.a (mon.0) 1075 : cluster 3 Health detail: HEALTH_WARN 17 stray daemon(s) not managed by cephadm; 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333008+0000 mon.a (mon.0) 1077 : cluster 3 stray daemon foo.rbd/image0 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333017+0000 mon.a (mon.0) 1078 : cluster 3 stray daemon foo.rbd/image1 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333025+0000 mon.a (mon.0) 1079 : cluster 3 stray daemon foo.rbd/image10 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333031+0000 mon.a (mon.0) 1080 : cluster 3 stray daemon foo.rbd/image11 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333040+0000 mon.a (mon.0) 1081 : cluster 3 stray daemon foo.rbd/image12 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333047+0000 mon.a (mon.0) 1082 : cluster 3 stray daemon foo.rbd/image13 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333057+0000 mon.a (mon.0) 1083 : cluster 3 stray daemon foo.rbd/image14 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333067+0000 mon.a (mon.0) 1084 : cluster 3 stray daemon foo.rbd/image15 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333074+0000 mon.a (mon.0) 1085 : cluster 3 stray daemon foo.rbd/image2 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333088+0000 mon.a (mon.0) 1086 : cluster 3 stray daemon foo.rbd/image3 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.856064+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.856704+0000 mon.a (mon.0) 1072 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.865226+0000 mon.a (mon.0) 1073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.865461+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:49:59.895973+0000 mon.c (mon.2) 76 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.009996+0000 mon.c (mon.2) 77 : audit 0 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.014738+0000 mon.c (mon.2) 78 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.332974+0000 mon.a (mon.0) 1075 : cluster 3 Health detail: HEALTH_WARN 17 stray daemon(s) not managed by cephadm; 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333008+0000 mon.a (mon.0) 1077 : cluster 3 stray daemon foo.rbd/image0 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333017+0000 mon.a (mon.0) 1078 : cluster 3 stray daemon foo.rbd/image1 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333025+0000 mon.a (mon.0) 1079 : cluster 3 stray daemon foo.rbd/image10 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333031+0000 mon.a (mon.0) 1080 : cluster 3 stray daemon foo.rbd/image11 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333040+0000 mon.a (mon.0) 1081 : cluster 3 stray daemon foo.rbd/image12 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333047+0000 mon.a (mon.0) 1082 : cluster 3 stray daemon foo.rbd/image13 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333057+0000 mon.a (mon.0) 1083 : cluster 3 stray daemon foo.rbd/image14 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333067+0000 mon.a (mon.0) 1084 : cluster 3 stray daemon foo.rbd/image15 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333074+0000 mon.a (mon.0) 1085 : cluster 3 stray daemon foo.rbd/image2 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333088+0000 mon.a (mon.0) 1086 : cluster 3 stray daemon foo.rbd/image3 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333095+0000 mon.a (mon.0) 1087 : cluster 3 stray daemon foo.rbd/image4 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333105+0000 mon.a (mon.0) 1088 : cluster 3 stray daemon foo.rbd/image5 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333111+0000 mon.a (mon.0) 1089 : cluster 3 stray daemon foo.rbd/image6 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333118+0000 mon.a (mon.0) 1090 : cluster 3 stray daemon foo.rbd/image7 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333124+0000 mon.a (mon.0) 1091 : cluster 3 stray daemon foo.rbd/image8 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333133+0000 mon.a (mon.0) 1092 : cluster 3 stray daemon foo.rbd/image9 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333140+0000 mon.a (mon.0) 1093 : cluster 3 stray daemon laundry.pid64245 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333148+0000 mon.a (mon.0) 1094 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333159+0000 mon.a (mon.0) 1095 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333169+0000 mon.a (mon.0) 1096 : cluster 3 application not enabled on pool 'LibRadosWatchNotifyECPP_smithi113-64174-1' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333182+0000 mon.a (mon.0) 1097 : cluster 3 application not enabled on pool 'SimpleWritesmithi113-64504-2' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333192+0000 mon.a (mon.0) 1098 : cluster 3 application not enabled on pool 'SnapRemovesmithi113-64687-2' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333201+0000 mon.a (mon.0) 1099 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-4' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333209+0000 mon.a (mon.0) 1100 : cluster 3 application not enabled on pool 'OSDCmdsmithi113-64438-2' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333217+0000 mon.a (mon.0) 1101 : cluster 3 application not enabled on pool 'ListObjectsNSsmithi113-64612-2' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333225+0000 mon.a (mon.0) 1102 : cluster 3 application not enabled on pool 'LibRadosLockECPP_smithi113-63955-10' 2024-04-19T22:50:01.552 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333243+0000 mon.a (mon.0) 1103 : cluster 3 application not enabled on pool 'LibRadosIoECPP_smithi113-63857-22' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333253+0000 mon.a (mon.0) 1104 : cluster 3 application not enabled on pool 'LibRadosStatEC_smithi113-64079-7' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333262+0000 mon.a (mon.0) 1105 : cluster 3 application not enabled on pool 'LibRadosLockEC_smithi113-63878-10' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333271+0000 mon.a (mon.0) 1106 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-64022-3' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333277+0000 mon.a (mon.0) 1107 : cluster 3 application not enabled on pool 'AssertExistssmithi113-64682-2' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333287+0000 mon.a (mon.0) 1108 : cluster 3 application not enabled on pool 'LongNamesmithi113-64657-3' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333297+0000 mon.a (mon.0) 1109 : cluster 3 application not enabled on pool 'ReadOpsmithi113-64557-2' 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333095+0000 mon.a (mon.0) 1087 : cluster 3 stray daemon foo.rbd/image4 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333105+0000 mon.a (mon.0) 1088 : cluster 3 stray daemon foo.rbd/image5 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333111+0000 mon.a (mon.0) 1089 : cluster 3 stray daemon foo.rbd/image6 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333118+0000 mon.a (mon.0) 1090 : cluster 3 stray daemon foo.rbd/image7 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.553 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333124+0000 mon.a (mon.0) 1091 : cluster 3 stray daemon foo.rbd/image8 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333133+0000 mon.a (mon.0) 1092 : cluster 3 stray daemon foo.rbd/image9 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333140+0000 mon.a (mon.0) 1093 : cluster 3 stray daemon laundry.pid64245 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333148+0000 mon.a (mon.0) 1094 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333159+0000 mon.a (mon.0) 1095 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333169+0000 mon.a (mon.0) 1096 : cluster 3 application not enabled on pool 'LibRadosWatchNotifyECPP_smithi113-64174-1' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333182+0000 mon.a (mon.0) 1097 : cluster 3 application not enabled on pool 'SimpleWritesmithi113-64504-2' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333192+0000 mon.a (mon.0) 1098 : cluster 3 application not enabled on pool 'SnapRemovesmithi113-64687-2' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333201+0000 mon.a (mon.0) 1099 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-4' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333209+0000 mon.a (mon.0) 1100 : cluster 3 application not enabled on pool 'OSDCmdsmithi113-64438-2' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333217+0000 mon.a (mon.0) 1101 : cluster 3 application not enabled on pool 'ListObjectsNSsmithi113-64612-2' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333225+0000 mon.a (mon.0) 1102 : cluster 3 application not enabled on pool 'LibRadosLockECPP_smithi113-63955-10' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333243+0000 mon.a (mon.0) 1103 : cluster 3 application not enabled on pool 'LibRadosIoECPP_smithi113-63857-22' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333253+0000 mon.a (mon.0) 1104 : cluster 3 application not enabled on pool 'LibRadosStatEC_smithi113-64079-7' 2024-04-19T22:50:01.554 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333262+0000 mon.a (mon.0) 1105 : cluster 3 application not enabled on pool 'LibRadosLockEC_smithi113-63878-10' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333271+0000 mon.a (mon.0) 1106 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-64022-3' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333277+0000 mon.a (mon.0) 1107 : cluster 3 application not enabled on pool 'AssertExistssmithi113-64682-2' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333287+0000 mon.a (mon.0) 1108 : cluster 3 application not enabled on pool 'LongNamesmithi113-64657-3' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333297+0000 mon.a (mon.0) 1109 : cluster 3 application not enabled on pool 'ReadOpsmithi113-64557-2' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333306+0000 mon.a (mon.0) 1110 : cluster 3 application not enabled on pool 'ceph_test_rados_delete_pools_parallel.smithi113-64350' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333318+0000 mon.a (mon.0) 1111 : cluster 3 application not enabled on pool 'Xattrssmithi113-64747-3' 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.333329+0000 mon.a (mon.0) 1112 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.338577+0000 mon.a (mon.0) 1113 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.339525+0000 mon.c (mon.2) 79 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.345519+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.555 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.385252+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.113:0/1821883868' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.385463+0000 mgr.y (mgr.24389) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.469478+0000 mon.c (mon.2) 81 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.471691+0000 mon.c (mon.2) 82 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[28910]: audit 2024-04-19T22:50:00.757050+0000 mon.a (mon.0) 1115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333306+0000 mon.a (mon.0) 1110 : cluster 3 application not enabled on pool 'ceph_test_rados_delete_pools_parallel.smithi113-64350' 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333318+0000 mon.a (mon.0) 1111 : cluster 3 application not enabled on pool 'Xattrssmithi113-64747-3' 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.333329+0000 mon.a (mon.0) 1112 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.338577+0000 mon.a (mon.0) 1113 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.339525+0000 mon.c (mon.2) 79 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.345519+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.556 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.385252+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.113:0/1821883868' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.385463+0000 mgr.y (mgr.24389) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.469478+0000 mon.c (mon.2) 81 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:01.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.471691+0000 mon.c (mon.2) 82 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.557 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:01 smithi113 bash[21528]: audit 2024-04-19T22:50:00.757050+0000 mon.a (mon.0) 1115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:49:58.835213+0000 mgr.y (mgr.24389) 189 : cluster 0 pgmap v137: 852 pgs: 174 creating+peering, 236 unknown, 442 active+clean; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.470125+0000 mon.c (mon.2) 72 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.822737+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.824108+0000 mon.a (mon.0) 1065 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.824216+0000 mon.a (mon.0) 1066 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.824311+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.824417+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi113-63849-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.831867+0000 mon.c (mon.2) 73 : audit 1 from='client.? 172.21.15.113:0/8315839' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.833575+0000 mon.c (mon.2) 74 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:49:59.834612+0000 mon.a (mon.0) 1069 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.836569+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.558 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.838431+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.844994+0000 mon.c (mon.2) 75 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.855439+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.856064+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.856704+0000 mon.a (mon.0) 1072 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.865226+0000 mon.a (mon.0) 1073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.865461+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:49:59.895973+0000 mon.c (mon.2) 76 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.009996+0000 mon.c (mon.2) 77 : audit 0 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.014738+0000 mon.c (mon.2) 78 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.332974+0000 mon.a (mon.0) 1075 : cluster 3 Health detail: HEALTH_WARN 17 stray daemon(s) not managed by cephadm; 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T22:50:01.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333008+0000 mon.a (mon.0) 1077 : cluster 3 stray daemon foo.rbd/image0 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333017+0000 mon.a (mon.0) 1078 : cluster 3 stray daemon foo.rbd/image1 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333025+0000 mon.a (mon.0) 1079 : cluster 3 stray daemon foo.rbd/image10 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333031+0000 mon.a (mon.0) 1080 : cluster 3 stray daemon foo.rbd/image11 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333040+0000 mon.a (mon.0) 1081 : cluster 3 stray daemon foo.rbd/image12 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333047+0000 mon.a (mon.0) 1082 : cluster 3 stray daemon foo.rbd/image13 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333057+0000 mon.a (mon.0) 1083 : cluster 3 stray daemon foo.rbd/image14 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333067+0000 mon.a (mon.0) 1084 : cluster 3 stray daemon foo.rbd/image15 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333074+0000 mon.a (mon.0) 1085 : cluster 3 stray daemon foo.rbd/image2 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333088+0000 mon.a (mon.0) 1086 : cluster 3 stray daemon foo.rbd/image3 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333095+0000 mon.a (mon.0) 1087 : cluster 3 stray daemon foo.rbd/image4 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333105+0000 mon.a (mon.0) 1088 : cluster 3 stray daemon foo.rbd/image5 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333111+0000 mon.a (mon.0) 1089 : cluster 3 stray daemon foo.rbd/image6 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333118+0000 mon.a (mon.0) 1090 : cluster 3 stray daemon foo.rbd/image7 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.560 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333124+0000 mon.a (mon.0) 1091 : cluster 3 stray daemon foo.rbd/image8 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333133+0000 mon.a (mon.0) 1092 : cluster 3 stray daemon foo.rbd/image9 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333140+0000 mon.a (mon.0) 1093 : cluster 3 stray daemon laundry.pid64245 on host smithi113 not managed by cephadm 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333148+0000 mon.a (mon.0) 1094 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 17 pool(s) do not have an application enabled 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333159+0000 mon.a (mon.0) 1095 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333169+0000 mon.a (mon.0) 1096 : cluster 3 application not enabled on pool 'LibRadosWatchNotifyECPP_smithi113-64174-1' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333182+0000 mon.a (mon.0) 1097 : cluster 3 application not enabled on pool 'SimpleWritesmithi113-64504-2' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333192+0000 mon.a (mon.0) 1098 : cluster 3 application not enabled on pool 'SnapRemovesmithi113-64687-2' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333201+0000 mon.a (mon.0) 1099 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-4' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333209+0000 mon.a (mon.0) 1100 : cluster 3 application not enabled on pool 'OSDCmdsmithi113-64438-2' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333217+0000 mon.a (mon.0) 1101 : cluster 3 application not enabled on pool 'ListObjectsNSsmithi113-64612-2' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333225+0000 mon.a (mon.0) 1102 : cluster 3 application not enabled on pool 'LibRadosLockECPP_smithi113-63955-10' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333243+0000 mon.a (mon.0) 1103 : cluster 3 application not enabled on pool 'LibRadosIoECPP_smithi113-63857-22' 2024-04-19T22:50:01.561 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333253+0000 mon.a (mon.0) 1104 : cluster 3 application not enabled on pool 'LibRadosStatEC_smithi113-64079-7' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333262+0000 mon.a (mon.0) 1105 : cluster 3 application not enabled on pool 'LibRadosLockEC_smithi113-63878-10' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333271+0000 mon.a (mon.0) 1106 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-64022-3' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333277+0000 mon.a (mon.0) 1107 : cluster 3 application not enabled on pool 'AssertExistssmithi113-64682-2' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333287+0000 mon.a (mon.0) 1108 : cluster 3 application not enabled on pool 'LongNamesmithi113-64657-3' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333297+0000 mon.a (mon.0) 1109 : cluster 3 application not enabled on pool 'ReadOpsmithi113-64557-2' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333306+0000 mon.a (mon.0) 1110 : cluster 3 application not enabled on pool 'ceph_test_rados_delete_pools_parallel.smithi113-64350' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333318+0000 mon.a (mon.0) 1111 : cluster 3 application not enabled on pool 'Xattrssmithi113-64747-3' 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.333329+0000 mon.a (mon.0) 1112 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.338577+0000 mon.a (mon.0) 1113 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.339525+0000 mon.c (mon.2) 79 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.345519+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.385252+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.113:0/1821883868' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.385463+0000 mgr.y (mgr.24389) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-04-19T22:50:01.562 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.469478+0000 mon.c (mon.2) 81 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:01.563 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.471691+0000 mon.c (mon.2) 82 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:01.563 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:01 smithi178 bash[23441]: audit 2024-04-19T22:50:00.757050+0000 mon.a (mon.0) 1115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] 33287+0000 mon.a [WRN] application not enabled on pool 'LongNamesmithi113-64657-3' 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333297+0000 mon.a [WRN] application not enabled on pool 'ReadOpsmithi113-64557-2' 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333306+0000 mon.a [WRN] application not enabled on pool 'ceph_test_rados_delete_pools_parallel.smithi113-64350' 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333318+0000 mon.a [WRN] application not enabled on pool 'Xattrssmithi113-64747-3' 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.333329+0000 mon.a [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.338577+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:02.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.339525+0000 mon.c [INF] from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.345519+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.469478+0000 mon.c [INF] from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.757050+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.469618+0000 client.admin [INF] threexx 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:00.758452+0000 mon.c [INF] from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.197399+0000 mon.a [WRN] Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.227849+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.228304+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.228415+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.228527+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.228642+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:02.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.228768+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.469618+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-04-19T22:50:03.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:00.758452+0000 mon.c (mon.2) 83 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: cluster 2024-04-19T22:50:00.835905+0000 mgr.y (mgr.24389) 191 : cluster 0 pgmap v139: 812 pgs: 234 creating+peering, 96 unknown, 482 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: cluster 2024-04-19T22:50:01.197399+0000 mon.a (mon.0) 1116 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.227849+0000 mon.a (mon.0) 1117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.228304+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.228415+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.228527+0000 mon.a (mon.0) 1120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.228642+0000 mon.a (mon.0) 1121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.228768+0000 mon.a (mon.0) 1122 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.233315+0000 mon.c (mon.2) 84 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.240061+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.241148+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.241758+0000 mon.c (mon.2) 85 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2"}]: dispatch 2024-04-19T22:50:03.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.242849+0000 mon.c (mon.2) 86 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.330091+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.472605+0000 mon.c (mon.2) 87 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: cluster 2024-04-19T22:50:01.697604+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.698964+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.702883+0000 mon.c (mon.2) 88 : audit 1 from='client.? 172.21.15.113:0/838826280' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:01.720503+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:02.138126+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[21528]: audit 2024-04-19T22:50:02.140407+0000 mon.a (mon.0) 1126 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.469618+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-04-19T22:50:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:00.758452+0000 mon.c (mon.2) 83 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: cluster 2024-04-19T22:50:00.835905+0000 mgr.y (mgr.24389) 191 : cluster 0 pgmap v139: 812 pgs: 234 creating+peering, 96 unknown, 482 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: cluster 2024-04-19T22:50:01.197399+0000 mon.a (mon.0) 1116 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.227849+0000 mon.a (mon.0) 1117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.228304+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.228415+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.228527+0000 mon.a (mon.0) 1120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.228642+0000 mon.a (mon.0) 1121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.228768+0000 mon.a (mon.0) 1122 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.233315+0000 mon.c (mon.2) 84 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.240061+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.241148+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.241758+0000 mon.c (mon.2) 85 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2"}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.242849+0000 mon.c (mon.2) 86 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.330091+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.472605+0000 mon.c (mon.2) 87 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: cluster 2024-04-19T22:50:01.697604+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.698964+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.702883+0000 mon.c (mon.2) 88 : audit 1 from='client.? 172.21.15.113:0/838826280' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:01.720503+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:02.138126+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:02 smithi113 bash[28910]: audit 2024-04-19T22:50:02.140407+0000 mon.a (mon.0) 1126 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.469618+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-04-19T22:50:03.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:00.758452+0000 mon.c (mon.2) 83 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: cluster 2024-04-19T22:50:00.835905+0000 mgr.y (mgr.24389) 191 : cluster 0 pgmap v139: 812 pgs: 234 creating+peering, 96 unknown, 482 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: cluster 2024-04-19T22:50:01.197399+0000 mon.a (mon.0) 1116 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.227849+0000 mon.a (mon.0) 1117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.228304+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi113-64658-1"}]': finished 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.228415+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.228527+0000 mon.a (mon.0) 1120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi113-63841-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.228642+0000 mon.a (mon.0) 1121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.228768+0000 mon.a (mon.0) 1122 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.233315+0000 mon.c (mon.2) 84 : audit 1 from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.240061+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.241148+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.241758+0000 mon.c (mon.2) 85 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2"}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.242849+0000 mon.c (mon.2) 86 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.330091+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.472605+0000 mon.c (mon.2) 87 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: cluster 2024-04-19T22:50:01.697604+0000 mon.a (mon.0) 1123 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.698964+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.702883+0000 mon.c (mon.2) 88 : audit 1 from='client.? 172.21.15.113:0/838826280' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:01.720503+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:02.138126+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:02 smithi178 bash[23441]: audit 2024-04-19T22:50:02.140407+0000 mon.a (mon.0) 1126 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.233315+0000 mon.c [INF] from='client.? 172.21.15.113:0/637263045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchN delete_pools_parallel: process_1_[64513]: starting. 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: creating pool ceph_test_rados_delete_pools_parallel.smithi113-64350 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: created object 0... 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: created object 25... 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: created object 49... 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: finishing. 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_1_[64513]: shutting down. 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_2_[64515]: starting. 2024-04-19T22:50:03.940 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_2_[64515]: deleting pool ceph_test_rados_delete_pools_parallel.smithi113-64350 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_2_[64515]: shutting down. 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******************************* 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: starting. 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: creating pool ceph_test_rados_delete_pools_parallel.smithi113-64350 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: created object 0... 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: created object 25... 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: created object 49... 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: finishing. 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_3_[65882]: shutting down. 2024-04-19T22:50:03.941 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******************************* 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: starting. 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: listing objects. 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: listed object 0... 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: listed object 25... 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: saw 50 objects 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_5_[65884]: shutting down. 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******************************* 2024-04-19T22:50:03.942 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_4_[65883]: starting. 2024-04-19T22:50:03.943 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_4_[65883]: deleting pool ceph_test_rados_delete_pools_parallel.smithi113-64350 2024-04-19T22:50:03.943 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: process_4_[65883]: shutting down. 2024-04-19T22:50:03.943 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******************************* 2024-04-19T22:50:03.943 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******************************* 2024-04-19T22:50:03.943 INFO:tasks.workunit.client.0.smithi113.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: starting. 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: creating pool ceph_test_rados_open_pools_parallel.smithi113-64333 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: created object 0... 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: created object 25... 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: created object 49... 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: finishing. 2024-04-19T22:50:03.948 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_1_[64398]: shutting down. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_2_[64399]: starting. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_2_[64399]: rados_pool_create. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_2_[64399]: rados_ioctx_create. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_2_[64399]: shutting down. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: ******************************* 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: starting. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: creating pool ceph_test_rados_open_pools_parallel.smithi113-64333 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: created object 0... 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: created object 25... 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: created object 49... 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: finishing. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_3_[66177]: shutting down. 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: ******************************* 2024-04-19T22:50:03.949 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_4_[66178]: starting. 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_4_[66178]: rados_pool_create. 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_4_[66178]: rados_ioctx_create. 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: process_4_[66178]: shutting down. 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: ******************************* 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: ******************************* 2024-04-19T22:50:03.950 INFO:tasks.workunit.client.0.smithi113.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.473813+0000 mon.c (mon.2) 89 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.571032+0000 mon.a (mon.0) 1127 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.577822+0000 mon.a (mon.0) 1128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.579483+0000 mon.c (mon.2) 90 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.580174+0000 mon.a (mon.0) 1129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.580329+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.580449+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.580552+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:04.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.590392+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: cluster 2024-04-19T22:50:02.598694+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.599796+0000 mon.c (mon.2) 92 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.600261+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:02.600598+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:03.475358+0000 mon.c (mon.2) 95 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: cluster 2024-04-19T22:50:03.480325+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[28910]: audit 2024-04-19T22:50:03.481875+0000 mon.a (mon.0) 1134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.473813+0000 mon.c (mon.2) 89 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.571032+0000 mon.a (mon.0) 1127 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.577822+0000 mon.a (mon.0) 1128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.579483+0000 mon.c (mon.2) 90 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:04.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.580174+0000 mon.a (mon.0) 1129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.580329+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.580449+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.580552+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.590392+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: cluster 2024-04-19T22:50:02.598694+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.599796+0000 mon.c (mon.2) 92 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.600261+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:02.600598+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:03.475358+0000 mon.c (mon.2) 95 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: cluster 2024-04-19T22:50:03.480325+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-04-19T22:50:04.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:03 smithi113 bash[21528]: audit 2024-04-19T22:50:03.481875+0000 mon.a (mon.0) 1134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:04.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.473813+0000 mon.c (mon.2) 89 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.571032+0000 mon.a (mon.0) 1127 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.577822+0000 mon.a (mon.0) 1128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.579483+0000 mon.c (mon.2) 90 : audit 1 from='client.? 172.21.15.113:0/743407194' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.580174+0000 mon.a (mon.0) 1129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi113-63849-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.580329+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.580449+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]': finished 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.580552+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.590392+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: cluster 2024-04-19T22:50:02.598694+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.599796+0000 mon.c (mon.2) 92 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.600261+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:02.600598+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:04.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:03.475358+0000 mon.c (mon.2) 95 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:04.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: cluster 2024-04-19T22:50:03.480325+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-04-19T22:50:04.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:03 smithi178 bash[23441]: audit 2024-04-19T22:50:03.481875+0000 mon.a (mon.0) 1134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-04-19T22:50:05.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:05.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: cluster 2024-04-19T22:50:02.837248+0000 mgr.y (mgr.24389) 192 : cluster 0 pgmap v142: 764 pgs: 131 creating+peering, 232 unknown, 401 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:50:05.795 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.912961+0000 mon.a (mon.0) 1135 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.918599+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.918791+0000 mon.a (mon.0) 1137 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.918989+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.919290+0000 mon.a (mon.0) 1139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.919642+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.919969+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.923582+0000 mon.a (mon.0) 1142 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:03.948109+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.113:0/1569515298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.476848+0000 mon.c (mon.2) 97 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: cluster 2024-04-19T22:50:04.833097+0000 mon.a (mon.0) 1143 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.835429+0000 mon.a (mon.0) 1144 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.850784+0000 mon.a (mon.0) 1145 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:05.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.851216+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.852123+0000 mon.a (mon.0) 1147 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[21528]: audit 2024-04-19T22:50:04.870512+0000 mon.a (mon.0) 1148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: cluster 2024-04-19T22:50:02.837248+0000 mgr.y (mgr.24389) 192 : cluster 0 pgmap v142: 764 pgs: 131 creating+peering, 232 unknown, 401 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.912961+0000 mon.a (mon.0) 1135 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.918599+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.918791+0000 mon.a (mon.0) 1137 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.918989+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.919290+0000 mon.a (mon.0) 1139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.919642+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.919969+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.923582+0000 mon.a (mon.0) 1142 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:03.948109+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.113:0/1569515298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.476848+0000 mon.c (mon.2) 97 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: cluster 2024-04-19T22:50:04.833097+0000 mon.a (mon.0) 1143 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.835429+0000 mon.a (mon.0) 1144 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.850784+0000 mon.a (mon.0) 1145 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.851216+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.852123+0000 mon.a (mon.0) 1147 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:05 smithi113 bash[28910]: audit 2024-04-19T22:50:04.870512+0000 mon.a (mon.0) 1148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: cluster 2024-04-19T22:50:02.837248+0000 mgr.y (mgr.24389) 192 : cluster 0 pgmap v142: 764 pgs: 131 creating+peering, 232 unknown, 401 active+clean; 145 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:50:05.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.912961+0000 mon.a (mon.0) 1135 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-04-19T22:50:05.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.918599+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.918791+0000 mon.a (mon.0) 1137 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.918989+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.919290+0000 mon.a (mon.0) 1139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.919642+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.919969+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.923582+0000 mon.a (mon.0) 1142 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:03.948109+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.113:0/1569515298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.476848+0000 mon.c (mon.2) 97 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: cluster 2024-04-19T22:50:04.833097+0000 mon.a (mon.0) 1143 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.835429+0000 mon.a (mon.0) 1144 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.850784+0000 mon.a (mon.0) 1145 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.851216+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.852123+0000 mon.a (mon.0) 1147 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:05.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:05 smithi178 bash[23441]: audit 2024-04-19T22:50:04.870512+0000 mon.a (mon.0) 1148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout:otifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.240061+0000 mon.b [INF] from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.241148+0000 mon.b [INF] from='client.? 172.21.15.113:0/3137776566' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.241758+0000 mon.c [INF] from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2"}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.242849+0000 mon.c [INF] from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.330091+0000 mon.b [INF] from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:05.924 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.698964+0000 mon.b [INF] from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.702883+0000 mon.c [INF] from='client.? 172.21.15.113:0/838826280' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi113-63833-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:01.720503+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:02.138126+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi113-64174-1"}]: dispatch 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: got: 2024-04-19T22:50:02.140407+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi113-63979-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (12735 ms) 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (36469 ms total) 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [----------] Global test environment tear-down 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (36469 ms total) 2024-04-19T22:50:05.925 INFO:tasks.workunit.client.0.smithi113.stdout: api_cmd: [ PASSED ] 4 tests. 2024-04-19T22:50:06.698 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: Running main() from gmock_main.cc 2024-04-19T22:50:06.698 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [----------] Global test environment set-up. 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (23099 ms) 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (13975 ms) 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (37075 ms total) 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [----------] Global test environment tear-down 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (37075 ms total) 2024-04-19T22:50:06.699 INFO:tasks.workunit.client.0.smithi113.stdout: ec_io: [ PASSED ] 2 tests. 2024-04-19T22:50:07.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:04.820702+0000 mgr.y (mgr.24389) 193 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:07.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: cluster 2024-04-19T22:50:04.839973+0000 mgr.y (mgr.24389) 194 : cluster 0 pgmap v144: 796 pgs: 166 creating+peering, 44 unknown, 586 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324042+0000 mon.a (mon.0) 1149 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324264+0000 mon.a (mon.0) 1150 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324408+0000 mon.a (mon.0) 1151 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324564+0000 mon.a (mon.0) 1152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324673+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324852+0000 mon.a (mon.0) 1154 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.324982+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.325108+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.325228+0000 mon.a (mon.0) 1157 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.329875+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.334716+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.338099+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:04.820702+0000 mgr.y (mgr.24389) 193 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: cluster 2024-04-19T22:50:04.839973+0000 mgr.y (mgr.24389) 194 : cluster 0 pgmap v144: 796 pgs: 166 creating+peering, 44 unknown, 586 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324042+0000 mon.a (mon.0) 1149 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324264+0000 mon.a (mon.0) 1150 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324408+0000 mon.a (mon.0) 1151 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324564+0000 mon.a (mon.0) 1152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324673+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324852+0000 mon.a (mon.0) 1154 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.324982+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.325108+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:07.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.325228+0000 mon.a (mon.0) 1157 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.329875+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.334716+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.338099+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.340893+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.478319+0000 mon.c (mon.2) 100 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.793879+0000 mon.c (mon.2) 101 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.794622+0000 mon.c (mon.2) 102 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:05.795316+0000 mon.c (mon.2) 103 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: cluster 2024-04-19T22:50:06.217143+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-04-19T22:50:07.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: cluster 2024-04-19T22:50:06.218601+0000 mon.a (mon.0) 1159 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.234201+0000 mon.a (mon.0) 1160 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.235201+0000 mon.a (mon.0) 1161 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.236550+0000 mon.a (mon.0) 1162 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.237615+0000 mon.a (mon.0) 1163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.239602+0000 mon.a (mon.0) 1164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.240303+0000 mon.a (mon.0) 1165 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.250930+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.251259+0000 mon.a (mon.0) 1167 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[21528]: audit 2024-04-19T22:50:06.251631+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.340893+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.478319+0000 mon.c (mon.2) 100 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.793879+0000 mon.c (mon.2) 101 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.794622+0000 mon.c (mon.2) 102 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:05.795316+0000 mon.c (mon.2) 103 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: cluster 2024-04-19T22:50:06.217143+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: cluster 2024-04-19T22:50:06.218601+0000 mon.a (mon.0) 1159 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.234201+0000 mon.a (mon.0) 1160 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.235201+0000 mon.a (mon.0) 1161 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.236550+0000 mon.a (mon.0) 1162 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.237615+0000 mon.a (mon.0) 1163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.239602+0000 mon.a (mon.0) 1164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.240303+0000 mon.a (mon.0) 1165 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.250930+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.251259+0000 mon.a (mon.0) 1167 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:06 smithi113 bash[28910]: audit 2024-04-19T22:50:06.251631+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:04.820702+0000 mgr.y (mgr.24389) 193 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:07.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: cluster 2024-04-19T22:50:04.839973+0000 mgr.y (mgr.24389) 194 : cluster 0 pgmap v144: 796 pgs: 166 creating+peering, 44 unknown, 586 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 2.4 KiB/s wr, 17 op/s 2024-04-19T22:50:07.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324042+0000 mon.a (mon.0) 1149 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:07.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324264+0000 mon.a (mon.0) 1150 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324408+0000 mon.a (mon.0) 1151 : audit 1 from='client.? 172.21.15.113:0/3585911676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324564+0000 mon.a (mon.0) 1152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324673+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324852+0000 mon.a (mon.0) 1154 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.324982+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi113-63841-3", "field": "max_bytes", "val": "4096"}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.325108+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi113-64658-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.325228+0000 mon.a (mon.0) 1157 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.329875+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.113:0/1876604678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.334716+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.338099+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.340893+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.478319+0000 mon.c (mon.2) 100 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.793879+0000 mon.c (mon.2) 101 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.794622+0000 mon.c (mon.2) 102 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:05.795316+0000 mon.c (mon.2) 103 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: cluster 2024-04-19T22:50:06.217143+0000 mon.a (mon.0) 1158 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: cluster 2024-04-19T22:50:06.218601+0000 mon.a (mon.0) 1159 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.234201+0000 mon.a (mon.0) 1160 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.235201+0000 mon.a (mon.0) 1161 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]: dispatch 2024-04-19T22:50:07.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.236550+0000 mon.a (mon.0) 1162 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.237615+0000 mon.a (mon.0) 1163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.239602+0000 mon.a (mon.0) 1164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.240303+0000 mon.a (mon.0) 1165 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.250930+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.251259+0000 mon.a (mon.0) 1167 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:06 smithi178 bash[23441]: audit 2024-04-19T22:50:06.251631+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: objects: 198 objects, 583 KiB 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: usage: 235 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pgs: 50.515% pgs not active 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 196 creating+peering 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 192 active+clean 2024-04-19T22:50:07.631 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: io: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: client: 684 B/s rd, 0 op/s rd, 0 op/s wr 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: cluster: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: id: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: health: HEALTH_WARN 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 17 stray daemon(s) not managed by cephadm 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 27 pool(s) do not have an application enabled 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: services: 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-04-19T22:50:07.632 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: data: 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pools: 39 pools, 1188 pgs 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: objects: 210 objects, 584 KiB 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: usage: 240 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: pgs: 0.084% pgs unknown 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 66.330% pgs not active 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 788 creating+peering 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 399 active+clean 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 1 unknown 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.633 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: io: 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: client: 2.9 KiB/s rd, 2.9 KiB/s wr, 4 op/s rd, 2 op/s wr 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ OK ] LibRadosService.StatusFormat (12529 ms) 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ RUN ] LibRadosService.Status 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ OK ] LibRadosService.Status (20508 ms) 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [----------] 4 tests from LibRadosService (38146 ms total) 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [----------] Global test environment tear-down 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [==========] 4 tests from 1 test suite ran. (38146 ms total) 2024-04-19T22:50:07.634 INFO:tasks.workunit.client.0.smithi113.stdout: api_service: [ PASSED ] 4 tests. 2024-04-19T22:50:07.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:08.455 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: Running main() from gmock_main.cc 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [----------] Global test environment set-up. 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (17040 ms) 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (13231 ms) 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (8617 ms) 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [----------] 3 tests from NeoRadosCmd (38888 ms total) 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [----------] Global test environment tear-down 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [==========] 3 tests from 1 test suite ran. (38888 ms total) 2024-04-19T22:50:08.456 INFO:tasks.workunit.client.0.smithi113.stdout: cmd: [ PASSED ] 3 tests. 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: Running main() from gmock_main.cc 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] Global test environment set-up. 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStat.Stat (197 ms) 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (6 ms) 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStat.StatNS (9 ms) 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1 ms) 2024-04-19T22:50:08.457 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] 5 tests from LibRadosStat (214 ms total) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (4287 ms) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (27 ms) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (300 ms) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (413 ms) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (5027 ms total) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [----------] Global test environment tear-down 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (39045 ms total) 2024-04-19T22:50:08.458 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat: [ PASSED ] 9 tests. 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout:LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (5 ms) 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (5 ms) 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (4 ms) 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-19T22:50:08.459 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (5 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (6 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (11 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (5 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (11 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (3 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (7 ms) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (4406 ms total) 2024-04-19T22:50:08.460 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: 2024-04-19T22:50:08.461 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [----------] Global test environment tear-down 2024-04-19T22:50:08.461 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (39158 ms total) 2024-04-19T22:50:08.461 INFO:tasks.workunit.client.0.smithi113.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-04-19T22:50:08.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:08 smithi113 bash[28910]: audit 2024-04-19T22:50:06.479592+0000 mon.c (mon.2) 104 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:08.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:08 smithi113 bash[28910]: audit 2024-04-19T22:50:06.686867+0000 mon.a (mon.0) 1169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:08 smithi113 bash[21528]: audit 2024-04-19T22:50:06.479592+0000 mon.c (mon.2) 104 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:08 smithi113 bash[21528]: audit 2024-04-19T22:50:06.686867+0000 mon.a (mon.0) 1169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:08.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:08 smithi178 bash[23441]: audit 2024-04-19T22:50:06.479592+0000 mon.c (mon.2) 104 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:08.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:08 smithi178 bash[23441]: audit 2024-04-19T22:50:06.686867+0000 mon.a (mon.0) 1169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi113-64131-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:09.782 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: Running main() from gmock_main.cc 2024-04-19T22:50:09.782 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-04-19T22:50:09.782 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] Global test environment set-up. 2024-04-19T22:50:09.782 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (287 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.LockShared (27 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1007 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1006 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (6 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.Unlock (5 ms) 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-04-19T22:50:09.783 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (7 ms) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (5 ms) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] 8 tests from LibRadosLock (2350 ms total) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (5574 ms) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (5 ms) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1010 ms) 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-04-19T22:50:09.784 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1010 ms) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (10 ms) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (12 ms) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (13 ms) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (16 ms) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (7650 ms total) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [----------] Global test environment tear-down 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (40474 ms total) 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock: [ PASSED ] 16 tests. 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-04-19T22:50:09.785 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: seed 63955 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (287 ms) 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (34 ms) 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1007 ms) 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1008 ms) 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (6 ms) 2024-04-19T22:50:09.786 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (6 ms) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (8 ms) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (4 ms) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2361 ms total) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2723 ms) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (2847 ms) 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-19T22:50:09.787 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1010 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1009 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (13 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (11 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (15 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (21 ms) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (7650 ms total) 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-04-19T22:50:09.788 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (40420 ms total) 2024-04-19T22:50:09.789 INFO:tasks.workunit.client.0.smithi113.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-04-19T22:50:10.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.686964+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687045+0000 mon.a (mon.0) 1171 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687108+0000 mon.a (mon.0) 1172 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687166+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687249+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687319+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687399+0000 mon.a (mon.0) 1176 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687467+0000 mon.a (mon.0) 1177 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.687534+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.696008+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.701399+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.702049+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.703631+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: cluster 2024-04-19T22:50:06.840614+0000 mgr.y (mgr.24389) 195 : cluster 0 pgmap v147: 700 pgs: 85 creating+peering, 175 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 721 B/s wr, 1 op/s 2024-04-19T22:50:10.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.686964+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:10.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687045+0000 mon.a (mon.0) 1171 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:10.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687108+0000 mon.a (mon.0) 1172 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687166+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687249+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687319+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687399+0000 mon.a (mon.0) 1176 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687467+0000 mon.a (mon.0) 1177 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.687534+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.696008+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.701399+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.702049+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.703631+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: cluster 2024-04-19T22:50:06.840614+0000 mgr.y (mgr.24389) 195 : cluster 0 pgmap v147: 700 pgs: 85 creating+peering, 175 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 721 B/s wr, 1 op/s 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:06.849753+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:07.480943+0000 mon.c (mon.2) 109 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: cluster 2024-04-19T22:50:08.428531+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.452534+0000 mon.a (mon.0) 1180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.452804+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.454316+0000 mon.a (mon.0) 1182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.458453+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.459318+0000 mon.a (mon.0) 1184 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: cluster 2024-04-19T22:50:08.464207+0000 mon.a (mon.0) 1185 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.468935+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.470731+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.113:0/4118191643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.475090+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.113:0/3124655477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:08.488008+0000 mon.c (mon.2) 112 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:09.312562+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[21528]: audit 2024-04-19T22:50:09.312855+0000 mon.a (mon.0) 1188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:06.849753+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:07.480943+0000 mon.c (mon.2) 109 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: cluster 2024-04-19T22:50:08.428531+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.452534+0000 mon.a (mon.0) 1180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.452804+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.454316+0000 mon.a (mon.0) 1182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.458453+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.459318+0000 mon.a (mon.0) 1184 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: cluster 2024-04-19T22:50:08.464207+0000 mon.a (mon.0) 1185 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.468935+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.470731+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.113:0/4118191643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.475090+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.113:0/3124655477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:08.488008+0000 mon.c (mon.2) 112 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:09.312562+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:09 smithi113 bash[28910]: audit 2024-04-19T22:50:09.312855+0000 mon.a (mon.0) 1188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.686964+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi113-64156-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687045+0000 mon.a (mon.0) 1171 : audit 1 from='client.? 172.21.15.113:0/1017762212' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi113-63857-22"}]': finished 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687108+0000 mon.a (mon.0) 1172 : audit 1 from='client.? 172.21.15.113:0/2618400791' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi113-64079-7"}]': finished 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687166+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi113-64557-2"}]': finished 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687249+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:10.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687319+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687399+0000 mon.a (mon.0) 1176 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687467+0000 mon.a (mon.0) 1177 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.687534+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.696008+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.701399+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.113:0/3918187449' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.702049+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.113:0/1240088707' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.703631+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.113:0/3869418017' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: cluster 2024-04-19T22:50:06.840614+0000 mgr.y (mgr.24389) 195 : cluster 0 pgmap v147: 700 pgs: 85 creating+peering, 175 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 721 B/s wr, 1 op/s 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:06.849753+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:07.480943+0000 mon.c (mon.2) 109 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: cluster 2024-04-19T22:50:08.428531+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.452534+0000 mon.a (mon.0) 1180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.452804+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.454316+0000 mon.a (mon.0) 1182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.458453+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.459318+0000 mon.a (mon.0) 1184 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi113-64658-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: cluster 2024-04-19T22:50:08.464207+0000 mon.a (mon.0) 1185 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.468935+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.470731+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.113:0/4118191643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.475090+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.113:0/3124655477' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:08.488008+0000 mon.c (mon.2) 112 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:09.312562+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:09 smithi178 bash[23441]: audit 2024-04-19T22:50:09.312855+0000 mon.a (mon.0) 1188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:10.833 INFO:tasks.workunit.client.0.smithi113.stdout: list: Running main() from gmock_main.cc 2024-04-19T22:50:10.833 INFO:tasks.workunit.client.0.smithi113.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-04-19T22:50:10.833 INFO:tasks.workunit.client.0.smithi113.stdout: list: [----------] Global test environment set-up. 2024-04-19T22:50:10.833 INFO:tasks.workunit.client.0.smithi113.stdout: list: [----------] 3 tests from NeoradosList 2024-04-19T22:50:10.833 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ OK ] NeoradosList.ListObjects (23115 ms) 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ OK ] NeoradosList.ListObjectsNS (8946 ms) 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ OK ] NeoradosList.ListObjectsMany (9116 ms) 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [----------] 3 tests from NeoradosList (41177 ms total) 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [----------] Global test environment tear-down 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [==========] 3 tests from 1 test suite ran. (41177 ms total) 2024-04-19T22:50:10.834 INFO:tasks.workunit.client.0.smithi113.stdout: list: [ PASSED ] 3 tests. 2024-04-19T22:50:11.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:10 smithi113 bash[28910]: cluster 2024-04-19T22:50:08.842035+0000 mgr.y (mgr.24389) 196 : cluster 0 pgmap v149: 740 pgs: 53 creating+peering, 247 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 624 B/s wr, 1 op/s 2024-04-19T22:50:11.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:10 smithi113 bash[28910]: audit 2024-04-19T22:50:09.495889+0000 mon.c (mon.2) 113 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:11.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:10 smithi113 bash[21528]: cluster 2024-04-19T22:50:08.842035+0000 mgr.y (mgr.24389) 196 : cluster 0 pgmap v149: 740 pgs: 53 creating+peering, 247 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 624 B/s wr, 1 op/s 2024-04-19T22:50:11.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:10 smithi113 bash[21528]: audit 2024-04-19T22:50:09.495889+0000 mon.c (mon.2) 113 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:11.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:10 smithi178 bash[23441]: cluster 2024-04-19T22:50:08.842035+0000 mgr.y (mgr.24389) 196 : cluster 0 pgmap v149: 740 pgs: 53 creating+peering, 247 unknown, 440 active+clean; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 624 B/s wr, 1 op/s 2024-04-19T22:50:11.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:10 smithi178 bash[23441]: audit 2024-04-19T22:50:09.495889+0000 mon.c (mon.2) 113 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:12.566 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: Running main() from gmock_main.cc 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] Global test environment set-up. 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (190 ms) 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: no timeout :/ 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: no timeout :/ 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: no timeout :/ 2024-04-19T22:50:12.567 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: no timeout :/ 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: no timeout :/ 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (1183 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (330 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.Checksum (3 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (4 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (9 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (5 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (3 ms) 2024-04-19T22:50:12.568 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (4 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.RmXattr (10 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIo.XattrIter (6 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] 14 tests from LibRadosIo (1754 ms total) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (4198 ms) 2024-04-19T22:50:12.569 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (33 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (5 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (6 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (8 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-04-19T22:50:12.570 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (10 ms) 2024-04-19T22:50:12.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-04-19T22:50:12.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (5 ms) 2024-04-19T22:50:12.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] 10 tests from LibRadosIoEC (4275 ms total) 2024-04-19T22:50:12.571 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: 2024-04-19T22:50:12.577 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [----------] Global test environment tear-down 2024-04-19T22:50:12.578 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [==========] 24 tests from 2 test suites ran. (43277 ms total) 2024-04-19T22:50:12.578 INFO:tasks.workunit.client.0.smithi113.stdout: api_io: [ PASSED ] 24 tests. 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745056+0000 mon.a (mon.0) 1189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745262+0000 mon.a (mon.0) 1190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745428+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745624+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745809+0000 mon.a (mon.0) 1193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.745993+0000 mon.a (mon.0) 1194 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.746186+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.758885+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.759956+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:09.779169+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:10.497110+0000 mon.c (mon.2) 116 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: cluster 2024-04-19T22:50:10.783958+0000 mon.a (mon.0) 1196 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:10.803461+0000 mon.a (mon.0) 1197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: cluster 2024-04-19T22:50:10.810987+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:10.821210+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:10.823237+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:10.835829+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.113:0/823431936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: cluster 2024-04-19T22:50:11.362238+0000 mon.a (mon.0) 1201 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.368407+0000 mon.a (mon.0) 1202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.368507+0000 mon.a (mon.0) 1203 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.368571+0000 mon.a (mon.0) 1204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.376488+0000 mon.c (mon.2) 118 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.377694+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: cluster 2024-04-19T22:50:11.379117+0000 mon.a (mon.0) 1205 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.416941+0000 mon.a (mon.0) 1206 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.424074+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.429982+0000 mon.a (mon.0) 1207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.430691+0000 mon.a (mon.0) 1208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.431284+0000 mon.a (mon.0) 1209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[21528]: audit 2024-04-19T22:50:11.437002+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745056+0000 mon.a (mon.0) 1189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745262+0000 mon.a (mon.0) 1190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745428+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745624+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745809+0000 mon.a (mon.0) 1193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]': finished 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.745993+0000 mon.a (mon.0) 1194 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.746186+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.758885+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.759956+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:09.779169+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:10.497110+0000 mon.c (mon.2) 116 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: cluster 2024-04-19T22:50:10.783958+0000 mon.a (mon.0) 1196 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:10.803461+0000 mon.a (mon.0) 1197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: cluster 2024-04-19T22:50:10.810987+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:10.821210+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:10.823237+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:10.835829+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.113:0/823431936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: cluster 2024-04-19T22:50:11.362238+0000 mon.a (mon.0) 1201 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.368407+0000 mon.a (mon.0) 1202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.368507+0000 mon.a (mon.0) 1203 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.368571+0000 mon.a (mon.0) 1204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.376488+0000 mon.c (mon.2) 118 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.377694+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: cluster 2024-04-19T22:50:11.379117+0000 mon.a (mon.0) 1205 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.416941+0000 mon.a (mon.0) 1206 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.424074+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.429982+0000 mon.a (mon.0) 1207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.430691+0000 mon.a (mon.0) 1208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.431284+0000 mon.a (mon.0) 1209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:12 smithi113 bash[28910]: audit 2024-04-19T22:50:11.437002+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:12.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745056+0000 mon.a (mon.0) 1189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-4", "overlaypool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:12.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745262+0000 mon.a (mon.0) 1190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi113-63878-10"}]': finished 2024-04-19T22:50:12.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745428+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi113-63955-10"}]': finished 2024-04-19T22:50:12.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745624+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi113-63979-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:50:12.802 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745809+0000 mon.a (mon.0) 1193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-64174-6", "pg_num": 4}]': finished 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.745993+0000 mon.a (mon.0) 1194 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi113-64042-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.746186+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi113-63833-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.758885+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.759956+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:09.779169+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:10.497110+0000 mon.c (mon.2) 116 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: cluster 2024-04-19T22:50:10.783958+0000 mon.a (mon.0) 1196 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:10.803461+0000 mon.a (mon.0) 1197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: cluster 2024-04-19T22:50:10.810987+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-04-19T22:50:12.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:10.821210+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:10.823237+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:10.835829+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.113:0/823431936' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: cluster 2024-04-19T22:50:11.362238+0000 mon.a (mon.0) 1201 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.368407+0000 mon.a (mon.0) 1202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.368507+0000 mon.a (mon.0) 1203 : audit 1 from='client.? 172.21.15.113:0/2912846783' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.368571+0000 mon.a (mon.0) 1204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.376488+0000 mon.c (mon.2) 118 : audit 1 from='client.? 172.21.15.113:0/572972784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.377694+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: cluster 2024-04-19T22:50:11.379117+0000 mon.a (mon.0) 1205 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-04-19T22:50:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.416941+0000 mon.a (mon.0) 1206 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.424074+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.429982+0000 mon.a (mon.0) 1207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]: dispatch 2024-04-19T22:50:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.430691+0000 mon.a (mon.0) 1208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.431284+0000 mon.a (mon.0) 1209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:12 smithi178 bash[23441]: audit 2024-04-19T22:50:11.437002+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]: dispatch 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: Running main() from gmock_main.cc 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [----------] Global test environment set-up. 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-04-19T22:50:13.821 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolList (16952 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (4781 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4421 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (12681 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2896 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2430 ms) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [----------] 6 tests from NeoRadosPools (44161 ms total) 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [----------] Global test environment tear-down 2024-04-19T22:50:13.822 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [==========] 6 tests from 1 test suite ran. (44161 ms total) 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: pool: [ PASSED ] 6 tests. 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify_test_cb 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (1555 ms) 2024-04-19T22:50:13.823 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93916310610048 err -107 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1008 ms) 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93916310621584 err -107 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1008 ms) 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220160 cookie 93916310638528 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (12 ms) 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220160 cookie 93916310654352 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (15 ms) 2024-04-19T22:50:13.824 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220161 cookie 93916310654352 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (30 ms) 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220160 cookie 93916310654352 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220160 cookie 93916310681904 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (48 ms) 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 365072220161 cookie 93916310654352 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 369367187458 cookie 93916310654352 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3013 ms) 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93916310654352 err -107 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_cb from 24665 notify_id 390842023939 cookie 93916310654352 2024-04-19T22:50:13.825 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5015 ms) 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93916310654352 err -107 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1011 ms) 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (12715 ms total) 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: watch_notify_test_cb 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (3229 ms) 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (3229 ms total) 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: 2024-04-19T22:50:13.826 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-04-19T22:50:13.827 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (44388 ms total) 2024-04-19T22:50:13.827 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: cluster 2024-04-19T22:50:10.843000+0000 mgr.y (mgr.24389) 197 : cluster 0 pgmap v152: 768 pgs: 152 creating+peering, 132 unknown, 484 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:11.503027+0000 mon.c (mon.2) 121 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.506947+0000 mon.c (mon.2) 122 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: cluster 2024-04-19T22:50:12.507339+0000 mon.a (mon.0) 1211 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.518143+0000 mon.a (mon.0) 1212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.518241+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.518298+0000 mon.a (mon.0) 1214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.518358+0000 mon.a (mon.0) 1215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.518434+0000 mon.a (mon.0) 1216 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]': finished 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: cluster 2024-04-19T22:50:12.523820+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.525512+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.539620+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.558227+0000 mon.a (mon.0) 1218 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.562873+0000 mon.a (mon.0) 1219 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[21528]: audit 2024-04-19T22:50:12.679862+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: cluster 2024-04-19T22:50:10.843000+0000 mgr.y (mgr.24389) 197 : cluster 0 pgmap v152: 768 pgs: 152 creating+peering, 132 unknown, 484 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-04-19T22:50:14.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:11.503027+0000 mon.c (mon.2) 121 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.506947+0000 mon.c (mon.2) 122 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: cluster 2024-04-19T22:50:12.507339+0000 mon.a (mon.0) 1211 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.518143+0000 mon.a (mon.0) 1212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.518241+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.518298+0000 mon.a (mon.0) 1214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.518358+0000 mon.a (mon.0) 1215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.518434+0000 mon.a (mon.0) 1216 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]': finished 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: cluster 2024-04-19T22:50:12.523820+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.525512+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.539620+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.558227+0000 mon.a (mon.0) 1218 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.562873+0000 mon.a (mon.0) 1219 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:13 smithi113 bash[28910]: audit 2024-04-19T22:50:12.679862+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:14.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: cluster 2024-04-19T22:50:10.843000+0000 mgr.y (mgr.24389) 197 : cluster 0 pgmap v152: 768 pgs: 152 creating+peering, 132 unknown, 484 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-04-19T22:50:14.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:11.503027+0000 mon.c (mon.2) 121 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.506947+0000 mon.c (mon.2) 122 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: cluster 2024-04-19T22:50:12.507339+0000 mon.a (mon.0) 1211 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.518143+0000 mon.a (mon.0) 1212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.518241+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi113-63849-16"}]': finished 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.518298+0000 mon.a (mon.0) 1214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "overlaypool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.518358+0000 mon.a (mon.0) 1215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.518434+0000 mon.a (mon.0) 1216 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-4-cache", "mode": "writeback"}]': finished 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: cluster 2024-04-19T22:50:12.523820+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.525512+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.113:0/958160712' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.539620+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.558227+0000 mon.a (mon.0) 1218 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]: dispatch 2024-04-19T22:50:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.562873+0000 mon.a (mon.0) 1219 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]: dispatch 2024-04-19T22:50:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:13 smithi178 bash[23441]: audit 2024-04-19T22:50:12.679862+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: cluster 2024-04-19T22:50:12.844125+0000 mgr.y (mgr.24389) 198 : cluster 0 pgmap v155: 728 pgs: 112 creating+peering, 164 unknown, 452 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:50:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.508017+0000 mon.c (mon.2) 125 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.722312+0000 mon.a (mon.0) 1220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.761042+0000 mon.a (mon.0) 1221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.761137+0000 mon.a (mon.0) 1222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]': finished 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.778158+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.113:0/3314460336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:13.778651+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: cluster 2024-04-19T22:50:14.325414+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[28910]: audit 2024-04-19T22:50:14.342984+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: cluster 2024-04-19T22:50:12.844125+0000 mgr.y (mgr.24389) 198 : cluster 0 pgmap v155: 728 pgs: 112 creating+peering, 164 unknown, 452 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.508017+0000 mon.c (mon.2) 125 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.722312+0000 mon.a (mon.0) 1220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.761042+0000 mon.a (mon.0) 1221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.761137+0000 mon.a (mon.0) 1222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]': finished 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.778158+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.113:0/3314460336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:13.778651+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: cluster 2024-04-19T22:50:14.325414+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-04-19T22:50:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:14 smithi113 bash[21528]: audit 2024-04-19T22:50:14.342984+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:15.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: cluster 2024-04-19T22:50:12.844125+0000 mgr.y (mgr.24389) 198 : cluster 0 pgmap v155: 728 pgs: 112 creating+peering, 164 unknown, 452 active+clean; 145 MiB data, 753 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.508017+0000 mon.c (mon.2) 125 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.722312+0000 mon.a (mon.0) 1220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]: dispatch 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.761042+0000 mon.a (mon.0) 1221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi113-64131-12"}]': finished 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.761137+0000 mon.a (mon.0) 1222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64174-6", "mode": "writeback"}]': finished 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.778158+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.113:0/3314460336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:15.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:13.778651+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: cluster 2024-04-19T22:50:14.325414+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-04-19T22:50:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:14 smithi178 bash[23441]: audit 2024-04-19T22:50:14.342984+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:17.027 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-04-19T22:50:17.027 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-04-19T22:50:17.027 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-04-19T22:50:17.027 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-19T22:50:17.027 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (3308 ms) 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (4358 ms) 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (7666 ms total) 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (146 ms) 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify 2024-04-19T22:50:17.028 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (7057 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (8 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (12 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444604240 notify_id 446676598788 notifier_gid 25253 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (11 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444604240 notify_id 446676598786 notifier_gid 25253 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (12 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444604240 notify_id 446676598787 notifier_gid 25253 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (11 ms) 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444604240 notify_id 446676598788 notifier_gid 25253 2024-04-19T22:50:17.029 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (24 ms) 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444573872 notify_id 446676598784 notifier_gid 25253 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (26 ms) 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444835248 notify_id 446676598786 notifier_gid 25253 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (14 ms) 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: trying... 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444835248 notify_id 446676598787 notifier_gid 25253 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: timed out 2024-04-19T22:50:17.030 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushing 2024-04-19T22:50:17.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:16 smithi113 bash[21528]: audit 2024-04-19T22:50:14.347552+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:17.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:16 smithi113 bash[21528]: audit 2024-04-19T22:50:14.509432+0000 mon.c (mon.2) 126 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:17.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:16 smithi113 bash[28910]: audit 2024-04-19T22:50:14.347552+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:17.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:16 smithi113 bash[28910]: audit 2024-04-19T22:50:14.509432+0000 mon.c (mon.2) 126 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:17.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:16 smithi178 bash[23441]: audit 2024-04-19T22:50:14.347552+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:17.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:16 smithi178 bash[23441]: audit 2024-04-19T22:50:14.509432+0000 mon.c (mon.2) 126 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: seed 64156 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (1643 ms) 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-19T22:50:18.020 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (10 ms) 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (634 ms) 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (460 ms) 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (16 ms) 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (2764 ms total) 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: 2024-04-19T22:50:18.021 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (3216 ms) 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (8 ms) 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-04-19T22:50:18.022 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (21 ms) 2024-04-19T22:50:18.023 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (3245 ms total) 2024-04-19T22:50:18.023 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: 2024-04-19T22:50:18.023 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-04-19T22:50:18.023 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (48587 ms total) 2024-04-19T22:50:18.023 INFO:tasks.workunit.client.0.smithi113.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-04-19T22:50:18.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.829810+0000 mgr.y (mgr.24389) 199 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:18.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: cluster 2024-04-19T22:50:14.848980+0000 mgr.y (mgr.24389) 200 : cluster 0 pgmap v157: 592 pgs: 64 creating+peering, 528 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-04-19T22:50:18.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.880132+0000 mon.a (mon.0) 1226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]': finished 2024-04-19T22:50:18.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.880206+0000 mon.a (mon.0) 1227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:18.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.880264+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.901458+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.908015+0000 mon.b (mon.1) 55 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.919695+0000 mon.b (mon.1) 56 : audit 1 from='client.? 172.21.15.113:0/2085982402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:14.929103+0000 mon.b (mon.1) 57 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:15.511192+0000 mon.c (mon.2) 127 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.513437+0000 mon.c (mon.2) 128 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: cluster 2024-04-19T22:50:16.850107+0000 mgr.y (mgr.24389) 201 : cluster 0 pgmap v159: 616 pgs: 64 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 5.7 KiB/s wr, 4 op/s 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: cluster 2024-04-19T22:50:16.880405+0000 mon.a (mon.0) 1229 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: cluster 2024-04-19T22:50:16.881859+0000 mon.a (mon.0) 1230 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.899818+0000 mon.a (mon.0) 1231 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: cluster 2024-04-19T22:50:16.928538+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-04-19T22:50:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.943074+0000 mon.b (mon.1) 58 : audit 1 from='client.? 172.21.15.113:0/2717008757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.962586+0000 mon.b (mon.1) 59 : audit 1 from='client.? 172.21.15.113:0/776557267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.963776+0000 mon.a (mon.0) 1233 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.987432+0000 mon.a (mon.0) 1234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.987803+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.988859+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:16.989370+0000 mon.a (mon.0) 1237 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:17.006944+0000 mon.a (mon.0) 1238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:17.007389+0000 mon.a (mon.0) 1239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[21528]: audit 2024-04-19T22:50:17.515125+0000 mon.c (mon.2) 129 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.829810+0000 mgr.y (mgr.24389) 199 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: cluster 2024-04-19T22:50:14.848980+0000 mgr.y (mgr.24389) 200 : cluster 0 pgmap v157: 592 pgs: 64 creating+peering, 528 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.880132+0000 mon.a (mon.0) 1226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]': finished 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.880206+0000 mon.a (mon.0) 1227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.880264+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.901458+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.908015+0000 mon.b (mon.1) 55 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.919695+0000 mon.b (mon.1) 56 : audit 1 from='client.? 172.21.15.113:0/2085982402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:14.929103+0000 mon.b (mon.1) 57 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:15.511192+0000 mon.c (mon.2) 127 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.513437+0000 mon.c (mon.2) 128 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: cluster 2024-04-19T22:50:16.850107+0000 mgr.y (mgr.24389) 201 : cluster 0 pgmap v159: 616 pgs: 64 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 5.7 KiB/s wr, 4 op/s 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: cluster 2024-04-19T22:50:16.880405+0000 mon.a (mon.0) 1229 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-04-19T22:50:18.302 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: cluster 2024-04-19T22:50:16.881859+0000 mon.a (mon.0) 1230 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.899818+0000 mon.a (mon.0) 1231 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: cluster 2024-04-19T22:50:16.928538+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.943074+0000 mon.b (mon.1) 58 : audit 1 from='client.? 172.21.15.113:0/2717008757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.962586+0000 mon.b (mon.1) 59 : audit 1 from='client.? 172.21.15.113:0/776557267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.963776+0000 mon.a (mon.0) 1233 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.987432+0000 mon.a (mon.0) 1234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.987803+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.303 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.988859+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.304 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:16.989370+0000 mon.a (mon.0) 1237 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.304 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:17.006944+0000 mon.a (mon.0) 1238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.304 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:17.007389+0000 mon.a (mon.0) 1239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.304 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:17 smithi113 bash[28910]: audit 2024-04-19T22:50:17.515125+0000 mon.c (mon.2) 129 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.829810+0000 mgr.y (mgr.24389) 199 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: cluster 2024-04-19T22:50:14.848980+0000 mgr.y (mgr.24389) 200 : cluster 0 pgmap v157: 592 pgs: 64 creating+peering, 528 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.880132+0000 mon.a (mon.0) 1226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-4"}]': finished 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.880206+0000 mon.a (mon.0) 1227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi113-64071-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.880264+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.901458+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.113:0/1260698696' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.908015+0000 mon.b (mon.1) 55 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.919695+0000 mon.b (mon.1) 56 : audit 1 from='client.? 172.21.15.113:0/2085982402' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:14.929103+0000 mon.b (mon.1) 57 : audit 1 from='client.? 172.21.15.113:0/3725188781' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:15.511192+0000 mon.c (mon.2) 127 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.513437+0000 mon.c (mon.2) 128 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: cluster 2024-04-19T22:50:16.850107+0000 mgr.y (mgr.24389) 201 : cluster 0 pgmap v159: 616 pgs: 64 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 5.7 KiB/s wr, 4 op/s 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: cluster 2024-04-19T22:50:16.880405+0000 mon.a (mon.0) 1229 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: cluster 2024-04-19T22:50:16.881859+0000 mon.a (mon.0) 1230 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.899818+0000 mon.a (mon.0) 1231 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: cluster 2024-04-19T22:50:16.928538+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.943074+0000 mon.b (mon.1) 58 : audit 1 from='client.? 172.21.15.113:0/2717008757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.962586+0000 mon.b (mon.1) 59 : audit 1 from='client.? 172.21.15.113:0/776557267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.963776+0000 mon.a (mon.0) 1233 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.987432+0000 mon.a (mon.0) 1234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.987803+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.988859+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:16.989370+0000 mon.a (mon.0) 1237 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]: dispatch 2024-04-19T22:50:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:17.006944+0000 mon.a (mon.0) 1238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.307 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:17.007389+0000 mon.a (mon.0) 1239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:18.307 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:17 smithi178 bash[23441]: audit 2024-04-19T22:50:17.515125+0000 mon.c (mon.2) 129 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: cluster 2024-04-19T22:50:17.922177+0000 mon.a (mon.0) 1240 : cluster 3 Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940107+0000 mon.a (mon.0) 1241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940205+0000 mon.a (mon.0) 1242 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940267+0000 mon.a (mon.0) 1243 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940345+0000 mon.a (mon.0) 1244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940430+0000 mon.a (mon.0) 1245 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.940507+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: cluster 2024-04-19T22:50:17.948852+0000 mon.a (mon.0) 1247 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.957775+0000 mon.b (mon.1) 60 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:17.970357+0000 mon.a (mon.0) 1248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[21528]: audit 2024-04-19T22:50:18.516580+0000 mon.c (mon.2) 130 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: cluster 2024-04-19T22:50:17.922177+0000 mon.a (mon.0) 1240 : cluster 3 Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940107+0000 mon.a (mon.0) 1241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:19.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940205+0000 mon.a (mon.0) 1242 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940267+0000 mon.a (mon.0) 1243 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940345+0000 mon.a (mon.0) 1244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940430+0000 mon.a (mon.0) 1245 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.940507+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: cluster 2024-04-19T22:50:17.948852+0000 mon.a (mon.0) 1247 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.957775+0000 mon.b (mon.1) 60 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:17.970357+0000 mon.a (mon.0) 1248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:18 smithi113 bash[28910]: audit 2024-04-19T22:50:18.516580+0000 mon.c (mon.2) 130 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: cluster 2024-04-19T22:50:17.922177+0000 mon.a (mon.0) 1240 : cluster 3 Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940107+0000 mon.a (mon.0) 1241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi113-64156-7"}]': finished 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940205+0000 mon.a (mon.0) 1242 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940267+0000 mon.a (mon.0) 1243 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940345+0000 mon.a (mon.0) 1244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-4", "tierpool": "test-rados-api-smithi113-63998-4-cache"}]': finished 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940430+0000 mon.a (mon.0) 1245 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.940507+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi113-63833-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:19.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: cluster 2024-04-19T22:50:17.948852+0000 mon.a (mon.0) 1247 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-04-19T22:50:19.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.957775+0000 mon.b (mon.1) 60 : audit 1 from='client.? 172.21.15.113:0/1931898535' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:17.970357+0000 mon.a (mon.0) 1248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]: dispatch 2024-04-19T22:50:19.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:18 smithi178 bash[23441]: audit 2024-04-19T22:50:18.516580+0000 mon.c (mon.2) 130 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:20.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[28910]: cluster 2024-04-19T22:50:18.851012+0000 mgr.y (mgr.24389) 202 : cluster 0 pgmap v162: 776 pgs: 224 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-04-19T22:50:20.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[28910]: audit 2024-04-19T22:50:18.943907+0000 mon.a (mon.0) 1249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[28910]: cluster 2024-04-19T22:50:18.947810+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[28910]: audit 2024-04-19T22:50:19.520186+0000 mon.c (mon.2) 131 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[21528]: cluster 2024-04-19T22:50:18.851012+0000 mgr.y (mgr.24389) 202 : cluster 0 pgmap v162: 776 pgs: 224 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[21528]: audit 2024-04-19T22:50:18.943907+0000 mon.a (mon.0) 1249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[21528]: cluster 2024-04-19T22:50:18.947810+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-04-19T22:50:20.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:20 smithi113 bash[21528]: audit 2024-04-19T22:50:19.520186+0000 mon.c (mon.2) 131 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:20.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:20 smithi178 bash[23441]: cluster 2024-04-19T22:50:18.851012+0000 mgr.y (mgr.24389) 202 : cluster 0 pgmap v162: 776 pgs: 224 unknown, 64 creating+peering, 488 active+clean; 145 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2024-04-19T22:50:20.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:20 smithi178 bash[23441]: audit 2024-04-19T22:50:18.943907+0000 mon.a (mon.0) 1249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi113-64658-2"}]': finished 2024-04-19T22:50:20.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:20 smithi178 bash[23441]: cluster 2024-04-19T22:50:18.947810+0000 mon.a (mon.0) 1250 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-04-19T22:50:20.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:20 smithi178 bash[23441]: audit 2024-04-19T22:50:19.520186+0000 mon.c (mon.2) 131 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:22.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:21 smithi113 bash[21528]: audit 2024-04-19T22:50:19.644692+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:21 smithi113 bash[21528]: audit 2024-04-19T22:50:20.162270+0000 mon.a (mon.0) 1251 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:21 smithi113 bash[28910]: audit 2024-04-19T22:50:19.644692+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:21 smithi113 bash[28910]: audit 2024-04-19T22:50:20.162270+0000 mon.a (mon.0) 1251 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:22.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:21 smithi178 bash[23441]: audit 2024-04-19T22:50:19.644692+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:22.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:21 smithi178 bash[23441]: audit 2024-04-19T22:50:20.162270+0000 mon.a (mon.0) 1251 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:20.522596+0000 mon.c (mon.2) 133 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:20.851623+0000 mgr.y (mgr.24389) 203 : cluster 0 pgmap v165: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:21.523729+0000 mon.c (mon.2) 134 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:21.699487+0000 mon.a (mon.0) 1252 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:21.740146+0000 mon.a (mon.0) 1253 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:21.750858+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:21.770748+0000 mon.b (mon.1) 61 : audit 1 from='client.? 172.21.15.113:0/3096537314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:21.781174+0000 mon.b (mon.1) 62 : audit 1 from='client.? 172.21.15.113:0/1724814651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.274074+0000 mon.a (mon.0) 1254 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.286539+0000 mon.a (mon.0) 1255 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.287219+0000 mon.a (mon.0) 1256 : cluster 3 pool 'PoolQuotaPP_smithi113-63841-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.288748+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[28910]: audit 2024-04-19T22:50:22.292952+0000 mon.a (mon.0) 1258 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:20.522596+0000 mon.c (mon.2) 133 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:20.851623+0000 mgr.y (mgr.24389) 203 : cluster 0 pgmap v165: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:21.523729+0000 mon.c (mon.2) 134 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:21.699487+0000 mon.a (mon.0) 1252 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:21.740146+0000 mon.a (mon.0) 1253 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:21.750858+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:21.770748+0000 mon.b (mon.1) 61 : audit 1 from='client.? 172.21.15.113:0/3096537314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:21.781174+0000 mon.b (mon.1) 62 : audit 1 from='client.? 172.21.15.113:0/1724814651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.274074+0000 mon.a (mon.0) 1254 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-04-19T22:50:23.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.286539+0000 mon.a (mon.0) 1255 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:23.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.287219+0000 mon.a (mon.0) 1256 : cluster 3 pool 'PoolQuotaPP_smithi113-63841-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-19T22:50:23.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.288748+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T22:50:23.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:22 smithi113 bash[21528]: audit 2024-04-19T22:50:22.292952+0000 mon.a (mon.0) 1258 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:23.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:20.522596+0000 mon.c (mon.2) 133 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:20.851623+0000 mgr.y (mgr.24389) 203 : cluster 0 pgmap v165: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-04-19T22:50:23.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:21.523729+0000 mon.c (mon.2) 134 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:23.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:21.699487+0000 mon.a (mon.0) 1252 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-04-19T22:50:23.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:21.740146+0000 mon.a (mon.0) 1253 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi113-64658-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:21.750858+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:21.770748+0000 mon.b (mon.1) 61 : audit 1 from='client.? 172.21.15.113:0/3096537314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:21.781174+0000 mon.b (mon.1) 62 : audit 1 from='client.? 172.21.15.113:0/1724814651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.274074+0000 mon.a (mon.0) 1254 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.286539+0000 mon.a (mon.0) 1255 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.287219+0000 mon.a (mon.0) 1256 : cluster 3 pool 'PoolQuotaPP_smithi113-63841-3' is full (reached quota's max_bytes: 4 KiB) 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.288748+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T22:50:23.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:22 smithi178 bash[23441]: audit 2024-04-19T22:50:22.292952+0000 mon.a (mon.0) 1258 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:22.525140+0000 mon.c (mon.2) 136 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.891958+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:22.892934+0000 mon.a (mon.0) 1260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:22.898321+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:22.903629+0000 mon.a (mon.0) 1262 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:23.456639+0000 mon.a (mon.0) 1263 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[21528]: audit 2024-04-19T22:50:23.457880+0000 mon.a (mon.0) 1264 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:22.525140+0000 mon.c (mon.2) 136 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.891958+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:22.892934+0000 mon.a (mon.0) 1260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:22.898321+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:22.903629+0000 mon.a (mon.0) 1262 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:23.456639+0000 mon.a (mon.0) 1263 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:24 smithi113 bash[28910]: audit 2024-04-19T22:50:23.457880+0000 mon.a (mon.0) 1264 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:22.525140+0000 mon.c (mon.2) 136 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.891958+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:22.892934+0000 mon.a (mon.0) 1260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:22.898321+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:22.903629+0000 mon.a (mon.0) 1262 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:23.456639+0000 mon.a (mon.0) 1263 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:25.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:24 smithi178 bash[23441]: audit 2024-04-19T22:50:23.457880+0000 mon.a (mon.0) 1264 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:22.854861+0000 mgr.y (mgr.24389) 204 : cluster 0 pgmap v168: 584 pgs: 160 unknown, 424 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:22.907923+0000 mgr.y (mgr.24389) 205 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:23.368978+0000 osd.3 (osd.3) 5 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:23.375998+0000 osd.3 (osd.3) 6 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:23.456808+0000 mgr.y (mgr.24389) 206 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:23.458103+0000 mgr.y (mgr.24389) 207 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:23.467139+0000 mon.a (mon.0) 1265 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:23.467263+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:23.534728+0000 mon.c (mon.2) 137 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:23.925371+0000 osd.6 (osd.6) 7 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:23.937170+0000 osd.6 (osd.6) 8 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:23.960955+0000 osd.7 (osd.7) 9 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:24.011128+0000 osd.7 (osd.7) 10 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.543770+0000 mon.c (mon.2) 138 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:24.706771+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.731586+0000 mon.a (mon.0) 1268 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.731861+0000 mgr.y (mgr.24389) 208 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.736349+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:24.743361+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.754145+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.113:0/1480543382' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:24.837333+0000 mgr.y (mgr.24389) 209 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:26.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:24.856470+0000 mgr.y (mgr.24389) 210 : cluster 0 pgmap v171: 688 pgs: 62 creating+peering, 65 unknown, 561 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.308290+0000 osd.0 (osd.0) 5 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.315102+0000 osd.0 (osd.0) 6 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.332246+0000 mon.a (mon.0) 1271 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.335637+0000 mgr.y (mgr.24389) 211 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.364339+0000 mon.a (mon.0) 1272 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.365518+0000 mgr.y (mgr.24389) 212 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.369371+0000 mon.a (mon.0) 1273 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.371885+0000 mgr.y (mgr.24389) 213 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.373722+0000 mon.a (mon.0) 1274 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.377792+0000 mon.a (mon.0) 1275 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.378509+0000 mgr.y (mgr.24389) 214 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.384782+0000 mon.a (mon.0) 1276 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.385729+0000 mgr.y (mgr.24389) 215 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.387735+0000 mon.a (mon.0) 1277 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.389630+0000 mgr.y (mgr.24389) 216 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[28910]: audit 2024-04-19T22:50:25.544682+0000 mon.c (mon.2) 140 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:22.854861+0000 mgr.y (mgr.24389) 204 : cluster 0 pgmap v168: 584 pgs: 160 unknown, 424 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:22.907923+0000 mgr.y (mgr.24389) 205 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:23.368978+0000 osd.3 (osd.3) 5 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:23.375998+0000 osd.3 (osd.3) 6 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:23.456808+0000 mgr.y (mgr.24389) 206 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:23.458103+0000 mgr.y (mgr.24389) 207 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:23.467139+0000 mon.a (mon.0) 1265 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:23.467263+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:23.534728+0000 mon.c (mon.2) 137 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:23.925371+0000 osd.6 (osd.6) 7 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:23.937170+0000 osd.6 (osd.6) 8 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:23.960955+0000 osd.7 (osd.7) 9 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:24.011128+0000 osd.7 (osd.7) 10 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.543770+0000 mon.c (mon.2) 138 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:24.706771+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.731586+0000 mon.a (mon.0) 1268 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.731861+0000 mgr.y (mgr.24389) 208 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.736349+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:24.743361+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.754145+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.113:0/1480543382' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:24.837333+0000 mgr.y (mgr.24389) 209 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:24.856470+0000 mgr.y (mgr.24389) 210 : cluster 0 pgmap v171: 688 pgs: 62 creating+peering, 65 unknown, 561 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.308290+0000 osd.0 (osd.0) 5 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.315102+0000 osd.0 (osd.0) 6 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.332246+0000 mon.a (mon.0) 1271 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.335637+0000 mgr.y (mgr.24389) 211 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.364339+0000 mon.a (mon.0) 1272 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.365518+0000 mgr.y (mgr.24389) 212 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.369371+0000 mon.a (mon.0) 1273 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.053 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.371885+0000 mgr.y (mgr.24389) 213 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.373722+0000 mon.a (mon.0) 1274 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.377792+0000 mon.a (mon.0) 1275 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.378509+0000 mgr.y (mgr.24389) 214 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.384782+0000 mon.a (mon.0) 1276 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.385729+0000 mgr.y (mgr.24389) 215 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.387735+0000 mon.a (mon.0) 1277 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.389630+0000 mgr.y (mgr.24389) 216 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.054 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:25 smithi113 bash[21528]: audit 2024-04-19T22:50:25.544682+0000 mon.c (mon.2) 140 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:22.854861+0000 mgr.y (mgr.24389) 204 : cluster 0 pgmap v168: 584 pgs: 160 unknown, 424 active+clean; 145 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:22.907923+0000 mgr.y (mgr.24389) 205 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.0"}]: dispatch 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:23.368978+0000 osd.3 (osd.3) 5 : cluster 0 20.0 deep-scrub starts 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:23.375998+0000 osd.3 (osd.3) 6 : cluster 0 20.0 deep-scrub ok 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:23.456808+0000 mgr.y (mgr.24389) 206 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.1"}]: dispatch 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:23.458103+0000 mgr.y (mgr.24389) 207 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.2"}]: dispatch 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:23.467139+0000 mon.a (mon.0) 1265 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi113-63833-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:23.467263+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:23.534728+0000 mon.c (mon.2) 137 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:23.925371+0000 osd.6 (osd.6) 7 : cluster 0 20.1 deep-scrub starts 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:23.937170+0000 osd.6 (osd.6) 8 : cluster 0 20.1 deep-scrub ok 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:23.960955+0000 osd.7 (osd.7) 9 : cluster 0 20.2 deep-scrub starts 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:24.011128+0000 osd.7 (osd.7) 10 : cluster 0 20.2 deep-scrub ok 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.543770+0000 mon.c (mon.2) 138 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:24.706771+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.731586+0000 mon.a (mon.0) 1268 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.731861+0000 mgr.y (mgr.24389) 208 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.3"}]: dispatch 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.736349+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi113-64658-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:24.743361+0000 mon.a (mon.0) 1270 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.754145+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.113:0/1480543382' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:24.837333+0000 mgr.y (mgr.24389) 209 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:24.856470+0000 mgr.y (mgr.24389) 210 : cluster 0 pgmap v171: 688 pgs: 62 creating+peering, 65 unknown, 561 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 5 op/s 2024-04-19T22:50:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.308290+0000 osd.0 (osd.0) 5 : cluster 0 20.3 deep-scrub starts 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.315102+0000 osd.0 (osd.0) 6 : cluster 0 20.3 deep-scrub ok 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.332246+0000 mon.a (mon.0) 1271 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.335637+0000 mgr.y (mgr.24389) 211 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.4"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.364339+0000 mon.a (mon.0) 1272 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.365518+0000 mgr.y (mgr.24389) 212 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.5"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.369371+0000 mon.a (mon.0) 1273 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.371885+0000 mgr.y (mgr.24389) 213 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.6"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.373722+0000 mon.a (mon.0) 1274 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.377792+0000 mon.a (mon.0) 1275 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.378509+0000 mgr.y (mgr.24389) 214 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.7"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.384782+0000 mon.a (mon.0) 1276 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.385729+0000 mgr.y (mgr.24389) 215 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.8"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.387735+0000 mon.a (mon.0) 1277 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.389630+0000 mgr.y (mgr.24389) 216 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "20.9"}]: dispatch 2024-04-19T22:50:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:25 smithi178 bash[23441]: audit 2024-04-19T22:50:25.544682+0000 mon.c (mon.2) 140 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:27.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[21528]: audit 2024-04-19T22:50:25.743049+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.750974+0000 mon.a (mon.0) 1279 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[21528]: audit 2024-04-19T22:50:25.769311+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[21528]: audit 2024-04-19T22:50:25.788279+0000 mon.a (mon.0) 1280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[28910]: audit 2024-04-19T22:50:25.743049+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.750974+0000 mon.a (mon.0) 1279 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-04-19T22:50:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[28910]: audit 2024-04-19T22:50:25.769311+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:28 smithi113 bash[28910]: audit 2024-04-19T22:50:25.788279+0000 mon.a (mon.0) 1280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:29.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:28 smithi178 bash[23441]: audit 2024-04-19T22:50:25.743049+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:29.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:28 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.750974+0000 mon.a (mon.0) 1279 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-04-19T22:50:29.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:28 smithi178 bash[23441]: audit 2024-04-19T22:50:25.769311+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:29.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:28 smithi178 bash[23441]: audit 2024-04-19T22:50:25.788279+0000 mon.a (mon.0) 1280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.750532+0000 osd.1 (osd.1) 9 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.864204+0000 osd.1 (osd.1) 10 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.934721+0000 osd.7 (osd.7) 11 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.936321+0000 osd.7 (osd.7) 12 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.943381+0000 osd.6 (osd.6) 9 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:30.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:25.945495+0000 osd.6 (osd.6) 10 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:26.099026+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:26.554819+0000 mon.c (mon.2) 143 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:26.742771+0000 osd.1 (osd.1) 11 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:26.822159+0000 osd.1 (osd.1) 12 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:26.857158+0000 mgr.y (mgr.24389) 217 : cluster 0 pgmap v173: 592 pgs: 39 creating+peering, 97 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 16 MiB/s wr, 5 op/s 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:27.057420+0000 mon.a (mon.0) 1281 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:27.058831+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:27.080212+0000 mon.b (mon.1) 63 : audit 1 from='client.? 172.21.15.113:0/3057206297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:27.558729+0000 mon.c (mon.2) 144 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:28.559911+0000 mon.c (mon.2) 145 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:28.725219+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-04-19T22:50:30.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:28.726300+0000 mon.a (mon.0) 1284 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:28.757642+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]': finished 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: cluster 2024-04-19T22:50:28.762760+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:28.768456+0000 mon.b (mon.1) 64 : audit 1 from='client.? 172.21.15.113:0/773388889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:28.776701+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[28910]: audit 2024-04-19T22:50:29.357335+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.750532+0000 osd.1 (osd.1) 9 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.864204+0000 osd.1 (osd.1) 10 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.934721+0000 osd.7 (osd.7) 11 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.936321+0000 osd.7 (osd.7) 12 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.943381+0000 osd.6 (osd.6) 9 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:25.945495+0000 osd.6 (osd.6) 10 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:26.099026+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:26.554819+0000 mon.c (mon.2) 143 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:26.742771+0000 osd.1 (osd.1) 11 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:26.822159+0000 osd.1 (osd.1) 12 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:26.857158+0000 mgr.y (mgr.24389) 217 : cluster 0 pgmap v173: 592 pgs: 39 creating+peering, 97 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 16 MiB/s wr, 5 op/s 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:27.057420+0000 mon.a (mon.0) 1281 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:27.058831+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:27.080212+0000 mon.b (mon.1) 63 : audit 1 from='client.? 172.21.15.113:0/3057206297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:27.558729+0000 mon.c (mon.2) 144 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:28.559911+0000 mon.c (mon.2) 145 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:28.725219+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:28.726300+0000 mon.a (mon.0) 1284 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:28.757642+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]': finished 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: cluster 2024-04-19T22:50:28.762760+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:28.768456+0000 mon.b (mon.1) 64 : audit 1 from='client.? 172.21.15.113:0/773388889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:28.776701+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:30.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:29 smithi113 bash[21528]: audit 2024-04-19T22:50:29.357335+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.750532+0000 osd.1 (osd.1) 9 : cluster 0 20.4 deep-scrub starts 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.864204+0000 osd.1 (osd.1) 10 : cluster 0 20.4 deep-scrub ok 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.934721+0000 osd.7 (osd.7) 11 : cluster 0 20.7 deep-scrub starts 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.936321+0000 osd.7 (osd.7) 12 : cluster 0 20.7 deep-scrub ok 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.943381+0000 osd.6 (osd.6) 9 : cluster 0 20.8 deep-scrub starts 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:25.945495+0000 osd.6 (osd.6) 10 : cluster 0 20.8 deep-scrub ok 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:26.099026+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:26.554819+0000 mon.c (mon.2) 143 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:26.742771+0000 osd.1 (osd.1) 11 : cluster 0 20.6 deep-scrub starts 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:26.822159+0000 osd.1 (osd.1) 12 : cluster 0 20.6 deep-scrub ok 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:26.857158+0000 mgr.y (mgr.24389) 217 : cluster 0 pgmap v173: 592 pgs: 39 creating+peering, 97 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 16 MiB/s wr, 5 op/s 2024-04-19T22:50:30.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:27.057420+0000 mon.a (mon.0) 1281 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]: dispatch 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:27.058831+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:27.080212+0000 mon.b (mon.1) 63 : audit 1 from='client.? 172.21.15.113:0/3057206297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:27.558729+0000 mon.c (mon.2) 144 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:28.559911+0000 mon.c (mon.2) 145 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:28.725219+0000 mon.a (mon.0) 1283 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:28.726300+0000 mon.a (mon.0) 1284 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:28.757642+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4"}]': finished 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: cluster 2024-04-19T22:50:28.762760+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-04-19T22:50:30.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:28.768456+0000 mon.b (mon.1) 64 : audit 1 from='client.? 172.21.15.113:0/773388889' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:28.776701+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:30.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:29 smithi178 bash[23441]: audit 2024-04-19T22:50:29.357335+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:30.970 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: Running main() from gmock_main.cc 2024-04-19T22:50:30.970 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-04-19T22:50:30.970 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [----------] Global test environment set-up. 2024-04-19T22:50:30.970 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (18943 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (7190 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (7657 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (6294 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (4566 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (4614 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (11998 ms) 2024-04-19T22:50:30.971 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (61262 ms total) 2024-04-19T22:50:30.972 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: 2024-04-19T22:50:30.972 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [----------] Global test environment tear-down 2024-04-19T22:50:30.972 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (61262 ms total) 2024-04-19T22:50:30.972 INFO:tasks.workunit.client.0.smithi113.stdout: write_operations: [ PASSED ] 7 tests. 2024-04-19T22:50:31.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:26.932860+0000 osd.7 (osd.7) 13 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:31.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:26.941062+0000 osd.7 (osd.7) 14 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:31.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:27.702896+0000 osd.1 (osd.1) 13 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:27.713822+0000 osd.1 (osd.1) 14 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:28.860225+0000 mgr.y (mgr.24389) 218 : cluster 0 pgmap v175: 624 pgs: 19 creating+peering, 149 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 4 op/s 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.561074+0000 mon.c (mon.2) 147 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.931398+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.938739+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: cluster 2024-04-19T22:50:29.949254+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.960748+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.970768+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:29.972127+0000 mon.a (mon.0) 1292 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[21528]: audit 2024-04-19T22:50:30.564089+0000 mon.c (mon.2) 149 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:26.932860+0000 osd.7 (osd.7) 13 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:26.941062+0000 osd.7 (osd.7) 14 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:27.702896+0000 osd.1 (osd.1) 13 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:27.713822+0000 osd.1 (osd.1) 14 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:28.860225+0000 mgr.y (mgr.24389) 218 : cluster 0 pgmap v175: 624 pgs: 19 creating+peering, 149 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 4 op/s 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.561074+0000 mon.c (mon.2) 147 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.931398+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.938739+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: cluster 2024-04-19T22:50:29.949254+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.960748+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.970768+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:29.972127+0000 mon.a (mon.0) 1292 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:30 smithi113 bash[28910]: audit 2024-04-19T22:50:30.564089+0000 mon.c (mon.2) 149 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:26.932860+0000 osd.7 (osd.7) 13 : cluster 0 20.9 deep-scrub starts 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:26.941062+0000 osd.7 (osd.7) 14 : cluster 0 20.9 deep-scrub ok 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:27.702896+0000 osd.1 (osd.1) 13 : cluster 0 20.5 deep-scrub starts 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:27.713822+0000 osd.1 (osd.1) 14 : cluster 0 20.5 deep-scrub ok 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:28.860225+0000 mgr.y (mgr.24389) 218 : cluster 0 pgmap v175: 624 pgs: 19 creating+peering, 149 unknown, 456 active+clean; 217 MiB data, 988 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 13 MiB/s wr, 4 op/s 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.561074+0000 mon.c (mon.2) 147 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.931398+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]: dispatch 2024-04-19T22:50:31.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.938739+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi113-63833-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:31.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: cluster 2024-04-19T22:50:29.949254+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-04-19T22:50:31.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.960748+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.970768+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:29.972127+0000 mon.a (mon.0) 1292 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:31.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:30 smithi178 bash[23441]: audit 2024-04-19T22:50:30.564089+0000 mon.c (mon.2) 149 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:32.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: cluster 2024-04-19T22:50:30.861130+0000 mgr.y (mgr.24389) 219 : cluster 0 pgmap v178: 752 pgs: 128 creating+peering, 64 unknown, 560 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:50:32.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: cluster 2024-04-19T22:50:30.939862+0000 mon.a (mon.0) 1293 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:32.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: cluster 2024-04-19T22:50:30.939901+0000 mon.a (mon.0) 1294 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T22:50:32.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:30.942381+0000 mon.a (mon.0) 1295 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:30.942505+0000 mon.a (mon.0) 1296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:30.942600+0000 mon.a (mon.0) 1297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: cluster 2024-04-19T22:50:30.947514+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:30.957513+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:30.960579+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:31.004378+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:31.004714+0000 mon.a (mon.0) 1300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:31.175005+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:31.566130+0000 mon.c (mon.2) 153 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[21528]: audit 2024-04-19T22:50:31.735947+0000 mon.a (mon.0) 1301 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:32.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: cluster 2024-04-19T22:50:30.861130+0000 mgr.y (mgr.24389) 219 : cluster 0 pgmap v178: 752 pgs: 128 creating+peering, 64 unknown, 560 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: cluster 2024-04-19T22:50:30.939862+0000 mon.a (mon.0) 1293 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: cluster 2024-04-19T22:50:30.939901+0000 mon.a (mon.0) 1294 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:30.942381+0000 mon.a (mon.0) 1295 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:30.942505+0000 mon.a (mon.0) 1296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:30.942600+0000 mon.a (mon.0) 1297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: cluster 2024-04-19T22:50:30.947514+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:30.957513+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:30.960579+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:31.004378+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:31.004714+0000 mon.a (mon.0) 1300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:31.175005+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:31.566130+0000 mon.c (mon.2) 153 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:32.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:31 smithi113 bash[28910]: audit 2024-04-19T22:50:31.735947+0000 mon.a (mon.0) 1301 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: cluster 2024-04-19T22:50:30.861130+0000 mgr.y (mgr.24389) 219 : cluster 0 pgmap v178: 752 pgs: 128 creating+peering, 64 unknown, 560 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: cluster 2024-04-19T22:50:30.939862+0000 mon.a (mon.0) 1293 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: cluster 2024-04-19T22:50:30.939901+0000 mon.a (mon.0) 1294 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:30.942381+0000 mon.a (mon.0) 1295 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi113-64174-4", "tierpool": "test-rados-api-smithi113-64174-6"}]': finished 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:30.942505+0000 mon.a (mon.0) 1296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:30.942600+0000 mon.a (mon.0) 1297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64294-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: cluster 2024-04-19T22:50:30.947514+0000 mon.a (mon.0) 1298 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:30.957513+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:30.960579+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.113:0/2864003329' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:31.004378+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:32.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:31.004714+0000 mon.a (mon.0) 1300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T22:50:32.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:31.175005+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:32.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:31.566130+0000 mon.c (mon.2) 153 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:32.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:31 smithi178 bash[23441]: audit 2024-04-19T22:50:31.735947+0000 mon.a (mon.0) 1301 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:33.230 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: Running main() from gmock_main.cc 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [----------] Global test environment set-up. 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (31581 ms) 2024-04-19T22:50:33.231 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (17723 ms) 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (14260 ms) 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [----------] 3 tests from NeoradosECList (63564 ms total) 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [----------] Global test environment tear-down 2024-04-19T22:50:33.232 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (63564 ms total) 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: ec_list: [ PASSED ] 3 tests. 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushed 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3006 ms) 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: trying... 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444835248 notify_id 455266533381 notifier_gid 25253 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: timed out 2024-04-19T22:50:33.233 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushing 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushed 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3008 ms) 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: List watches 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify2 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444835248 notify_id 463856467969 notifier_gid 25253 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify2 done 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: watch_check 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: unwatch2 2024-04-19T22:50:33.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushing 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: done 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3040 ms) 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: List watches 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify2 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: handle_notify cookie 94008444835248 notify_id 476741369858 notifier_gid 25253 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: notify2 done 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: watch_check 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: unwatch2 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: flushing 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: done 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3017 ms) 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19393 ms total) 2024-04-19T22:50:33.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: 2024-04-19T22:50:33.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-04-19T22:50:33.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (63778 ms total) 2024-04-19T22:50:33.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-04-19T22:50:34.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:31.998807+0000 mon.a (mon.0) 1302 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:34.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:31.998879+0000 mon.a (mon.0) 1303 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:31.998953+0000 mon.a (mon.0) 1304 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: cluster 2024-04-19T22:50:32.003900+0000 mon.a (mon.0) 1305 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.011811+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.013432+0000 mon.a (mon.0) 1306 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.023619+0000 mon.c (mon.2) 155 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.023954+0000 mon.a (mon.0) 1307 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.027672+0000 mon.b (mon.1) 65 : audit 1 from='client.? 172.21.15.113:0/2242072199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.030092+0000 mon.a (mon.0) 1308 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.039104+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.043756+0000 mon.a (mon.0) 1310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:33 smithi178 bash[23441]: audit 2024-04-19T22:50:32.568061+0000 mon.c (mon.2) 156 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:34.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:31.998807+0000 mon.a (mon.0) 1302 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:34.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:31.998879+0000 mon.a (mon.0) 1303 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T22:50:34.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:31.998953+0000 mon.a (mon.0) 1304 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:34.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: cluster 2024-04-19T22:50:32.003900+0000 mon.a (mon.0) 1305 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-04-19T22:50:34.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.011811+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.013432+0000 mon.a (mon.0) 1306 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.023619+0000 mon.c (mon.2) 155 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.023954+0000 mon.a (mon.0) 1307 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.027672+0000 mon.b (mon.1) 65 : audit 1 from='client.? 172.21.15.113:0/2242072199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.030092+0000 mon.a (mon.0) 1308 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.039104+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.043756+0000 mon.a (mon.0) 1310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[21528]: audit 2024-04-19T22:50:32.568061+0000 mon.c (mon.2) 156 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:31.998807+0000 mon.a (mon.0) 1302 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:31.998879+0000 mon.a (mon.0) 1303 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi113-64174-6", "pool2": "test-rados-api-smithi113-64174-6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T22:50:34.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:31.998953+0000 mon.a (mon.0) 1304 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: cluster 2024-04-19T22:50:32.003900+0000 mon.a (mon.0) 1305 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.011811+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.113:0/1630617566' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.013432+0000 mon.a (mon.0) 1306 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.023619+0000 mon.c (mon.2) 155 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.023954+0000 mon.a (mon.0) 1307 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.027672+0000 mon.b (mon.1) 65 : audit 1 from='client.? 172.21.15.113:0/2242072199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.030092+0000 mon.a (mon.0) 1308 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.039104+0000 mon.a (mon.0) 1309 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.043756+0000 mon.a (mon.0) 1310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:34.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:33 smithi113 bash[28910]: audit 2024-04-19T22:50:32.568061+0000 mon.c (mon.2) 156 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: cluster 2024-04-19T22:50:32.861829+0000 mgr.y (mgr.24389) 220 : cluster 0 pgmap v181: 516 pgs: 32 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.199262+0000 mon.a (mon.0) 1311 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.199357+0000 mon.a (mon.0) 1312 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.199458+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: cluster 2024-04-19T22:50:33.205098+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.570867+0000 mon.c (mon.2) 157 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: cluster 2024-04-19T22:50:33.799839+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.847295+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.113:0/3449125515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:35.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: audit 2024-04-19T22:50:33.902180+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[28910]: cluster 2024-04-19T22:50:34.365697+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: cluster 2024-04-19T22:50:32.861829+0000 mgr.y (mgr.24389) 220 : cluster 0 pgmap v181: 516 pgs: 32 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.199262+0000 mon.a (mon.0) 1311 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.199357+0000 mon.a (mon.0) 1312 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.199458+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: cluster 2024-04-19T22:50:33.205098+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.570867+0000 mon.c (mon.2) 157 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: cluster 2024-04-19T22:50:33.799839+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.847295+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.113:0/3449125515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: audit 2024-04-19T22:50:33.902180+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:35.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:34 smithi113 bash[21528]: cluster 2024-04-19T22:50:34.365697+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-04-19T22:50:35.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:35.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: cluster 2024-04-19T22:50:32.861829+0000 mgr.y (mgr.24389) 220 : cluster 0 pgmap v181: 516 pgs: 32 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 973 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.199262+0000 mon.a (mon.0) 1311 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi113-64658-3"}]': finished 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.199357+0000 mon.a (mon.0) 1312 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.199458+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: cluster 2024-04-19T22:50:33.205098+0000 mon.a (mon.0) 1314 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.570867+0000 mon.c (mon.2) 157 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: cluster 2024-04-19T22:50:33.799839+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.847295+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.113:0/3449125515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: audit 2024-04-19T22:50:33.902180+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:35.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:34 smithi178 bash[23441]: cluster 2024-04-19T22:50:34.365697+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-04-19T22:50:35.935 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-04-19T22:50:35.935 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-04-19T22:50:35.935 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (19112 ms) 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (12645 ms) 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (7225 ms) 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-04-19T22:50:35.936 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (5334 ms) 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (5153 ms) 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6840 ms) 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (10105 ms) 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (66414 ms total) 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: 2024-04-19T22:50:35.937 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-04-19T22:50:35.938 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (66415 ms total) 2024-04-19T22:50:35.938 INFO:tasks.workunit.client.0.smithi113.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] Global test environment set-up. 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-19T22:50:35.951 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:49:29.426+0000 7f754c76a880 -1 failed for service _ceph-mon._tcp 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:49:29.426+0000 7f754c76a880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (62 ms) 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2008 ms) 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2070 ms total) 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: started 0x5577e5231300 2024-04-19T22:50:35.952 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: started 0x5577e5432410 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: started 2 aios 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: waiting 0x5577e5231300 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: waiting 0x5577e5432410 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: done. 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (21297 ms) 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (21297 ms total) 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-04-19T22:50:35.953 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.Exec (2840 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (38 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.Applications (9763 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (25777 ms) 2024-04-19T22:50:35.954 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] 8 tests from LibRadosMisc (38423 ms total) 2024-04-19T22:50:35.955 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: 2024-04-19T22:50:35.955 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [----------] Global test environment tear-down 2024-04-19T22:50:35.955 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (66545 ms total) 2024-04-19T22:50:35.955 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc: [ PASSED ] 12 tests. 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:34.576222+0000 mon.c (mon.2) 160 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:34.845572+0000 mgr.y (mgr.24389) 221 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: cluster 2024-04-19T22:50:34.868557+0000 mgr.y (mgr.24389) 222 : cluster 0 pgmap v184: 580 pgs: 96 creating+peering, 484 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:34.875679+0000 mon.a (mon.0) 1317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:34.875932+0000 mon.a (mon.0) 1318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: cluster 2024-04-19T22:50:35.377957+0000 mon.a (mon.0) 1319 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:35.382082+0000 mon.a (mon.0) 1320 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[21528]: audit 2024-04-19T22:50:35.577910+0000 mon.c (mon.2) 161 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:36.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:34.576222+0000 mon.c (mon.2) 160 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:36.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:34.845572+0000 mgr.y (mgr.24389) 221 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:36.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: cluster 2024-04-19T22:50:34.868557+0000 mgr.y (mgr.24389) 222 : cluster 0 pgmap v184: 580 pgs: 96 creating+peering, 484 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:36.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:34.875679+0000 mon.a (mon.0) 1317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:34.875932+0000 mon.a (mon.0) 1318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:36.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: cluster 2024-04-19T22:50:35.377957+0000 mon.a (mon.0) 1319 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-04-19T22:50:36.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:35.382082+0000 mon.a (mon.0) 1320 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:35 smithi113 bash[28910]: audit 2024-04-19T22:50:35.577910+0000 mon.c (mon.2) 161 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:36.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:34.576222+0000 mon.c (mon.2) 160 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:34.845572+0000 mgr.y (mgr.24389) 221 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: cluster 2024-04-19T22:50:34.868557+0000 mgr.y (mgr.24389) 222 : cluster 0 pgmap v184: 580 pgs: 96 creating+peering, 484 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:34.875679+0000 mon.a (mon.0) 1317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:34.875932+0000 mon.a (mon.0) 1318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: cluster 2024-04-19T22:50:35.377957+0000 mon.a (mon.0) 1319 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-04-19T22:50:36.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:35.382082+0000 mon.a (mon.0) 1320 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:36.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:35 smithi178 bash[23441]: audit 2024-04-19T22:50:35.577910+0000 mon.c (mon.2) 161 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:37.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:35.883622+0000 mon.a (mon.0) 1321 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:35.883786+0000 mon.a (mon.0) 1322 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:37.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:35.883903+0000 mon.a (mon.0) 1323 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: cluster 2024-04-19T22:50:35.893001+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-04-19T22:50:37.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:35.895964+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:35.897477+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[21528]: audit 2024-04-19T22:50:36.579085+0000 mon.c (mon.2) 163 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:37.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:35.883622+0000 mon.a (mon.0) 1321 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:35.883786+0000 mon.a (mon.0) 1322 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:37.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:35.883903+0000 mon.a (mon.0) 1323 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: cluster 2024-04-19T22:50:35.893001+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-04-19T22:50:37.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:35.895964+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:35.897477+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:36 smithi113 bash[28910]: audit 2024-04-19T22:50:36.579085+0000 mon.c (mon.2) 163 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:37.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:35.883622+0000 mon.a (mon.0) 1321 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:35.883786+0000 mon.a (mon.0) 1322 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:35.883903+0000 mon.a (mon.0) 1323 : audit 1 from='client.? 172.21.15.113:0/1760256002' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi113-63833-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: cluster 2024-04-19T22:50:35.893001+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:35.895964+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:35.897477+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]: dispatch 2024-04-19T22:50:37.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:36 smithi178 bash[23441]: audit 2024-04-19T22:50:36.579085+0000 mon.c (mon.2) 163 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: cluster 2024-04-19T22:50:36.869663+0000 mgr.y (mgr.24389) 223 : cluster 0 pgmap v187: 548 pgs: 96 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:50:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:36.896690+0000 mon.a (mon.0) 1326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: cluster 2024-04-19T22:50:36.907451+0000 mon.a (mon.0) 1327 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-04-19T22:50:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:36.970526+0000 mon.b (mon.1) 66 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:36.971502+0000 mon.a (mon.0) 1328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:36.975759+0000 mon.b (mon.1) 67 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:37.397014+0000 mon.a (mon.0) 1329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:37.397984+0000 mon.b (mon.1) 68 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:37.580631+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[28910]: audit 2024-04-19T22:50:37.802691+0000 mon.a (mon.0) 1330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: cluster 2024-04-19T22:50:36.869663+0000 mgr.y (mgr.24389) 223 : cluster 0 pgmap v187: 548 pgs: 96 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:36.896690+0000 mon.a (mon.0) 1326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: cluster 2024-04-19T22:50:36.907451+0000 mon.a (mon.0) 1327 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-04-19T22:50:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:36.970526+0000 mon.b (mon.1) 66 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:36.971502+0000 mon.a (mon.0) 1328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:36.975759+0000 mon.b (mon.1) 67 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:37.397014+0000 mon.a (mon.0) 1329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:37.397984+0000 mon.b (mon.1) 68 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:37.580631+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:38 smithi113 bash[21528]: audit 2024-04-19T22:50:37.802691+0000 mon.a (mon.0) 1330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: cluster 2024-04-19T22:50:36.869663+0000 mgr.y (mgr.24389) 223 : cluster 0 pgmap v187: 548 pgs: 96 unknown, 64 creating+peering, 388 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:36.896690+0000 mon.a (mon.0) 1326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-7"}]': finished 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: cluster 2024-04-19T22:50:36.907451+0000 mon.a (mon.0) 1327 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:36.970526+0000 mon.b (mon.1) 66 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:36.971502+0000 mon.a (mon.0) 1328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:36.975759+0000 mon.b (mon.1) 67 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:37.397014+0000 mon.a (mon.0) 1329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:37.397984+0000 mon.b (mon.1) 68 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:37.580631+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:38 smithi178 bash[23441]: audit 2024-04-19T22:50:37.802691+0000 mon.a (mon.0) 1330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.216681+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.224286+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.113:0/3921391811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.226737+0000 mon.b (mon.1) 69 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.582186+0000 mon.c (mon.2) 166 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: cluster 2024-04-19T22:50:38.643416+0000 mon.a (mon.0) 1332 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.648307+0000 mon.a (mon.0) 1333 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.656033+0000 mon.a (mon.0) 1334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:38.657013+0000 mon.a (mon.0) 1335 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: cluster 2024-04-19T22:50:39.100432+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:39.107662+0000 mon.a (mon.0) 1337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:39.107767+0000 mon.a (mon.0) 1338 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: cluster 2024-04-19T22:50:39.525486+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:39.526963+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[28910]: audit 2024-04-19T22:50:39.583526+0000 mon.c (mon.2) 168 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.216681+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.224286+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.113:0/3921391811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.226737+0000 mon.b (mon.1) 69 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.582186+0000 mon.c (mon.2) 166 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: cluster 2024-04-19T22:50:38.643416+0000 mon.a (mon.0) 1332 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-04-19T22:50:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.648307+0000 mon.a (mon.0) 1333 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.656033+0000 mon.a (mon.0) 1334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:38.657013+0000 mon.a (mon.0) 1335 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: cluster 2024-04-19T22:50:39.100432+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:39.107662+0000 mon.a (mon.0) 1337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:39.107767+0000 mon.a (mon.0) 1338 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: cluster 2024-04-19T22:50:39.525486+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:39.526963+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:39 smithi113 bash[21528]: audit 2024-04-19T22:50:39.583526+0000 mon.c (mon.2) 168 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.216681+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.224286+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.113:0/3921391811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.226737+0000 mon.b (mon.1) 69 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.582186+0000 mon.c (mon.2) 166 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: cluster 2024-04-19T22:50:38.643416+0000 mon.a (mon.0) 1332 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.648307+0000 mon.a (mon.0) 1333 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.656033+0000 mon.a (mon.0) 1334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:38.657013+0000 mon.a (mon.0) 1335 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: cluster 2024-04-19T22:50:39.100432+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:40.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:39.107662+0000 mon.a (mon.0) 1337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi113-63841-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:39.107767+0000 mon.a (mon.0) 1338 : audit 1 from='client.? 172.21.15.113:0/3778871792' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi113-63833-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: cluster 2024-04-19T22:50:39.525486+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-04-19T22:50:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:39.526963+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:39 smithi178 bash[23441]: audit 2024-04-19T22:50:39.583526+0000 mon.c (mon.2) 168 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:41.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: cluster 2024-04-19T22:50:38.870721+0000 mgr.y (mgr.24389) 224 : cluster 0 pgmap v190: 452 pgs: 160 unknown, 292 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:41.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:39.993919+0000 mon.a (mon.0) 1340 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.113364+0000 mon.a (mon.0) 1341 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.113633+0000 mon.a (mon.0) 1342 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: cluster 2024-04-19T22:50:40.124240+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.137097+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.229123+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.584835+0000 mon.c (mon.2) 170 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[28910]: audit 2024-04-19T22:50:40.620239+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: cluster 2024-04-19T22:50:38.870721+0000 mgr.y (mgr.24389) 224 : cluster 0 pgmap v190: 452 pgs: 160 unknown, 292 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:39.993919+0000 mon.a (mon.0) 1340 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.113364+0000 mon.a (mon.0) 1341 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.113633+0000 mon.a (mon.0) 1342 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:41.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: cluster 2024-04-19T22:50:40.124240+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-04-19T22:50:41.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.137097+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.229123+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:41.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.584835+0000 mon.c (mon.2) 170 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:41.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:40 smithi113 bash[21528]: audit 2024-04-19T22:50:40.620239+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:41.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: cluster 2024-04-19T22:50:38.870721+0000 mgr.y (mgr.24389) 224 : cluster 0 pgmap v190: 452 pgs: 160 unknown, 292 active+clean; 217 MiB data, 990 MiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:41.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:39.993919+0000 mon.a (mon.0) 1340 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.113364+0000 mon.a (mon.0) 1341 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi113-64042-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.113633+0000 mon.a (mon.0) 1342 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: cluster 2024-04-19T22:50:40.124240+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.137097+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.229123+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.584835+0000 mon.c (mon.2) 170 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:41.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:40 smithi178 bash[23441]: audit 2024-04-19T22:50:40.620239+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: cluster 2024-04-19T22:50:40.871931+0000 mgr.y (mgr.24389) 225 : cluster 0 pgmap v193: 524 pgs: 151 creating+peering, 40 unknown, 333 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 0 op/s 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: audit 2024-04-19T22:50:41.128458+0000 mon.a (mon.0) 1346 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: audit 2024-04-19T22:50:41.128651+0000 mon.a (mon.0) 1347 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: cluster 2024-04-19T22:50:41.136635+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: audit 2024-04-19T22:50:41.144054+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: audit 2024-04-19T22:50:41.157628+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[21528]: audit 2024-04-19T22:50:41.586436+0000 mon.c (mon.2) 172 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: cluster 2024-04-19T22:50:40.871931+0000 mgr.y (mgr.24389) 225 : cluster 0 pgmap v193: 524 pgs: 151 creating+peering, 40 unknown, 333 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 0 op/s 2024-04-19T22:50:43.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: audit 2024-04-19T22:50:41.128458+0000 mon.a (mon.0) 1346 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:43.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: audit 2024-04-19T22:50:41.128651+0000 mon.a (mon.0) 1347 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:43.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: cluster 2024-04-19T22:50:41.136635+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-04-19T22:50:43.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: audit 2024-04-19T22:50:41.144054+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: audit 2024-04-19T22:50:41.157628+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:42 smithi113 bash[28910]: audit 2024-04-19T22:50:41.586436+0000 mon.c (mon.2) 172 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:43.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: cluster 2024-04-19T22:50:40.871931+0000 mgr.y (mgr.24389) 225 : cluster 0 pgmap v193: 524 pgs: 151 creating+peering, 40 unknown, 333 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 767 B/s wr, 0 op/s 2024-04-19T22:50:43.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: audit 2024-04-19T22:50:41.128458+0000 mon.a (mon.0) 1346 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64022-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:43.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: audit 2024-04-19T22:50:41.128651+0000 mon.a (mon.0) 1347 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:43.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: cluster 2024-04-19T22:50:41.136635+0000 mon.a (mon.0) 1348 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-04-19T22:50:43.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: audit 2024-04-19T22:50:41.144054+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: audit 2024-04-19T22:50:41.157628+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:43.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:42 smithi178 bash[23441]: audit 2024-04-19T22:50:41.586436+0000 mon.c (mon.2) 172 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:42.467445+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:42.471935+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:42.489874+0000 mon.b (mon.1) 70 : audit 1 from='client.? 172.21.15.113:0/2752598093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:42.587868+0000 mon.c (mon.2) 174 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: cluster 2024-04-19T22:50:42.873100+0000 mgr.y (mgr.24389) 226 : cluster 0 pgmap v196: 524 pgs: 32 creating+peering, 168 unknown, 324 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-04-19T22:50:44.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: cluster 2024-04-19T22:50:42.929578+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:42.940412+0000 mon.a (mon.0) 1352 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.352869+0000 mon.a (mon.0) 1353 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.355018+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: cluster 2024-04-19T22:50:43.471278+0000 mon.a (mon.0) 1355 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.474484+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]': finished 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.474669+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]': finished 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.474864+0000 mon.a (mon.0) 1358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: cluster 2024-04-19T22:50:43.488481+0000 mon.a (mon.0) 1359 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.489497+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.492571+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.113:0/3132154639' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[21528]: audit 2024-04-19T22:50:43.493240+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:42.467445+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:42.471935+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:42.489874+0000 mon.b (mon.1) 70 : audit 1 from='client.? 172.21.15.113:0/2752598093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:42.587868+0000 mon.c (mon.2) 174 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: cluster 2024-04-19T22:50:42.873100+0000 mgr.y (mgr.24389) 226 : cluster 0 pgmap v196: 524 pgs: 32 creating+peering, 168 unknown, 324 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: cluster 2024-04-19T22:50:42.929578+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:42.940412+0000 mon.a (mon.0) 1352 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.352869+0000 mon.a (mon.0) 1353 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.355018+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: cluster 2024-04-19T22:50:43.471278+0000 mon.a (mon.0) 1355 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.474484+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]': finished 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.474669+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]': finished 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.474864+0000 mon.a (mon.0) 1358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:44.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: cluster 2024-04-19T22:50:43.488481+0000 mon.a (mon.0) 1359 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-04-19T22:50:44.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.489497+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.492571+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.113:0/3132154639' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:43 smithi113 bash[28910]: audit 2024-04-19T22:50:43.493240+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:42.467445+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:42.471935+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:42.489874+0000 mon.b (mon.1) 70 : audit 1 from='client.? 172.21.15.113:0/2752598093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:42.587868+0000 mon.c (mon.2) 174 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: cluster 2024-04-19T22:50:42.873100+0000 mgr.y (mgr.24389) 226 : cluster 0 pgmap v196: 524 pgs: 32 creating+peering, 168 unknown, 324 active+clean; 217 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: cluster 2024-04-19T22:50:42.929578+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:42.940412+0000 mon.a (mon.0) 1352 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.352869+0000 mon.a (mon.0) 1353 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.355018+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: cluster 2024-04-19T22:50:43.471278+0000 mon.a (mon.0) 1355 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:44.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.474484+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache", "force_nonempty":""}]': finished 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.474669+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-9", "mode": "writeback"}]': finished 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.474864+0000 mon.a (mon.0) 1358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi113-63833-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: cluster 2024-04-19T22:50:43.488481+0000 mon.a (mon.0) 1359 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.489497+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.492571+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.113:0/3132154639' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:44.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:43 smithi178 bash[23441]: audit 2024-04-19T22:50:43.493240+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:43.588970+0000 mon.c (mon.2) 176 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:43.635294+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: cluster 2024-04-19T22:50:44.387973+0000 mon.a (mon.0) 1362 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:44.397232+0000 mon.a (mon.0) 1363 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:44.399435+0000 mon.a (mon.0) 1364 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:44.399511+0000 mon.a (mon.0) 1365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: cluster 2024-04-19T22:50:44.408401+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-04-19T22:50:45.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:44.422895+0000 mon.a (mon.0) 1367 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[21528]: audit 2024-04-19T22:50:44.590129+0000 mon.c (mon.2) 178 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:43.588970+0000 mon.c (mon.2) 176 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:43.635294+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: cluster 2024-04-19T22:50:44.387973+0000 mon.a (mon.0) 1362 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:44.397232+0000 mon.a (mon.0) 1363 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:44.399435+0000 mon.a (mon.0) 1364 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:44.399511+0000 mon.a (mon.0) 1365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: cluster 2024-04-19T22:50:44.408401+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:44.422895+0000 mon.a (mon.0) 1367 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]: dispatch 2024-04-19T22:50:45.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:44 smithi113 bash[28910]: audit 2024-04-19T22:50:44.590129+0000 mon.c (mon.2) 178 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:45.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:45.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:43.588970+0000 mon.c (mon.2) 176 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:43.635294+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: cluster 2024-04-19T22:50:44.387973+0000 mon.a (mon.0) 1362 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:44.397232+0000 mon.a (mon.0) 1363 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:44.399435+0000 mon.a (mon.0) 1364 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-64022-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:44.399511+0000 mon.a (mon.0) 1365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi113-63841-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: cluster 2024-04-19T22:50:44.408401+0000 mon.a (mon.0) 1366 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:44.422895+0000 mon.a (mon.0) 1367 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]: dispatch 2024-04-19T22:50:45.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:44 smithi178 bash[23441]: audit 2024-04-19T22:50:44.590129+0000 mon.c (mon.2) 178 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:44.849692+0000 mgr.y (mgr.24389) 227 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: cluster 2024-04-19T22:50:44.877442+0000 mgr.y (mgr.24389) 228 : cluster 0 pgmap v199: 588 pgs: 74 creating+peering, 514 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 5 op/s 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.403705+0000 mon.a (mon.0) 1368 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.403953+0000 mon.a (mon.0) 1369 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]': finished 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: cluster 2024-04-19T22:50:45.413300+0000 mon.a (mon.0) 1370 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.419645+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.446835+0000 mon.a (mon.0) 1371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.591623+0000 mon.c (mon.2) 180 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:46.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[28910]: audit 2024-04-19T22:50:45.915694+0000 mon.a (mon.0) 1372 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:44.849692+0000 mgr.y (mgr.24389) 227 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: cluster 2024-04-19T22:50:44.877442+0000 mgr.y (mgr.24389) 228 : cluster 0 pgmap v199: 588 pgs: 74 creating+peering, 514 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 5 op/s 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.403705+0000 mon.a (mon.0) 1368 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.403953+0000 mon.a (mon.0) 1369 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]': finished 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: cluster 2024-04-19T22:50:45.413300+0000 mon.a (mon.0) 1370 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.419645+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.446835+0000 mon.a (mon.0) 1371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.591623+0000 mon.c (mon.2) 180 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:46 smithi113 bash[21528]: audit 2024-04-19T22:50:45.915694+0000 mon.a (mon.0) 1372 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:44.849692+0000 mgr.y (mgr.24389) 227 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: cluster 2024-04-19T22:50:44.877442+0000 mgr.y (mgr.24389) 228 : cluster 0 pgmap v199: 588 pgs: 74 creating+peering, 514 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 257 KiB/s wr, 5 op/s 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.403705+0000 mon.a (mon.0) 1368 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.403953+0000 mon.a (mon.0) 1369 : audit 1 from='client.? 172.21.15.113:0/2356829954' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-64022-10", "tierpool":"test-rados-api-smithi113-64022-10-cache"}]': finished 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: cluster 2024-04-19T22:50:45.413300+0000 mon.a (mon.0) 1370 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.419645+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.446835+0000 mon.a (mon.0) 1371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]: dispatch 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.591623+0000 mon.c (mon.2) 180 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:46.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:46 smithi178 bash[23441]: audit 2024-04-19T22:50:45.915694+0000 mon.a (mon.0) 1372 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:50:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:47.801 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: Running main() from gmock_main.cc 2024-04-19T22:50:47.801 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-04-19T22:50:47.801 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [----------] Global test environment set-up. 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolList (18220 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (7781 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (6325 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (5455 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (5422 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (9774 ms) 2024-04-19T22:50:47.802 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (8610 ms) 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (7271 ms) 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (9568 ms) 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [----------] 9 tests from LibRadosPools (78426 ms total) 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [----------] Global test environment tear-down 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (78426 ms total) 2024-04-19T22:50:47.803 INFO:tasks.workunit.client.0.smithi113.stdout: api_pool: [ PASSED ] 9 tests. 2024-04-19T22:50:48.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: cluster 2024-04-19T22:50:46.405292+0000 mon.a (mon.0) 1373 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: audit 2024-04-19T22:50:46.407379+0000 mon.a (mon.0) 1374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: cluster 2024-04-19T22:50:46.420930+0000 mon.a (mon.0) 1375 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: audit 2024-04-19T22:50:46.424798+0000 mon.b (mon.1) 71 : audit 1 from='client.? 172.21.15.113:0/160321700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: audit 2024-04-19T22:50:46.432949+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: audit 2024-04-19T22:50:46.592765+0000 mon.c (mon.2) 181 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[28910]: audit 2024-04-19T22:50:46.897663+0000 mon.a (mon.0) 1377 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: cluster 2024-04-19T22:50:46.405292+0000 mon.a (mon.0) 1373 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: audit 2024-04-19T22:50:46.407379+0000 mon.a (mon.0) 1374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: cluster 2024-04-19T22:50:46.420930+0000 mon.a (mon.0) 1375 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-04-19T22:50:48.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: audit 2024-04-19T22:50:46.424798+0000 mon.b (mon.1) 71 : audit 1 from='client.? 172.21.15.113:0/160321700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: audit 2024-04-19T22:50:46.432949+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: audit 2024-04-19T22:50:46.592765+0000 mon.c (mon.2) 181 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:48.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:47 smithi113 bash[21528]: audit 2024-04-19T22:50:46.897663+0000 mon.a (mon.0) 1377 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:50:48.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: cluster 2024-04-19T22:50:46.405292+0000 mon.a (mon.0) 1373 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:50:48.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: audit 2024-04-19T22:50:46.407379+0000 mon.a (mon.0) 1374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-9"}]': finished 2024-04-19T22:50:48.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: cluster 2024-04-19T22:50:46.420930+0000 mon.a (mon.0) 1375 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-04-19T22:50:48.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: audit 2024-04-19T22:50:46.424798+0000 mon.b (mon.1) 71 : audit 1 from='client.? 172.21.15.113:0/160321700' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: audit 2024-04-19T22:50:46.432949+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:48.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: audit 2024-04-19T22:50:46.592765+0000 mon.c (mon.2) 181 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:48.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:47 smithi178 bash[23441]: audit 2024-04-19T22:50:46.897663+0000 mon.a (mon.0) 1377 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: cluster 2024-04-19T22:50:46.878532+0000 mgr.y (mgr.24389) 229 : cluster 0 pgmap v202: 460 pgs: 64 unknown, 32 creating+peering, 364 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 256 KiB/s wr, 3 op/s 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.593830+0000 mon.c (mon.2) 182 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.778789+0000 mon.a (mon.0) 1378 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.779694+0000 mon.a (mon.0) 1379 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.780448+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: cluster 2024-04-19T22:50:47.792461+0000 mon.a (mon.0) 1381 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.806077+0000 mon.b (mon.1) 72 : audit 1 from='client.? 172.21.15.113:0/1656300864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: cluster 2024-04-19T22:50:47.813202+0000 mgr.y (mgr.24389) 230 : cluster 0 pgmap v204: 492 pgs: 128 unknown, 32 creating+peering, 332 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 301 KiB/s wr, 4 op/s 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.829670+0000 mon.a (mon.0) 1382 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:47.837309+0000 mon.a (mon.0) 1383 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:48.595455+0000 mon.c (mon.2) 183 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: audit 2024-04-19T22:50:48.786284+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[28910]: cluster 2024-04-19T22:50:48.801379+0000 mon.a (mon.0) 1385 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: cluster 2024-04-19T22:50:46.878532+0000 mgr.y (mgr.24389) 229 : cluster 0 pgmap v202: 460 pgs: 64 unknown, 32 creating+peering, 364 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 256 KiB/s wr, 3 op/s 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.593830+0000 mon.c (mon.2) 182 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.778789+0000 mon.a (mon.0) 1378 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.779694+0000 mon.a (mon.0) 1379 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.780448+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: cluster 2024-04-19T22:50:47.792461+0000 mon.a (mon.0) 1381 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.806077+0000 mon.b (mon.1) 72 : audit 1 from='client.? 172.21.15.113:0/1656300864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: cluster 2024-04-19T22:50:47.813202+0000 mgr.y (mgr.24389) 230 : cluster 0 pgmap v204: 492 pgs: 128 unknown, 32 creating+peering, 332 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 301 KiB/s wr, 4 op/s 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.829670+0000 mon.a (mon.0) 1382 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:47.837309+0000 mon.a (mon.0) 1383 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:48.595455+0000 mon.c (mon.2) 183 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: audit 2024-04-19T22:50:48.786284+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:49 smithi113 bash[21528]: cluster 2024-04-19T22:50:48.801379+0000 mon.a (mon.0) 1385 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: cluster 2024-04-19T22:50:46.878532+0000 mgr.y (mgr.24389) 229 : cluster 0 pgmap v202: 460 pgs: 64 unknown, 32 creating+peering, 364 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 256 KiB/s wr, 3 op/s 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.593830+0000 mon.c (mon.2) 182 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.778789+0000 mon.a (mon.0) 1378 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.779694+0000 mon.a (mon.0) 1379 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.780448+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi113-63833-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: cluster 2024-04-19T22:50:47.792461+0000 mon.a (mon.0) 1381 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.806077+0000 mon.b (mon.1) 72 : audit 1 from='client.? 172.21.15.113:0/1656300864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: cluster 2024-04-19T22:50:47.813202+0000 mgr.y (mgr.24389) 230 : cluster 0 pgmap v204: 492 pgs: 128 unknown, 32 creating+peering, 332 active+clean; 218 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 301 KiB/s wr, 4 op/s 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.829670+0000 mon.a (mon.0) 1382 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:47.837309+0000 mon.a (mon.0) 1383 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:50:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:48.595455+0000 mon.c (mon.2) 183 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: audit 2024-04-19T22:50:48.786284+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi113-63841-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:49 smithi178 bash[23441]: cluster 2024-04-19T22:50:48.801379+0000 mon.a (mon.0) 1385 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: Running main() from gmock_main.cc 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [----------] Global test environment set-up. 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.Version (14661 ms) 2024-04-19T22:50:50.767 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (4290 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.LongName (17190 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (8015 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (5165 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (6781 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.Exec (6278 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (4880 ms) 2024-04-19T22:50:50.768 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (4230 ms) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.BigObject (4277 ms) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2379 ms) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2958 ms) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [----------] 12 tests from NeoRadosMisc (81106 ms total) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [----------] Global test environment tear-down 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [==========] 12 tests from 1 test suite ran. (81106 ms total) 2024-04-19T22:50:50.769 INFO:tasks.workunit.client.0.smithi113.stdout: misc: [ PASSED ] 12 tests. 2024-04-19T22:50:51.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: cluster 2024-04-19T22:50:48.811548+0000 mon.a (mon.0) 1386 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 17 stray daemon(s) not managed by cephadm) 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: audit 2024-04-19T22:50:49.597090+0000 mon.c (mon.2) 184 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: cluster 2024-04-19T22:50:49.746342+0000 mon.a (mon.0) 1387 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: audit 2024-04-19T22:50:49.753126+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: audit 2024-04-19T22:50:49.755735+0000 mon.a (mon.0) 1388 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: audit 2024-04-19T22:50:49.764304+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: cluster 2024-04-19T22:50:49.813848+0000 mgr.y (mgr.24389) 231 : cluster 0 pgmap v207: 492 pgs: 64 unknown, 32 creating+peering, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[28910]: audit 2024-04-19T22:50:50.598725+0000 mon.c (mon.2) 186 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: cluster 2024-04-19T22:50:48.811548+0000 mon.a (mon.0) 1386 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 17 stray daemon(s) not managed by cephadm) 2024-04-19T22:50:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: audit 2024-04-19T22:50:49.597090+0000 mon.c (mon.2) 184 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: cluster 2024-04-19T22:50:49.746342+0000 mon.a (mon.0) 1387 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: audit 2024-04-19T22:50:49.753126+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: audit 2024-04-19T22:50:49.755735+0000 mon.a (mon.0) 1388 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: audit 2024-04-19T22:50:49.764304+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: cluster 2024-04-19T22:50:49.813848+0000 mgr.y (mgr.24389) 231 : cluster 0 pgmap v207: 492 pgs: 64 unknown, 32 creating+peering, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-04-19T22:50:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:50 smithi113 bash[21528]: audit 2024-04-19T22:50:50.598725+0000 mon.c (mon.2) 186 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:51.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: cluster 2024-04-19T22:50:48.811548+0000 mon.a (mon.0) 1386 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 17 stray daemon(s) not managed by cephadm) 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: audit 2024-04-19T22:50:49.597090+0000 mon.c (mon.2) 184 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: cluster 2024-04-19T22:50:49.746342+0000 mon.a (mon.0) 1387 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: audit 2024-04-19T22:50:49.753126+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: audit 2024-04-19T22:50:49.755735+0000 mon.a (mon.0) 1388 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: audit 2024-04-19T22:50:49.764304+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: cluster 2024-04-19T22:50:49.813848+0000 mgr.y (mgr.24389) 231 : cluster 0 pgmap v207: 492 pgs: 64 unknown, 32 creating+peering, 396 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 5.9 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-04-19T22:50:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:50 smithi178 bash[23441]: audit 2024-04-19T22:50:50.598725+0000 mon.c (mon.2) 186 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:52.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[28910]: cluster 2024-04-19T22:50:50.735323+0000 mon.a (mon.0) 1390 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[28910]: audit 2024-04-19T22:50:50.746112+0000 mon.a (mon.0) 1391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[28910]: audit 2024-04-19T22:50:50.746310+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[28910]: cluster 2024-04-19T22:50:50.754713+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[28910]: audit 2024-04-19T22:50:51.600315+0000 mon.c (mon.2) 187 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[21528]: cluster 2024-04-19T22:50:50.735323+0000 mon.a (mon.0) 1390 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[21528]: audit 2024-04-19T22:50:50.746112+0000 mon.a (mon.0) 1391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[21528]: audit 2024-04-19T22:50:50.746310+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[21528]: cluster 2024-04-19T22:50:50.754713+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-04-19T22:50:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:52 smithi113 bash[21528]: audit 2024-04-19T22:50:51.600315+0000 mon.c (mon.2) 187 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:52.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:52 smithi178 bash[23441]: cluster 2024-04-19T22:50:50.735323+0000 mon.a (mon.0) 1390 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:50:52.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:52 smithi178 bash[23441]: audit 2024-04-19T22:50:50.746112+0000 mon.a (mon.0) 1391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:52 smithi178 bash[23441]: audit 2024-04-19T22:50:50.746310+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.113:0/3584109601' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi113-63833-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:52.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:52 smithi178 bash[23441]: cluster 2024-04-19T22:50:50.754713+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-04-19T22:50:52.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:52 smithi178 bash[23441]: audit 2024-04-19T22:50:51.600315+0000 mon.c (mon.2) 187 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[28910]: cluster 2024-04-19T22:50:51.814756+0000 mgr.y (mgr.24389) 232 : cluster 0 pgmap v209: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[28910]: cluster 2024-04-19T22:50:52.160203+0000 mon.a (mon.0) 1394 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[28910]: audit 2024-04-19T22:50:52.164370+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.113:0/2805389261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[28910]: audit 2024-04-19T22:50:52.176663+0000 mon.a (mon.0) 1395 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[28910]: audit 2024-04-19T22:50:52.601929+0000 mon.c (mon.2) 189 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[21528]: cluster 2024-04-19T22:50:51.814756+0000 mgr.y (mgr.24389) 232 : cluster 0 pgmap v209: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[21528]: cluster 2024-04-19T22:50:52.160203+0000 mon.a (mon.0) 1394 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-04-19T22:50:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[21528]: audit 2024-04-19T22:50:52.164370+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.113:0/2805389261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[21528]: audit 2024-04-19T22:50:52.176663+0000 mon.a (mon.0) 1395 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:53 smithi113 bash[21528]: audit 2024-04-19T22:50:52.601929+0000 mon.c (mon.2) 189 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:53.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:53 smithi178 bash[23441]: cluster 2024-04-19T22:50:51.814756+0000 mgr.y (mgr.24389) 232 : cluster 0 pgmap v209: 396 pgs: 96 unknown, 300 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:50:53.552 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:53 smithi178 bash[23441]: cluster 2024-04-19T22:50:52.160203+0000 mon.a (mon.0) 1394 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-04-19T22:50:53.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:53 smithi178 bash[23441]: audit 2024-04-19T22:50:52.164370+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.113:0/2805389261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:53 smithi178 bash[23441]: audit 2024-04-19T22:50:52.176663+0000 mon.a (mon.0) 1395 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:53.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:53 smithi178 bash[23441]: audit 2024-04-19T22:50:52.601929+0000 mon.c (mon.2) 189 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.161049+0000 mon.a (mon.0) 1396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: cluster 2024-04-19T22:50:53.175216+0000 mon.a (mon.0) 1397 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.178032+0000 mon.b (mon.1) 73 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.182251+0000 mon.a (mon.0) 1398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.183038+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.282338+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.282774+0000 mon.a (mon.0) 1400 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:53.603663+0000 mon.c (mon.2) 191 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:54.164775+0000 mon.a (mon.0) 1401 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:54.164967+0000 mon.a (mon.0) 1402 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:54.165120+0000 mon.a (mon.0) 1403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:54.174146+0000 mon.b (mon.1) 74 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: cluster 2024-04-19T22:50:54.174399+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[21528]: audit 2024-04-19T22:50:54.177642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.161049+0000 mon.a (mon.0) 1396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: cluster 2024-04-19T22:50:53.175216+0000 mon.a (mon.0) 1397 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.178032+0000 mon.b (mon.1) 73 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.182251+0000 mon.a (mon.0) 1398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.183038+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.282338+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.282774+0000 mon.a (mon.0) 1400 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:53.603663+0000 mon.c (mon.2) 191 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:54.164775+0000 mon.a (mon.0) 1401 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:54.164967+0000 mon.a (mon.0) 1402 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:54.165120+0000 mon.a (mon.0) 1403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:54.174146+0000 mon.b (mon.1) 74 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: cluster 2024-04-19T22:50:54.174399+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-04-19T22:50:54.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:54 smithi113 bash[28910]: audit 2024-04-19T22:50:54.177642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.161049+0000 mon.a (mon.0) 1396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi113-63841-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: cluster 2024-04-19T22:50:53.175216+0000 mon.a (mon.0) 1397 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.178032+0000 mon.b (mon.1) 73 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.182251+0000 mon.a (mon.0) 1398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.183038+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.282338+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.282774+0000 mon.a (mon.0) 1400 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:53.603663+0000 mon.c (mon.2) 191 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:54.164775+0000 mon.a (mon.0) 1401 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:54.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:54.164967+0000 mon.a (mon.0) 1402 : audit 1 from='client.? 172.21.15.113:0/3567547504' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi113-63833-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:54.165120+0000 mon.a (mon.0) 1403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:50:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:54.174146+0000 mon.b (mon.1) 74 : audit 1 from='client.? 172.21.15.113:0/2169030941' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: cluster 2024-04-19T22:50:54.174399+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-04-19T22:50:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[23441]: audit 2024-04-19T22:50:54.177642+0000 mon.a (mon.0) 1405 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]: dispatch 2024-04-19T22:50:55.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:50:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[21528]: cluster 2024-04-19T22:50:53.815741+0000 mgr.y (mgr.24389) 233 : cluster 0 pgmap v212: 484 pgs: 192 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[21528]: audit 2024-04-19T22:50:54.217497+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[21528]: audit 2024-04-19T22:50:54.225070+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[21528]: audit 2024-04-19T22:50:54.605378+0000 mon.c (mon.2) 193 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[28910]: cluster 2024-04-19T22:50:53.815741+0000 mgr.y (mgr.24389) 233 : cluster 0 pgmap v212: 484 pgs: 192 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[28910]: audit 2024-04-19T22:50:54.217497+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[28910]: audit 2024-04-19T22:50:54.225070+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:55 smithi113 bash[28910]: audit 2024-04-19T22:50:54.605378+0000 mon.c (mon.2) 193 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:56.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:55 smithi178 bash[23441]: cluster 2024-04-19T22:50:53.815741+0000 mgr.y (mgr.24389) 233 : cluster 0 pgmap v212: 484 pgs: 192 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:50:56.052 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:55 smithi178 bash[23441]: audit 2024-04-19T22:50:54.217497+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:55 smithi178 bash[23441]: audit 2024-04-19T22:50:54.225070+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:50:56.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:55 smithi178 bash[23441]: audit 2024-04-19T22:50:54.605378+0000 mon.c (mon.2) 193 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:57.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:54.854047+0000 mgr.y (mgr.24389) 234 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:57.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.528974+0000 mon.a (mon.0) 1407 : audit 0 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-19T22:50:57.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.535592+0000 mon.a (mon.0) 1408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:57.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.535767+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.540158+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: cluster 2024-04-19T22:50:55.556634+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.557734+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.113:0/3517008901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.564544+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.565795+0000 mon.a (mon.0) 1412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.566524+0000 mon.a (mon.0) 1413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.595731+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.596086+0000 mon.a (mon.0) 1414 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.597997+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.598306+0000 mon.a (mon.0) 1415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.598822+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:54.854047+0000 mgr.y (mgr.24389) 234 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.528974+0000 mon.a (mon.0) 1407 : audit 0 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.535592+0000 mon.a (mon.0) 1408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.535767+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.540158+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: cluster 2024-04-19T22:50:55.556634+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.557734+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.113:0/3517008901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.564544+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.565795+0000 mon.a (mon.0) 1412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.566524+0000 mon.a (mon.0) 1413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.595731+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.596086+0000 mon.a (mon.0) 1414 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.597997+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.598306+0000 mon.a (mon.0) 1415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.598822+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.599084+0000 mon.a (mon.0) 1416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:55.606524+0000 mon.c (mon.2) 199 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: cluster 2024-04-19T22:50:55.816694+0000 mgr.y (mgr.24389) 235 : cluster 0 pgmap v215: 452 pgs: 96 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: cluster 2024-04-19T22:50:56.537646+0000 mon.a (mon.0) 1417 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.540748+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.540895+0000 mon.a (mon.0) 1419 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]': finished 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.541018+0000 mon.a (mon.0) 1420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.541249+0000 mon.a (mon.0) 1421 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.553222+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: cluster 2024-04-19T22:50:56.555351+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-04-19T22:50:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.572360+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.113:0/545672590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[21528]: audit 2024-04-19T22:50:56.578401+0000 mon.a (mon.0) 1423 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.599084+0000 mon.a (mon.0) 1416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:55.606524+0000 mon.c (mon.2) 199 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: cluster 2024-04-19T22:50:55.816694+0000 mgr.y (mgr.24389) 235 : cluster 0 pgmap v215: 452 pgs: 96 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: cluster 2024-04-19T22:50:56.537646+0000 mon.a (mon.0) 1417 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.540748+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.540895+0000 mon.a (mon.0) 1419 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]': finished 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.541018+0000 mon.a (mon.0) 1420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.541249+0000 mon.a (mon.0) 1421 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.553222+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: cluster 2024-04-19T22:50:56.555351+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-04-19T22:50:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.572360+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.113:0/545672590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:56 smithi113 bash[28910]: audit 2024-04-19T22:50:56.578401+0000 mon.a (mon.0) 1423 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:54.854047+0000 mgr.y (mgr.24389) 234 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.528974+0000 mon.a (mon.0) 1407 : audit 0 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.535592+0000 mon.a (mon.0) 1408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi113-64042-10"}]': finished 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.535767+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.540158+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: cluster 2024-04-19T22:50:55.556634+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-04-19T22:50:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.557734+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.113:0/3517008901' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.564544+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.565795+0000 mon.a (mon.0) 1412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.566524+0000 mon.a (mon.0) 1413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.595731+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.596086+0000 mon.a (mon.0) 1414 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.597997+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.598306+0000 mon.a (mon.0) 1415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.598822+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.599084+0000 mon.a (mon.0) 1416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:55.606524+0000 mon.c (mon.2) 199 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: cluster 2024-04-19T22:50:55.816694+0000 mgr.y (mgr.24389) 235 : cluster 0 pgmap v215: 452 pgs: 96 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: cluster 2024-04-19T22:50:56.537646+0000 mon.a (mon.0) 1417 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:50:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.540748+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.540895+0000 mon.a (mon.0) 1419 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-11", "mode": "writeback"}]': finished 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.541018+0000 mon.a (mon.0) 1420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.541249+0000 mon.a (mon.0) 1421 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.553222+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: cluster 2024-04-19T22:50:56.555351+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.572360+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.113:0/545672590' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:56 smithi178 bash[23441]: audit 2024-04-19T22:50:56.578401+0000 mon.a (mon.0) 1423 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:50:57.839 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:50:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:50:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:50:58.021 INFO:tasks.workunit.client.0.smithi113.stdout: io: Running main() from gmock_main.cc 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [----------] Global test environment set-up. 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [----------] 14 tests from NeoRadosIo 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.Limits (19016 ms) 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (11272 ms) 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.ReadOp (7265 ms) 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.SparseRead (6677 ms) 2024-04-19T22:50:58.022 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.RoundTrip (5156 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (6781 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (6260 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3878 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (4227 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.Trunc (3370 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.Remove (2930 ms) 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-19T22:50:58.023 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (4332 ms) 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.RmXattr (3424 ms) 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3835 ms) 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [----------] 14 tests from NeoRadosIo (88423 ms total) 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [----------] Global test environment tear-down 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [==========] 14 tests from 1 test suite ran. (88423 ms total) 2024-04-19T22:50:58.024 INFO:tasks.workunit.client.0.smithi113.stdout: io: [ PASSED ] 14 tests. 2024-04-19T22:50:58.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[28910]: audit 2024-04-19T22:50:56.582153+0000 mon.a (mon.0) 1424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[28910]: audit 2024-04-19T22:50:56.586006+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2"}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[28910]: audit 2024-04-19T22:50:56.586911+0000 mon.a (mon.0) 1426 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[28910]: audit 2024-04-19T22:50:56.607648+0000 mon.c (mon.2) 202 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[28910]: audit 2024-04-19T22:50:57.545559+0000 mon.a (mon.0) 1427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[21528]: audit 2024-04-19T22:50:56.582153+0000 mon.a (mon.0) 1424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[21528]: audit 2024-04-19T22:50:56.586006+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2"}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[21528]: audit 2024-04-19T22:50:56.586911+0000 mon.a (mon.0) 1426 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[21528]: audit 2024-04-19T22:50:56.607648+0000 mon.c (mon.2) 202 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:58.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:58 smithi113 bash[21528]: audit 2024-04-19T22:50:57.545559+0000 mon.a (mon.0) 1427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:50:58.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:58 smithi178 bash[23441]: audit 2024-04-19T22:50:56.582153+0000 mon.a (mon.0) 1424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:58 smithi178 bash[23441]: audit 2024-04-19T22:50:56.586006+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2"}]: dispatch 2024-04-19T22:50:58.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:58 smithi178 bash[23441]: audit 2024-04-19T22:50:56.586911+0000 mon.a (mon.0) 1426 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:50:58.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:58 smithi178 bash[23441]: audit 2024-04-19T22:50:56.607648+0000 mon.c (mon.2) 202 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:50:58.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:58 smithi178 bash[23441]: audit 2024-04-19T22:50:57.545559+0000 mon.a (mon.0) 1427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi113-63833-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:00.150 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: Running main() from gmock_main.cc 2024-04-19T22:51:00.150 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [----------] Global test environment set-up. 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (17926 ms) 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (18202 ms) 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (5589 ms) 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3521 ms) 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (6869 ms) 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-04-19T22:51:00.151 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (5317 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (4937 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (4882 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (4230 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (5286 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (4345 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3416 ms) 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-04-19T22:51:00.152 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3830 ms) 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2129 ms) 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (90480 ms total) 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [----------] Global test environment tear-down 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (90480 ms total) 2024-04-19T22:51:00.153 INFO:tasks.workunit.client.0.smithi113.stdout: read_operations: [ PASSED ] 14 tests. 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:57.545780+0000 mon.a (mon.0) 1428 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:57.608794+0000 mon.c (mon.2) 203 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: cluster 2024-04-19T22:50:57.817604+0000 mgr.y (mgr.24389) 236 : cluster 0 pgmap v218: 388 pgs: 32 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: cluster 2024-04-19T22:50:58.014129+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.024147+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.025018+0000 mon.a (mon.0) 1431 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.046119+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.481743+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.610412+0000 mon.c (mon.2) 205 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: cluster 2024-04-19T22:50:58.915315+0000 mon.a (mon.0) 1433 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.930097+0000 mon.a (mon.0) 1434 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:00.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.930324+0000 mon.a (mon.0) 1435 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.930524+0000 mon.a (mon.0) 1436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: cluster 2024-04-19T22:50:58.938105+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.939534+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.961578+0000 mon.a (mon.0) 1438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.962840+0000 mon.a (mon.0) 1439 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[28910]: audit 2024-04-19T22:50:58.963289+0000 mon.a (mon.0) 1440 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:57.545780+0000 mon.a (mon.0) 1428 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:57.608794+0000 mon.c (mon.2) 203 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: cluster 2024-04-19T22:50:57.817604+0000 mgr.y (mgr.24389) 236 : cluster 0 pgmap v218: 388 pgs: 32 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: cluster 2024-04-19T22:50:58.014129+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.024147+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.025018+0000 mon.a (mon.0) 1431 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.046119+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.481743+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.610412+0000 mon.c (mon.2) 205 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: cluster 2024-04-19T22:50:58.915315+0000 mon.a (mon.0) 1433 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.930097+0000 mon.a (mon.0) 1434 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.930324+0000 mon.a (mon.0) 1435 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.930524+0000 mon.a (mon.0) 1436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: cluster 2024-04-19T22:50:58.938105+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.939534+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.961578+0000 mon.a (mon.0) 1438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.962840+0000 mon.a (mon.0) 1439 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:51:00.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:50:59 smithi113 bash[21528]: audit 2024-04-19T22:50:58.963289+0000 mon.a (mon.0) 1440 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:00.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:57.545780+0000 mon.a (mon.0) 1428 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi113-63989-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:57.608794+0000 mon.c (mon.2) 203 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: cluster 2024-04-19T22:50:57.817604+0000 mgr.y (mgr.24389) 236 : cluster 0 pgmap v218: 388 pgs: 32 unknown, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: cluster 2024-04-19T22:50:58.014129+0000 mon.a (mon.0) 1429 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.024147+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.025018+0000 mon.a (mon.0) 1431 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.046119+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.481743+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.610412+0000 mon.c (mon.2) 205 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: cluster 2024-04-19T22:50:58.915315+0000 mon.a (mon.0) 1433 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:00.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.930097+0000 mon.a (mon.0) 1434 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi113-64042-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.930324+0000 mon.a (mon.0) 1435 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.930524+0000 mon.a (mon.0) 1436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: cluster 2024-04-19T22:50:58.938105+0000 mon.a (mon.0) 1437 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.939534+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.961578+0000 mon.a (mon.0) 1438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]: dispatch 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.962840+0000 mon.a (mon.0) 1439 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-04-19T22:51:00.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:50:59 smithi178 bash[23441]: audit 2024-04-19T22:50:58.963289+0000 mon.a (mon.0) 1440 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.182 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: seed 63989 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (6 ms) 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (26 ms) 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (14 ms) 2024-04-19T22:51:01.183 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (9 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (8 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (2 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (2 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (6 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (15 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2024-04-19T22:51:01.184 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (5 ms) 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (7 ms) 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: osd_max_attr_size = 0 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2226 ms) 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (500 ms) 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: done waiting, doing copies 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: waiting for final deep scrubs... 2024-04-19T22:51:01.185 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: done waiting 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (65949 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (9 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (4 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4733 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-04-19T22:51:01.186 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.611959+0000 mon.c (mon.2) 207 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:59.820779+0000 mgr.y (mgr.24389) 237 : cluster 0 pgmap v220: 396 pgs: 72 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 3 op/s 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:59.932212+0000 mon.a (mon.0) 1441 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.935081+0000 mon.a (mon.0) 1442 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.935325+0000 mon.a (mon.0) 1443 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.935490+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: cluster 2024-04-19T22:50:59.946755+0000 mon.a (mon.0) 1445 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.949080+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.113:0/2134999330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.952983+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:50:59.960827+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:51:00.125439+0000 mon.a (mon.0) 1448 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: audit 2024-04-19T22:51:00.125650+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[21528]: cluster 2024-04-19T22:51:00.134480+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.611959+0000 mon.c (mon.2) 207 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:59.820779+0000 mgr.y (mgr.24389) 237 : cluster 0 pgmap v220: 396 pgs: 72 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 3 op/s 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:59.932212+0000 mon.a (mon.0) 1441 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.935081+0000 mon.a (mon.0) 1442 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.935325+0000 mon.a (mon.0) 1443 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.935490+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: cluster 2024-04-19T22:50:59.946755+0000 mon.a (mon.0) 1445 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.949080+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.113:0/2134999330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.952983+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:50:59.960827+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:51:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:51:00.125439+0000 mon.a (mon.0) 1448 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: audit 2024-04-19T22:51:00.125650+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:51:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:01 smithi113 bash[28910]: cluster 2024-04-19T22:51:00.134480+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.611959+0000 mon.c (mon.2) 207 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:59.820779+0000 mgr.y (mgr.24389) 237 : cluster 0 pgmap v220: 396 pgs: 72 creating+peering, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 3 op/s 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:59.932212+0000 mon.a (mon.0) 1441 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.935081+0000 mon.a (mon.0) 1442 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-11"}]': finished 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.935325+0000 mon.a (mon.0) 1443 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.935490+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.113:0/849919304' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi113-63841-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: cluster 2024-04-19T22:50:59.946755+0000 mon.a (mon.0) 1445 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.949080+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.113:0/2134999330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.952983+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:01.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:50:59.960827+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]: dispatch 2024-04-19T22:51:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:51:00.125439+0000 mon.a (mon.0) 1448 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi113-63833-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: audit 2024-04-19T22:51:00.125650+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.113:0/1829699671' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi113-63989-1","app":"app1","key":"key1"}]': finished 2024-04-19T22:51:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:01 smithi178 bash[23441]: cluster 2024-04-19T22:51:00.134480+0000 mon.a (mon.0) 1450 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-04-19T22:51:02.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:00.613394+0000 mon.c (mon.2) 209 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:02.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: cluster 2024-04-19T22:51:01.137815+0000 mon.a (mon.0) 1451 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.140885+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.142415+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.113:0/2819966588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.163600+0000 mon.a (mon.0) 1452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.164540+0000 mon.a (mon.0) 1453 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.201931+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.601406+0000 mon.a (mon.0) 1454 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.602777+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.603247+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.603955+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.604373+0000 mon.a (mon.0) 1456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[28910]: audit 2024-04-19T22:51:01.614681+0000 mon.c (mon.2) 215 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:00.613394+0000 mon.c (mon.2) 209 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: cluster 2024-04-19T22:51:01.137815+0000 mon.a (mon.0) 1451 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.140885+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.142415+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.113:0/2819966588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.163600+0000 mon.a (mon.0) 1452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.164540+0000 mon.a (mon.0) 1453 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.201931+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.601406+0000 mon.a (mon.0) 1454 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.602777+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.603247+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.603955+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.604373+0000 mon.a (mon.0) 1456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:02 smithi113 bash[21528]: audit 2024-04-19T22:51:01.614681+0000 mon.c (mon.2) 215 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:02.302 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:00.613394+0000 mon.c (mon.2) 209 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: cluster 2024-04-19T22:51:01.137815+0000 mon.a (mon.0) 1451 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.140885+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.142415+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.113:0/2819966588' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.163600+0000 mon.a (mon.0) 1452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.164540+0000 mon.a (mon.0) 1453 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.201931+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.601406+0000 mon.a (mon.0) 1454 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.602777+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.603247+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.603955+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.604373+0000 mon.a (mon.0) 1456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:02.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:02 smithi178 bash[23441]: audit 2024-04-19T22:51:01.614681+0000 mon.c (mon.2) 215 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: cluster 2024-04-19T22:51:01.821760+0000 mgr.y (mgr.24389) 238 : cluster 0 pgmap v224: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.145231+0000 mon.a (mon.0) 1457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.145520+0000 mon.a (mon.0) 1458 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.145767+0000 mon.a (mon.0) 1459 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: cluster 2024-04-19T22:51:02.155528+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.161764+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.113:0/1971875735' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.164509+0000 mon.c (mon.2) 217 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.173799+0000 mon.a (mon.0) 1461 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.174665+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.616296+0000 mon.c (mon.2) 218 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.856338+0000 mon.a (mon.0) 1463 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[28910]: audit 2024-04-19T22:51:02.859150+0000 mon.a (mon.0) 1464 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: cluster 2024-04-19T22:51:01.821760+0000 mgr.y (mgr.24389) 238 : cluster 0 pgmap v224: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.145231+0000 mon.a (mon.0) 1457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.145520+0000 mon.a (mon.0) 1458 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.145767+0000 mon.a (mon.0) 1459 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: cluster 2024-04-19T22:51:02.155528+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.161764+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.113:0/1971875735' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.164509+0000 mon.c (mon.2) 217 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.173799+0000 mon.a (mon.0) 1461 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.174665+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.616296+0000 mon.c (mon.2) 218 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:04.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.856338+0000 mon.a (mon.0) 1463 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:04.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:03 smithi113 bash[21528]: audit 2024-04-19T22:51:02.859150+0000 mon.a (mon.0) 1464 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: cluster 2024-04-19T22:51:01.821760+0000 mgr.y (mgr.24389) 238 : cluster 0 pgmap v224: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.145231+0000 mon.a (mon.0) 1457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.145520+0000 mon.a (mon.0) 1458 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi113-63841-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.145767+0000 mon.a (mon.0) 1459 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63989-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: cluster 2024-04-19T22:51:02.155528+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.161764+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.113:0/1971875735' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.164509+0000 mon.c (mon.2) 217 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.173799+0000 mon.a (mon.0) 1461 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.174665+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.616296+0000 mon.c (mon.2) 218 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.856338+0000 mon.a (mon.0) 1463 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:03 smithi178 bash[23441]: audit 2024-04-19T22:51:02.859150+0000 mon.a (mon.0) 1464 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: audit 2024-04-19T22:51:03.151273+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: cluster 2024-04-19T22:51:03.617708+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: audit 2024-04-19T22:51:03.617781+0000 mon.c (mon.2) 219 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: cluster 2024-04-19T22:51:03.822602+0000 mgr.y (mgr.24389) 239 : cluster 0 pgmap v227: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: audit 2024-04-19T22:51:04.155286+0000 mon.a (mon.0) 1467 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: cluster 2024-04-19T22:51:04.165412+0000 mon.a (mon.0) 1468 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: audit 2024-04-19T22:51:04.181567+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.113:0/110046632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[28910]: audit 2024-04-19T22:51:04.613707+0000 mon.a (mon.0) 1469 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:05.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: audit 2024-04-19T22:51:03.151273+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: cluster 2024-04-19T22:51:03.617708+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: audit 2024-04-19T22:51:03.617781+0000 mon.c (mon.2) 219 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: cluster 2024-04-19T22:51:03.822602+0000 mgr.y (mgr.24389) 239 : cluster 0 pgmap v227: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: audit 2024-04-19T22:51:04.155286+0000 mon.a (mon.0) 1467 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: cluster 2024-04-19T22:51:04.165412+0000 mon.a (mon.0) 1468 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: audit 2024-04-19T22:51:04.181567+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.113:0/110046632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:05 smithi113 bash[21528]: audit 2024-04-19T22:51:04.613707+0000 mon.a (mon.0) 1469 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:05.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: audit 2024-04-19T22:51:03.151273+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi113-63833-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: cluster 2024-04-19T22:51:03.617708+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: audit 2024-04-19T22:51:03.617781+0000 mon.c (mon.2) 219 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: cluster 2024-04-19T22:51:03.822602+0000 mgr.y (mgr.24389) 239 : cluster 0 pgmap v227: 364 pgs: 96 unknown, 8 creating+peering, 260 active+clean; 587 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: audit 2024-04-19T22:51:04.155286+0000 mon.a (mon.0) 1467 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63989-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: cluster 2024-04-19T22:51:04.165412+0000 mon.a (mon.0) 1468 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: audit 2024-04-19T22:51:04.181567+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.113:0/110046632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:05.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:05 smithi178 bash[23441]: audit 2024-04-19T22:51:04.613707+0000 mon.a (mon.0) 1469 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:04.618847+0000 mon.c (mon.2) 221 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:04.865485+0000 mgr.y (mgr.24389) 240 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: cluster 2024-04-19T22:51:05.017850+0000 mon.a (mon.0) 1470 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.482583+0000 mon.a (mon.0) 1471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: cluster 2024-04-19T22:51:05.485457+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.493609+0000 mon.c (mon.2) 222 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.497516+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.113:0/1003078937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.503327+0000 mon.a (mon.0) 1473 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.503683+0000 mon.a (mon.0) 1474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[28910]: audit 2024-04-19T22:51:05.619970+0000 mon.c (mon.2) 224 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:04.618847+0000 mon.c (mon.2) 221 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:04.865485+0000 mgr.y (mgr.24389) 240 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: cluster 2024-04-19T22:51:05.017850+0000 mon.a (mon.0) 1470 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.482583+0000 mon.a (mon.0) 1471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: cluster 2024-04-19T22:51:05.485457+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.493609+0000 mon.c (mon.2) 222 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.497516+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.113:0/1003078937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.503327+0000 mon.a (mon.0) 1473 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.503683+0000 mon.a (mon.0) 1474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:06 smithi113 bash[21528]: audit 2024-04-19T22:51:05.619970+0000 mon.c (mon.2) 224 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:04.618847+0000 mon.c (mon.2) 221 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:04.865485+0000 mgr.y (mgr.24389) 240 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: cluster 2024-04-19T22:51:05.017850+0000 mon.a (mon.0) 1470 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.482583+0000 mon.a (mon.0) 1471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi113-63841-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: cluster 2024-04-19T22:51:05.485457+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.493609+0000 mon.c (mon.2) 222 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.497516+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.113:0/1003078937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.503327+0000 mon.a (mon.0) 1473 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.503683+0000 mon.a (mon.0) 1474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:06.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:06 smithi178 bash[23441]: audit 2024-04-19T22:51:05.619970+0000 mon.c (mon.2) 224 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:07.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: cluster 2024-04-19T22:51:05.823582+0000 mgr.y (mgr.24389) 241 : cluster 0 pgmap v230: 436 pgs: 96 unknown, 40 creating+peering, 300 active+clean; 597 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 83 KiB/s wr, 77 op/s 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.486641+0000 mon.a (mon.0) 1475 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.486847+0000 mon.a (mon.0) 1476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: cluster 2024-04-19T22:51:06.495659+0000 mon.a (mon.0) 1477 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.516783+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.517752+0000 mon.a (mon.0) 1478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.620801+0000 mon.c (mon.2) 226 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:06.734096+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[21528]: audit 2024-04-19T22:51:07.005611+0000 mon.a (mon.0) 1479 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: cluster 2024-04-19T22:51:05.823582+0000 mgr.y (mgr.24389) 241 : cluster 0 pgmap v230: 436 pgs: 96 unknown, 40 creating+peering, 300 active+clean; 597 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 83 KiB/s wr, 77 op/s 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.486641+0000 mon.a (mon.0) 1475 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.486847+0000 mon.a (mon.0) 1476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: cluster 2024-04-19T22:51:06.495659+0000 mon.a (mon.0) 1477 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.516783+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.517752+0000 mon.a (mon.0) 1478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.620801+0000 mon.c (mon.2) 226 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:06.734096+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:07 smithi113 bash[28910]: audit 2024-04-19T22:51:07.005611+0000 mon.a (mon.0) 1479 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: cluster 2024-04-19T22:51:05.823582+0000 mgr.y (mgr.24389) 241 : cluster 0 pgmap v230: 436 pgs: 96 unknown, 40 creating+peering, 300 active+clean; 597 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 83 KiB/s wr, 77 op/s 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.486641+0000 mon.a (mon.0) 1475 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.486847+0000 mon.a (mon.0) 1476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi113-63833-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: cluster 2024-04-19T22:51:06.495659+0000 mon.a (mon.0) 1477 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.516783+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.517752+0000 mon.a (mon.0) 1478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.620801+0000 mon.c (mon.2) 226 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:06.734096+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:07 smithi178 bash[23441]: audit 2024-04-19T22:51:07.005611+0000 mon.a (mon.0) 1479 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.505201+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.505410+0000 mon.a (mon.0) 1481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: cluster 2024-04-19T22:51:07.515145+0000 mon.a (mon.0) 1482 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.519752+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.523846+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.525526+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.526059+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.113:0/331565823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.528275+0000 mon.a (mon.0) 1484 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.528946+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[28910]: audit 2024-04-19T22:51:07.621811+0000 mon.c (mon.2) 231 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.505201+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.505410+0000 mon.a (mon.0) 1481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: cluster 2024-04-19T22:51:07.515145+0000 mon.a (mon.0) 1482 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.519752+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.523846+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.525526+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.526059+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.113:0/331565823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.528275+0000 mon.a (mon.0) 1484 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.528946+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:08 smithi113 bash[21528]: audit 2024-04-19T22:51:07.621811+0000 mon.c (mon.2) 231 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.505201+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63989-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.505410+0000 mon.a (mon.0) 1481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: cluster 2024-04-19T22:51:07.515145+0000 mon.a (mon.0) 1482 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.519752+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.523846+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.525526+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.526059+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.113:0/331565823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.528275+0000 mon.a (mon.0) 1484 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:08.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.528946+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:08.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:08 smithi178 bash[23441]: audit 2024-04-19T22:51:07.621811+0000 mon.c (mon.2) 231 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (7 api_snapshots: Running main() from gmock_main.cc 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] Global test environment set-up. 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (4751 ms) 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (4459 ms) 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (4035 ms) 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-04-19T22:51:09.545 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3625 ms) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (16870 ms total) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (8331 ms) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (7759 ms) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (10176 ms) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (26266 ms total) 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-19T22:51:09.546 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4282 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2014 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2390 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (3352 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (12038 ms total) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (3293 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4358 ms) 2024-04-19T22:51:09.547 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (7651 ms total) 2024-04-19T22:51:09.548 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: 2024-04-19T22:51:09.548 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [----------] Global test environment tear-down 2024-04-19T22:51:09.548 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (100154 ms total) 2024-04-19T22:51:09.548 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-04-19T22:51:09.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: cluster 2024-04-19T22:51:07.824474+0000 mgr.y (mgr.24389) 242 : cluster 0 pgmap v233: 396 pgs: 96 unknown, 8 creating+peering, 292 active+clean; 589 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 KiB/s wr, 76 op/s 2024-04-19T22:51:09.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.518565+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.518835+0000 mon.a (mon.0) 1487 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.519033+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: cluster 2024-04-19T22:51:08.530902+0000 mon.a (mon.0) 1489 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.533154+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.533746+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.535455+0000 mon.c (mon.2) 234 : audit 1 from='client.? 172.21.15.113:0/3542073733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.540020+0000 mon.a (mon.0) 1490 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.540481+0000 mon.a (mon.0) 1491 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.541090+0000 mon.a (mon.0) 1492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[28910]: audit 2024-04-19T22:51:08.622830+0000 mon.c (mon.2) 235 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: cluster 2024-04-19T22:51:07.824474+0000 mgr.y (mgr.24389) 242 : cluster 0 pgmap v233: 396 pgs: 96 unknown, 8 creating+peering, 292 active+clean; 589 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 KiB/s wr, 76 op/s 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.518565+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.518835+0000 mon.a (mon.0) 1487 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.519033+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: cluster 2024-04-19T22:51:08.530902+0000 mon.a (mon.0) 1489 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.533154+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.533746+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.535455+0000 mon.c (mon.2) 234 : audit 1 from='client.? 172.21.15.113:0/3542073733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.540020+0000 mon.a (mon.0) 1490 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.540481+0000 mon.a (mon.0) 1491 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.541090+0000 mon.a (mon.0) 1492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:09 smithi113 bash[21528]: audit 2024-04-19T22:51:08.622830+0000 mon.c (mon.2) 235 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: cluster 2024-04-19T22:51:07.824474+0000 mgr.y (mgr.24389) 242 : cluster 0 pgmap v233: 396 pgs: 96 unknown, 8 creating+peering, 292 active+clean; 589 KiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 75 KiB/s wr, 76 op/s 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.518565+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.518835+0000 mon.a (mon.0) 1487 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.519033+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi113-63841-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: cluster 2024-04-19T22:51:08.530902+0000 mon.a (mon.0) 1489 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.533154+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.533746+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.113:0/1924968993' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.535455+0000 mon.c (mon.2) 234 : audit 1 from='client.? 172.21.15.113:0/3542073733' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.540020+0000 mon.a (mon.0) 1490 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.540481+0000 mon.a (mon.0) 1491 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.541090+0000 mon.a (mon.0) 1492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:09 smithi178 bash[23441]: audit 2024-04-19T22:51:08.622830+0000 mon.c (mon.2) 235 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: cluster 2024-04-19T22:51:09.521628+0000 mon.a (mon.0) 1493 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.524698+0000 mon.a (mon.0) 1494 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]': finished 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.524965+0000 mon.a (mon.0) 1495 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.525187+0000 mon.a (mon.0) 1496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: cluster 2024-04-19T22:51:09.536760+0000 mon.a (mon.0) 1497 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.553311+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.557678+0000 mon.a (mon.0) 1498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:09.623806+0000 mon.c (mon.2) 237 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.337966+0000 mon.c (mon.2) 238 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.338854+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.339515+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.340168+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.340793+0000 mon.c (mon.2) 242 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.341411+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.342167+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.342755+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.343294+0000 mon.c (mon.2) 246 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.343955+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:11.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[28910]: audit 2024-04-19T22:51:10.529468+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: cluster 2024-04-19T22:51:09.521628+0000 mon.a (mon.0) 1493 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.524698+0000 mon.a (mon.0) 1494 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]': finished 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.524965+0000 mon.a (mon.0) 1495 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.525187+0000 mon.a (mon.0) 1496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: cluster 2024-04-19T22:51:09.536760+0000 mon.a (mon.0) 1497 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.553311+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.557678+0000 mon.a (mon.0) 1498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:09.623806+0000 mon.c (mon.2) 237 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.337966+0000 mon.c (mon.2) 238 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:11.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.338854+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.339515+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.340168+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.340793+0000 mon.c (mon.2) 242 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.341411+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.342167+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.342755+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.343294+0000 mon.c (mon.2) 246 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.343955+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:11.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:10 smithi113 bash[21528]: audit 2024-04-19T22:51:10.529468+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:11.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: cluster 2024-04-19T22:51:09.521628+0000 mon.a (mon.0) 1493 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:11.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.524698+0000 mon.a (mon.0) 1494 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-13", "mode": "writeback"}]': finished 2024-04-19T22:51:11.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.524965+0000 mon.a (mon.0) 1495 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi113-64042-15"}]': finished 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.525187+0000 mon.a (mon.0) 1496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi113-63833-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: cluster 2024-04-19T22:51:09.536760+0000 mon.a (mon.0) 1497 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.553311+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.557678+0000 mon.a (mon.0) 1498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:09.623806+0000 mon.c (mon.2) 237 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.337966+0000 mon.c (mon.2) 238 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.338854+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.339515+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.340168+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.340793+0000 mon.c (mon.2) 242 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.341411+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.342167+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.342755+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:11.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.343294+0000 mon.c (mon.2) 246 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:11.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.343955+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:11.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:10 smithi178 bash[23441]: audit 2024-04-19T22:51:10.529468+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:09.826596+0000 mgr.y (mgr.24389) 243 : cluster 0 pgmap v236: 324 pgs: 32 creating+peering, 292 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 63 op/s 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.338229+0000 mgr.y (mgr.24389) 244 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.338989+0000 mgr.y (mgr.24389) 245 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.339641+0000 mgr.y (mgr.24389) 246 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.340287+0000 mgr.y (mgr.24389) 247 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.340913+0000 mgr.y (mgr.24389) 248 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.341562+0000 mgr.y (mgr.24389) 249 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.342307+0000 mgr.y (mgr.24389) 250 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:12.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.342894+0000 mgr.y (mgr.24389) 251 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.343415+0000 mgr.y (mgr.24389) 252 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.344123+0000 mgr.y (mgr.24389) 253 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.540142+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.540633+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.551336+0000 mon.a (mon.0) 1501 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.553316+0000 mon.a (mon.0) 1502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.555171+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.561946+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.113:0/3434523080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.581607+0000 mon.a (mon.0) 1504 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:09.826596+0000 mgr.y (mgr.24389) 243 : cluster 0 pgmap v236: 324 pgs: 32 creating+peering, 292 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 63 op/s 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.338229+0000 mgr.y (mgr.24389) 244 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.338989+0000 mgr.y (mgr.24389) 245 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.339641+0000 mgr.y (mgr.24389) 246 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.340287+0000 mgr.y (mgr.24389) 247 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.340913+0000 mgr.y (mgr.24389) 248 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.341562+0000 mgr.y (mgr.24389) 249 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.342307+0000 mgr.y (mgr.24389) 250 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.342894+0000 mgr.y (mgr.24389) 251 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.343415+0000 mgr.y (mgr.24389) 252 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.344123+0000 mgr.y (mgr.24389) 253 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.540142+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.540633+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.551336+0000 mon.a (mon.0) 1501 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.553316+0000 mon.a (mon.0) 1502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.555171+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.561946+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.113:0/3434523080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.581607+0000 mon.a (mon.0) 1504 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:10.624912+0000 mon.c (mon.2) 250 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.828487+0000 osd.1 (osd.1) 15 : cluster 0 176.5 scrub starts 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.832810+0000 osd.1 (osd.1) 16 : cluster 0 176.5 scrub ok 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.872681+0000 osd.2 (osd.2) 3 : cluster 0 176.8 scrub starts 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.876572+0000 osd.2 (osd.2) 4 : cluster 0 176.8 scrub ok 2024-04-19T22:51:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.061165+0000 osd.7 (osd.7) 15 : cluster 0 176.3 scrub starts 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.065950+0000 osd.7 (osd.7) 16 : cluster 0 176.3 scrub ok 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:11.535918+0000 mon.a (mon.0) 1505 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:11.536125+0000 mon.a (mon.0) 1506 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: audit 2024-04-19T22:51:11.536336+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.547522+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:10.624912+0000 mon.c (mon.2) 250 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.828487+0000 osd.1 (osd.1) 15 : cluster 0 176.5 scrub starts 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.832810+0000 osd.1 (osd.1) 16 : cluster 0 176.5 scrub ok 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.872681+0000 osd.2 (osd.2) 3 : cluster 0 176.8 scrub starts 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.876572+0000 osd.2 (osd.2) 4 : cluster 0 176.8 scrub ok 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.061165+0000 osd.7 (osd.7) 15 : cluster 0 176.3 scrub starts 2024-04-19T22:51:12.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.065950+0000 osd.7 (osd.7) 16 : cluster 0 176.3 scrub ok 2024-04-19T22:51:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:11.535918+0000 mon.a (mon.0) 1505 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:11.536125+0000 mon.a (mon.0) 1506 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: audit 2024-04-19T22:51:11.536336+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:11 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.547522+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:09.826596+0000 mgr.y (mgr.24389) 243 : cluster 0 pgmap v236: 324 pgs: 32 creating+peering, 292 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 63 op/s 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.338229+0000 mgr.y (mgr.24389) 244 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.0"}]: dispatch 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.338989+0000 mgr.y (mgr.24389) 245 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.1"}]: dispatch 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.339641+0000 mgr.y (mgr.24389) 246 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.2"}]: dispatch 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.340287+0000 mgr.y (mgr.24389) 247 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.3"}]: dispatch 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.340913+0000 mgr.y (mgr.24389) 248 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.4"}]: dispatch 2024-04-19T22:51:12.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.341562+0000 mgr.y (mgr.24389) 249 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.5"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.342307+0000 mgr.y (mgr.24389) 250 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.6"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.342894+0000 mgr.y (mgr.24389) 251 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.7"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.343415+0000 mgr.y (mgr.24389) 252 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.8"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.344123+0000 mgr.y (mgr.24389) 253 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "176.9"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.540142+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.540633+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.113:0/3819049614' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.551336+0000 mon.a (mon.0) 1501 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.553316+0000 mon.a (mon.0) 1502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.555171+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.561946+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.113:0/3434523080' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.581607+0000 mon.a (mon.0) 1504 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:10.624912+0000 mon.c (mon.2) 250 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.828487+0000 osd.1 (osd.1) 15 : cluster 0 176.5 scrub starts 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.832810+0000 osd.1 (osd.1) 16 : cluster 0 176.5 scrub ok 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.872681+0000 osd.2 (osd.2) 3 : cluster 0 176.8 scrub starts 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.876572+0000 osd.2 (osd.2) 4 : cluster 0 176.8 scrub ok 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.061165+0000 osd.7 (osd.7) 15 : cluster 0 176.3 scrub starts 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.065950+0000 osd.7 (osd.7) 16 : cluster 0 176.3 scrub ok 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:11.535918+0000 mon.a (mon.0) 1505 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63989-24"}]': finished 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:11.536125+0000 mon.a (mon.0) 1506 : audit 1 from='client.? 172.21.15.113:0/6230172' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-64071-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: audit 2024-04-19T22:51:11.536336+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi113-63841-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:11 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.547522+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-04-19T22:51:13.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.985327+0000 osd.6 (osd.6) 11 : cluster 0 176.2 scrub starts 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:10.991617+0000 osd.6 (osd.6) 12 : cluster 0 176.2 scrub ok 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.377344+0000 osd.5 (osd.5) 3 : cluster 0 176.6 scrub starts 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.381741+0000 osd.5 (osd.5) 4 : cluster 0 176.6 scrub ok 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: audit 2024-04-19T22:51:11.576134+0000 mon.a (mon.0) 1509 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: audit 2024-04-19T22:51:11.626078+0000 mon.c (mon.2) 251 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:11.827488+0000 mgr.y (mgr.24389) 254 : cluster 0 pgmap v239: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 64 op/s 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: audit 2024-04-19T22:51:12.540537+0000 mon.a (mon.0) 1510 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: cluster 2024-04-19T22:51:12.551568+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: audit 2024-04-19T22:51:12.566162+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.113:0/4032069417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[28910]: audit 2024-04-19T22:51:12.574508+0000 mon.a (mon.0) 1512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.985327+0000 osd.6 (osd.6) 11 : cluster 0 176.2 scrub starts 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:10.991617+0000 osd.6 (osd.6) 12 : cluster 0 176.2 scrub ok 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.377344+0000 osd.5 (osd.5) 3 : cluster 0 176.6 scrub starts 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.381741+0000 osd.5 (osd.5) 4 : cluster 0 176.6 scrub ok 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: audit 2024-04-19T22:51:11.576134+0000 mon.a (mon.0) 1509 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: audit 2024-04-19T22:51:11.626078+0000 mon.c (mon.2) 251 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:11.827488+0000 mgr.y (mgr.24389) 254 : cluster 0 pgmap v239: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 64 op/s 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: audit 2024-04-19T22:51:12.540537+0000 mon.a (mon.0) 1510 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: cluster 2024-04-19T22:51:12.551568+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: audit 2024-04-19T22:51:12.566162+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.113:0/4032069417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:12 smithi113 bash[21528]: audit 2024-04-19T22:51:12.574508+0000 mon.a (mon.0) 1512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.985327+0000 osd.6 (osd.6) 11 : cluster 0 176.2 scrub starts 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:10.991617+0000 osd.6 (osd.6) 12 : cluster 0 176.2 scrub ok 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.377344+0000 osd.5 (osd.5) 3 : cluster 0 176.6 scrub starts 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.381741+0000 osd.5 (osd.5) 4 : cluster 0 176.6 scrub ok 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: audit 2024-04-19T22:51:11.576134+0000 mon.a (mon.0) 1509 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: audit 2024-04-19T22:51:11.626078+0000 mon.c (mon.2) 251 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:11.827488+0000 mgr.y (mgr.24389) 254 : cluster 0 pgmap v239: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 64 op/s 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: audit 2024-04-19T22:51:12.540537+0000 mon.a (mon.0) 1510 : audit 1 from='client.? 172.21.15.113:0/1792942659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi113-63833-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: cluster 2024-04-19T22:51:12.551568+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-04-19T22:51:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: audit 2024-04-19T22:51:12.566162+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.113:0/4032069417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:12 smithi178 bash[23441]: audit 2024-04-19T22:51:12.574508+0000 mon.a (mon.0) 1512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: cluster 2024-04-19T22:51:12.029255+0000 osd.6 (osd.6) 13 : cluster 0 176.9 scrub starts 2024-04-19T22:51:14.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: cluster 2024-04-19T22:51:12.033159+0000 osd.6 (osd.6) 14 : cluster 0 176.9 scrub ok 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: cluster 2024-04-19T22:51:12.355357+0000 osd.5 (osd.5) 5 : cluster 0 176.7 scrub starts 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: cluster 2024-04-19T22:51:12.367466+0000 osd.5 (osd.5) 6 : cluster 0 176.7 scrub ok 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: audit 2024-04-19T22:51:12.627074+0000 mon.c (mon.2) 253 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: audit 2024-04-19T22:51:13.545015+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.557053+0000 mon.a (mon.0) 1514 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: audit 2024-04-19T22:51:13.562768+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.113:0/783765388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[21528]: audit 2024-04-19T22:51:13.574887+0000 mon.a (mon.0) 1515 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: cluster 2024-04-19T22:51:12.029255+0000 osd.6 (osd.6) 13 : cluster 0 176.9 scrub starts 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: cluster 2024-04-19T22:51:12.033159+0000 osd.6 (osd.6) 14 : cluster 0 176.9 scrub ok 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: cluster 2024-04-19T22:51:12.355357+0000 osd.5 (osd.5) 5 : cluster 0 176.7 scrub starts 2024-04-19T22:51:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: cluster 2024-04-19T22:51:12.367466+0000 osd.5 (osd.5) 6 : cluster 0 176.7 scrub ok 2024-04-19T22:51:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: audit 2024-04-19T22:51:12.627074+0000 mon.c (mon.2) 253 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: audit 2024-04-19T22:51:13.545015+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.557053+0000 mon.a (mon.0) 1514 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-04-19T22:51:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: audit 2024-04-19T22:51:13.562768+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.113:0/783765388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:13 smithi113 bash[28910]: audit 2024-04-19T22:51:13.574887+0000 mon.a (mon.0) 1515 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: cluster 2024-04-19T22:51:12.029255+0000 osd.6 (osd.6) 13 : cluster 0 176.9 scrub starts 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: cluster 2024-04-19T22:51:12.033159+0000 osd.6 (osd.6) 14 : cluster 0 176.9 scrub ok 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: cluster 2024-04-19T22:51:12.355357+0000 osd.5 (osd.5) 5 : cluster 0 176.7 scrub starts 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: cluster 2024-04-19T22:51:12.367466+0000 osd.5 (osd.5) 6 : cluster 0 176.7 scrub ok 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: audit 2024-04-19T22:51:12.627074+0000 mon.c (mon.2) 253 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: audit 2024-04-19T22:51:13.545015+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi113-63989-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.557053+0000 mon.a (mon.0) 1514 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: audit 2024-04-19T22:51:13.562768+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.113:0/783765388' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:13 smithi178 bash[23441]: audit 2024-04-19T22:51:13.574887+0000 mon.a (mon.0) 1515 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.077428+0000 osd.6 (osd.6) 15 : cluster 0 176.4 scrub starts 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.081278+0000 osd.6 (osd.6) 16 : cluster 0 176.4 scrub ok 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.357810+0000 osd.5 (osd.5) 7 : cluster 0 176.1 scrub starts 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.362997+0000 osd.5 (osd.5) 8 : cluster 0 176.1 scrub ok 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: audit 2024-04-19T22:51:13.628413+0000 mon.c (mon.2) 255 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:15.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:13.828478+0000 mgr.y (mgr.24389) 255 : cluster 0 pgmap v242: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: audit 2024-04-19T22:51:14.551122+0000 mon.a (mon.0) 1516 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: cluster 2024-04-19T22:51:14.565488+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-04-19T22:51:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: audit 2024-04-19T22:51:14.570583+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.113:0/1263580264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:15 smithi178 bash[23441]: audit 2024-04-19T22:51:14.574116+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.077428+0000 osd.6 (osd.6) 15 : cluster 0 176.4 scrub starts 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.081278+0000 osd.6 (osd.6) 16 : cluster 0 176.4 scrub ok 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.357810+0000 osd.5 (osd.5) 7 : cluster 0 176.1 scrub starts 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.362997+0000 osd.5 (osd.5) 8 : cluster 0 176.1 scrub ok 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: audit 2024-04-19T22:51:13.628413+0000 mon.c (mon.2) 255 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:13.828478+0000 mgr.y (mgr.24389) 255 : cluster 0 pgmap v242: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: audit 2024-04-19T22:51:14.551122+0000 mon.a (mon.0) 1516 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:15.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: cluster 2024-04-19T22:51:14.565488+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: audit 2024-04-19T22:51:14.570583+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.113:0/1263580264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[21528]: audit 2024-04-19T22:51:14.574116+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.077428+0000 osd.6 (osd.6) 15 : cluster 0 176.4 scrub starts 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.081278+0000 osd.6 (osd.6) 16 : cluster 0 176.4 scrub ok 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.357810+0000 osd.5 (osd.5) 7 : cluster 0 176.1 scrub starts 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.362997+0000 osd.5 (osd.5) 8 : cluster 0 176.1 scrub ok 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: audit 2024-04-19T22:51:13.628413+0000 mon.c (mon.2) 255 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:13.828478+0000 mgr.y (mgr.24389) 255 : cluster 0 pgmap v242: 388 pgs: 96 unknown, 32 creating+peering, 260 active+clean; 590 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: audit 2024-04-19T22:51:14.551122+0000 mon.a (mon.0) 1516 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi113-63841-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: cluster 2024-04-19T22:51:14.565488+0000 mon.a (mon.0) 1517 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: audit 2024-04-19T22:51:14.570583+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.113:0/1263580264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:15.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:15 smithi113 bash[28910]: audit 2024-04-19T22:51:14.574116+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:14.629923+0000 mon.c (mon.2) 257 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:14.654428+0000 mon.c (mon.2) 258 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:14.876939+0000 mgr.y (mgr.24389) 256 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.072083+0000 mon.a (mon.0) 1519 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.073226+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.074305+0000 mon.a (mon.0) 1520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.075230+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.075852+0000 mon.a (mon.0) 1521 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.554778+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.555122+0000 mon.a (mon.0) 1523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: cluster 2024-04-19T22:51:15.564264+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.567131+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.569451+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.113:0/415818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.570065+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:14.629923+0000 mon.c (mon.2) 257 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:14.654428+0000 mon.c (mon.2) 258 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:14.876939+0000 mgr.y (mgr.24389) 256 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.072083+0000 mon.a (mon.0) 1519 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.073226+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.074305+0000 mon.a (mon.0) 1520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.075230+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.075852+0000 mon.a (mon.0) 1521 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.554778+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.555122+0000 mon.a (mon.0) 1523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: cluster 2024-04-19T22:51:15.564264+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.567131+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.569451+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.113:0/415818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.570065+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.570755+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[28910]: audit 2024-04-19T22:51:15.630749+0000 mon.c (mon.2) 263 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.570755+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:16 smithi113 bash[21528]: audit 2024-04-19T22:51:15.630749+0000 mon.c (mon.2) 263 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:16.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:14.629923+0000 mon.c (mon.2) 257 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:16.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:14.654428+0000 mon.c (mon.2) 258 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:14.876939+0000 mgr.y (mgr.24389) 256 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:16.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.072083+0000 mon.a (mon.0) 1519 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.073226+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.074305+0000 mon.a (mon.0) 1520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.075230+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.075852+0000 mon.a (mon.0) 1521 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.554778+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63833-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.555122+0000 mon.a (mon.0) 1523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: cluster 2024-04-19T22:51:15.564264+0000 mon.a (mon.0) 1524 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.567131+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.569451+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.113:0/415818748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.570065+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.570755+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:16 smithi178 bash[23441]: audit 2024-04-19T22:51:15.630749+0000 mon.c (mon.2) 263 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[28910]: cluster 2024-04-19T22:51:15.829419+0000 mgr.y (mgr.24389) 257 : cluster 0 pgmap v245: 356 pgs: 32 creating+peering, 32 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[28910]: audit 2024-04-19T22:51:16.566201+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[28910]: audit 2024-04-19T22:51:16.631823+0000 mon.c (mon.2) 264 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[28910]: cluster 2024-04-19T22:51:17.028536+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-04-19T22:51:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[28910]: audit 2024-04-19T22:51:17.035355+0000 mon.a (mon.0) 1529 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21528]: cluster 2024-04-19T22:51:15.829419+0000 mgr.y (mgr.24389) 257 : cluster 0 pgmap v245: 356 pgs: 32 creating+peering, 32 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21528]: audit 2024-04-19T22:51:16.566201+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21528]: audit 2024-04-19T22:51:16.631823+0000 mon.c (mon.2) 264 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21528]: cluster 2024-04-19T22:51:17.028536+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-04-19T22:51:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:17 smithi113 bash[21528]: audit 2024-04-19T22:51:17.035355+0000 mon.a (mon.0) 1529 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:17 smithi178 bash[23441]: cluster 2024-04-19T22:51:15.829419+0000 mgr.y (mgr.24389) 257 : cluster 0 pgmap v245: 356 pgs: 32 creating+peering, 32 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:17 smithi178 bash[23441]: audit 2024-04-19T22:51:16.566201+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi113-63989-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:17 smithi178 bash[23441]: audit 2024-04-19T22:51:16.631823+0000 mon.c (mon.2) 264 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:17 smithi178 bash[23441]: cluster 2024-04-19T22:51:17.028536+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-04-19T22:51:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:17 smithi178 bash[23441]: audit 2024-04-19T22:51:17.035355+0000 mon.a (mon.0) 1529 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:17.570494+0000 mon.a (mon.0) 1530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:17.570746+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: cluster 2024-04-19T22:51:17.579791+0000 mon.a (mon.0) 1532 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:17.585964+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:17.633376+0000 mon.c (mon.2) 265 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: cluster 2024-04-19T22:51:17.830326+0000 mgr.y (mgr.24389) 258 : cluster 0 pgmap v248: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:19.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:18.072415+0000 mon.a (mon.0) 1534 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[28910]: audit 2024-04-19T22:51:18.075093+0000 mon.a (mon.0) 1535 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:17.570494+0000 mon.a (mon.0) 1530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:17.570746+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: cluster 2024-04-19T22:51:17.579791+0000 mon.a (mon.0) 1532 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:17.585964+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:17.633376+0000 mon.c (mon.2) 265 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: cluster 2024-04-19T22:51:17.830326+0000 mgr.y (mgr.24389) 258 : cluster 0 pgmap v248: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:18.072415+0000 mon.a (mon.0) 1534 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:19.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:18 smithi113 bash[21528]: audit 2024-04-19T22:51:18.075093+0000 mon.a (mon.0) 1535 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:19.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:17.570494+0000 mon.a (mon.0) 1530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi113-64071-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:19.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:17.570746+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.113:0/942762860' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi113-63841-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:19.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: cluster 2024-04-19T22:51:17.579791+0000 mon.a (mon.0) 1532 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-04-19T22:51:19.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:17.585964+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:19.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:17.633376+0000 mon.c (mon.2) 265 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:19.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: cluster 2024-04-19T22:51:17.830326+0000 mgr.y (mgr.24389) 258 : cluster 0 pgmap v248: 364 pgs: 72 unknown, 292 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 255 B/s wr, 53 op/s 2024-04-19T22:51:19.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:18.072415+0000 mon.a (mon.0) 1534 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:19.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:18 smithi178 bash[23441]: audit 2024-04-19T22:51:18.075093+0000 mon.a (mon.0) 1535 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: cluster 2024-04-19T22:51:18.572760+0000 mon.a (mon.0) 1536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: audit 2024-04-19T22:51:18.574776+0000 mon.a (mon.0) 1537 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: cluster 2024-04-19T22:51:18.584570+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-04-19T22:51:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: audit 2024-04-19T22:51:18.600203+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: audit 2024-04-19T22:51:18.637388+0000 mon.c (mon.2) 266 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: audit 2024-04-19T22:51:19.579127+0000 mon.a (mon.0) 1540 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[21528]: cluster 2024-04-19T22:51:19.591640+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: cluster 2024-04-19T22:51:18.572760+0000 mon.a (mon.0) 1536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: audit 2024-04-19T22:51:18.574776+0000 mon.a (mon.0) 1537 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: cluster 2024-04-19T22:51:18.584570+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: audit 2024-04-19T22:51:18.600203+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: audit 2024-04-19T22:51:18.637388+0000 mon.c (mon.2) 266 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: audit 2024-04-19T22:51:19.579127+0000 mon.a (mon.0) 1540 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:19 smithi113 bash[28910]: cluster 2024-04-19T22:51:19.591640+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: cluster 2024-04-19T22:51:18.572760+0000 mon.a (mon.0) 1536 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: audit 2024-04-19T22:51:18.574776+0000 mon.a (mon.0) 1537 : audit 1 from='client.? 172.21.15.113:0/4150998467' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi113-63833-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: cluster 2024-04-19T22:51:18.584570+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: audit 2024-04-19T22:51:18.600203+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: audit 2024-04-19T22:51:18.637388+0000 mon.c (mon.2) 266 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: audit 2024-04-19T22:51:19.579127+0000 mon.a (mon.0) 1540 : audit 1 from='client.? 172.21.15.113:0/1273382046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi113-63989-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:19 smithi178 bash[23441]: cluster 2024-04-19T22:51:19.591640+0000 mon.a (mon.0) 1541 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-04-19T22:51:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:19.594795+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.113:0/592305197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:19.613624+0000 mon.a (mon.0) 1542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:19.639507+0000 mon.c (mon.2) 268 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: cluster 2024-04-19T22:51:19.833147+0000 mgr.y (mgr.24389) 259 : cluster 0 pgmap v251: 364 pgs: 32 creating+peering, 332 active+clean; 600 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.492618+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: cluster 2024-04-19T22:51:20.508617+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.527051+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.113:0/655674308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.528019+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.555264+0000 mon.c (mon.2) 270 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.555791+0000 mon.a (mon.0) 1546 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.557158+0000 mon.c (mon.2) 271 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.557622+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.558248+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[21528]: audit 2024-04-19T22:51:20.558630+0000 mon.a (mon.0) 1548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:19.594795+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.113:0/592305197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:19.613624+0000 mon.a (mon.0) 1542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:19.639507+0000 mon.c (mon.2) 268 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: cluster 2024-04-19T22:51:19.833147+0000 mgr.y (mgr.24389) 259 : cluster 0 pgmap v251: 364 pgs: 32 creating+peering, 332 active+clean; 600 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.492618+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: cluster 2024-04-19T22:51:20.508617+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.527051+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.113:0/655674308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.528019+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.555264+0000 mon.c (mon.2) 270 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.555791+0000 mon.a (mon.0) 1546 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.557158+0000 mon.c (mon.2) 271 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.557622+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.558248+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:20 smithi113 bash[28910]: audit 2024-04-19T22:51:20.558630+0000 mon.a (mon.0) 1548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:19.594795+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.113:0/592305197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:19.613624+0000 mon.a (mon.0) 1542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:19.639507+0000 mon.c (mon.2) 268 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: cluster 2024-04-19T22:51:19.833147+0000 mgr.y (mgr.24389) 259 : cluster 0 pgmap v251: 364 pgs: 32 creating+peering, 332 active+clean; 600 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.492618+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: cluster 2024-04-19T22:51:20.508617+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-04-19T22:51:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.527051+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.113:0/655674308' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.528019+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.555264+0000 mon.c (mon.2) 270 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.555791+0000 mon.a (mon.0) 1546 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.557158+0000 mon.c (mon.2) 271 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.557622+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.558248+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:20 smithi178 bash[23441]: audit 2024-04-19T22:51:20.558630+0000 mon.a (mon.0) 1548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: audit 2024-04-19T22:51:20.640516+0000 mon.c (mon.2) 273 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: audit 2024-04-19T22:51:21.496022+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: audit 2024-04-19T22:51:21.496229+0000 mon.a (mon.0) 1550 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: cluster 2024-04-19T22:51:21.504221+0000 mon.a (mon.0) 1551 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: audit 2024-04-19T22:51:21.506852+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[28910]: audit 2024-04-19T22:51:21.507958+0000 mon.a (mon.0) 1552 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: audit 2024-04-19T22:51:20.640516+0000 mon.c (mon.2) 273 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: audit 2024-04-19T22:51:21.496022+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: audit 2024-04-19T22:51:21.496229+0000 mon.a (mon.0) 1550 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: cluster 2024-04-19T22:51:21.504221+0000 mon.a (mon.0) 1551 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: audit 2024-04-19T22:51:21.506852+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:22.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:21 smithi113 bash[21528]: audit 2024-04-19T22:51:21.507958+0000 mon.a (mon.0) 1552 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: audit 2024-04-19T22:51:20.640516+0000 mon.c (mon.2) 273 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: audit 2024-04-19T22:51:21.496022+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi113-63833-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: audit 2024-04-19T22:51:21.496229+0000 mon.a (mon.0) 1550 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: cluster 2024-04-19T22:51:21.504221+0000 mon.a (mon.0) 1551 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: audit 2024-04-19T22:51:21.506852+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:22.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:21 smithi178 bash[23441]: audit 2024-04-19T22:51:21.507958+0000 mon.a (mon.0) 1552 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: cluster 2024-04-19T22:51:21.574796+0000 osd.3 (osd.3) 7 : cluster 0 176.0 scrub starts 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: cluster 2024-04-19T22:51:21.579046+0000 osd.3 (osd.3) 8 : cluster 0 176.0 scrub ok 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: audit 2024-04-19T22:51:21.641615+0000 mon.c (mon.2) 275 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: cluster 2024-04-19T22:51:21.834009+0000 mgr.y (mgr.24389) 260 : cluster 0 pgmap v254: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: audit 2024-04-19T22:51:22.643044+0000 mon.c (mon.2) 276 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: cluster 2024-04-19T22:51:22.947514+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: audit 2024-04-19T22:51:22.949345+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.113:0/1080848809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[28910]: audit 2024-04-19T22:51:22.950550+0000 mon.a (mon.0) 1554 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:23.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: cluster 2024-04-19T22:51:21.574796+0000 osd.3 (osd.3) 7 : cluster 0 176.0 scrub starts 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: cluster 2024-04-19T22:51:21.579046+0000 osd.3 (osd.3) 8 : cluster 0 176.0 scrub ok 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: audit 2024-04-19T22:51:21.641615+0000 mon.c (mon.2) 275 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: cluster 2024-04-19T22:51:21.834009+0000 mgr.y (mgr.24389) 260 : cluster 0 pgmap v254: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: audit 2024-04-19T22:51:22.643044+0000 mon.c (mon.2) 276 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: cluster 2024-04-19T22:51:22.947514+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: audit 2024-04-19T22:51:22.949345+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.113:0/1080848809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:23 smithi113 bash[21528]: audit 2024-04-19T22:51:22.950550+0000 mon.a (mon.0) 1554 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: cluster 2024-04-19T22:51:21.574796+0000 osd.3 (osd.3) 7 : cluster 0 176.0 scrub starts 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: cluster 2024-04-19T22:51:21.579046+0000 osd.3 (osd.3) 8 : cluster 0 176.0 scrub ok 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: audit 2024-04-19T22:51:21.641615+0000 mon.c (mon.2) 275 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: cluster 2024-04-19T22:51:21.834009+0000 mgr.y (mgr.24389) 260 : cluster 0 pgmap v254: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: audit 2024-04-19T22:51:22.643044+0000 mon.c (mon.2) 276 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: cluster 2024-04-19T22:51:22.947514+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: audit 2024-04-19T22:51:22.949345+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.113:0/1080848809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:23 smithi178 bash[23441]: audit 2024-04-19T22:51:22.950550+0000 mon.a (mon.0) 1554 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: seed 64071 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5686 ms) 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4423 ms) 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-19T22:51:24.525 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (4039 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (4089 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (7452 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (25690 ms total) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (9233 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (7873 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (9123 ms) 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-19T22:51:24.526 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (5283 ms) 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2484 ms) 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi113-64071-7 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: waiting for snaps to purge 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (20274 ms) 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (54270 ms total) 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-19T22:51:24.527 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (14 ms) 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5072 ms) 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5086 ms total) 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2923 ms) 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2436 ms) 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-19T22:51:24.528 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1580 ms) 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: audit 2024-04-19T22:51:23.513687+0000 mon.a (mon.0) 1555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: audit 2024-04-19T22:51:23.513936+0000 mon.a (mon.0) 1556 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: cluster 2024-04-19T22:51:23.522619+0000 mon.a (mon.0) 1557 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: audit 2024-04-19T22:51:23.527539+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.113:0/1421974732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: audit 2024-04-19T22:51:23.545957+0000 mon.a (mon.0) 1558 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:24.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[23441]: audit 2024-04-19T22:51:23.644595+0000 mon.c (mon.2) 279 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: audit 2024-04-19T22:51:23.513687+0000 mon.a (mon.0) 1555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: audit 2024-04-19T22:51:23.513936+0000 mon.a (mon.0) 1556 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: cluster 2024-04-19T22:51:23.522619+0000 mon.a (mon.0) 1557 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: audit 2024-04-19T22:51:23.527539+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.113:0/1421974732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: audit 2024-04-19T22:51:23.545957+0000 mon.a (mon.0) 1558 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[28910]: audit 2024-04-19T22:51:23.644595+0000 mon.c (mon.2) 279 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: audit 2024-04-19T22:51:23.513687+0000 mon.a (mon.0) 1555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi113-63989-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: audit 2024-04-19T22:51:23.513936+0000 mon.a (mon.0) 1556 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi113-63841-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: cluster 2024-04-19T22:51:23.522619+0000 mon.a (mon.0) 1557 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-04-19T22:51:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: audit 2024-04-19T22:51:23.527539+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.113:0/1421974732' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: audit 2024-04-19T22:51:23.545957+0000 mon.a (mon.0) 1558 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:24 smithi113 bash[21528]: audit 2024-04-19T22:51:23.644595+0000 mon.c (mon.2) 279 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:25.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:25.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: cluster 2024-04-19T22:51:23.835025+0000 mgr.y (mgr.24389) 261 : cluster 0 pgmap v257: 372 pgs: 72 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: cluster 2024-04-19T22:51:24.515299+0000 mon.a (mon.0) 1559 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: audit 2024-04-19T22:51:24.517150+0000 mon.a (mon.0) 1560 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: cluster 2024-04-19T22:51:24.525476+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-04-19T22:51:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: audit 2024-04-19T22:51:24.645630+0000 mon.c (mon.2) 280 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:25 smithi178 bash[23441]: audit 2024-04-19T22:51:24.888305+0000 mgr.y (mgr.24389) 262 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:26.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: cluster 2024-04-19T22:51:23.835025+0000 mgr.y (mgr.24389) 261 : cluster 0 pgmap v257: 372 pgs: 72 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:26.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: cluster 2024-04-19T22:51:24.515299+0000 mon.a (mon.0) 1559 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: audit 2024-04-19T22:51:24.517150+0000 mon.a (mon.0) 1560 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: cluster 2024-04-19T22:51:24.525476+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: audit 2024-04-19T22:51:24.645630+0000 mon.c (mon.2) 280 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[28910]: audit 2024-04-19T22:51:24.888305+0000 mgr.y (mgr.24389) 262 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: cluster 2024-04-19T22:51:23.835025+0000 mgr.y (mgr.24389) 261 : cluster 0 pgmap v257: 372 pgs: 72 unknown, 300 active+clean; 592 KiB data, 538 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: cluster 2024-04-19T22:51:24.515299+0000 mon.a (mon.0) 1559 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: audit 2024-04-19T22:51:24.517150+0000 mon.a (mon.0) 1560 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi113-63833-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: cluster 2024-04-19T22:51:24.525476+0000 mon.a (mon.0) 1561 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-04-19T22:51:26.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: audit 2024-04-19T22:51:24.645630+0000 mon.c (mon.2) 280 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:25 smithi113 bash[21528]: audit 2024-04-19T22:51:24.888305+0000 mgr.y (mgr.24389) 262 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: cluster 2024-04-19T22:51:25.569193+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: audit 2024-04-19T22:51:25.574322+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.113:0/654813227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: audit 2024-04-19T22:51:25.575757+0000 mon.a (mon.0) 1563 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: audit 2024-04-19T22:51:25.590641+0000 mon.c (mon.2) 282 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: audit 2024-04-19T22:51:25.593592+0000 mon.a (mon.0) 1564 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: audit 2024-04-19T22:51:25.646529+0000 mon.c (mon.2) 283 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[28910]: cluster 2024-04-19T22:51:25.835898+0000 mgr.y (mgr.24389) 263 : cluster 0 pgmap v260: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:51:27.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: cluster 2024-04-19T22:51:25.569193+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: audit 2024-04-19T22:51:25.574322+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.113:0/654813227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: audit 2024-04-19T22:51:25.575757+0000 mon.a (mon.0) 1563 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: audit 2024-04-19T22:51:25.590641+0000 mon.c (mon.2) 282 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: audit 2024-04-19T22:51:25.593592+0000 mon.a (mon.0) 1564 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: audit 2024-04-19T22:51:25.646529+0000 mon.c (mon.2) 283 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:26 smithi113 bash[21528]: cluster 2024-04-19T22:51:25.835898+0000 mgr.y (mgr.24389) 263 : cluster 0 pgmap v260: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: cluster 2024-04-19T22:51:25.569193+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: audit 2024-04-19T22:51:25.574322+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.113:0/654813227' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: audit 2024-04-19T22:51:25.575757+0000 mon.a (mon.0) 1563 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: audit 2024-04-19T22:51:25.590641+0000 mon.c (mon.2) 282 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: audit 2024-04-19T22:51:25.593592+0000 mon.a (mon.0) 1564 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: audit 2024-04-19T22:51:25.646529+0000 mon.c (mon.2) 283 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:26 smithi178 bash[23441]: cluster 2024-04-19T22:51:25.835898+0000 mgr.y (mgr.24389) 263 : cluster 0 pgmap v260: 332 pgs: 32 unknown, 300 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:51:27.597 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_3526 ms total) 2024-04-19T22:51:27.597 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (177 ms) 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (177 ms total) 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (79 ms) 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-04-19T22:51:27.598 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (2 ms) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (81 ms total) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (64 ms) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (2 ms) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (66 ms total) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (63 ms) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (6 ms) 2024-04-19T22:51:27.599 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (69 ms total) 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1084 ms) 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1084 ms total) 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (118218 ms total) 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-04-19T22:51:27.600 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: Running main() from gmock_main.cc 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] Global test environment set-up. 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (21694 ms) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (10334 ms) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (8092 ms) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (10415 ms) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (15695 ms) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (66230 ms total) 2024-04-19T22:51:27.601 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (7590 ms) 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6262 ms) 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (9202 ms) 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5220 ms) 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4367 ms) 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi113-64687-11. 2024-04-19T22:51:27.602 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: Waiting for snaps to purge. 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19052 ms) 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (51693 ms total) 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [----------] Global test environment tear-down 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (117923 ms total) 2024-04-19T22:51:27.603 INFO:tasks.workunit.client.0.smithi113.stdout: snapshots: [ PASSED ] 11 tests. 2024-04-19T22:51:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.573281+0000 mon.a (mon.0) 1565 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.573480+0000 mon.a (mon.0) 1566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: cluster 2024-04-19T22:51:26.584930+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.588357+0000 mon.c (mon.2) 284 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.600028+0000 mon.a (mon.0) 1568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.600823+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[21528]: audit 2024-04-19T22:51:26.647420+0000 mon.c (mon.2) 285 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.573281+0000 mon.a (mon.0) 1565 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.573480+0000 mon.a (mon.0) 1566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: cluster 2024-04-19T22:51:26.584930+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.588357+0000 mon.c (mon.2) 284 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.600028+0000 mon.a (mon.0) 1568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.600823+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:27 smithi113 bash[28910]: audit 2024-04-19T22:51:26.647420+0000 mon.c (mon.2) 285 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:28.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.573281+0000 mon.a (mon.0) 1565 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi113-63841-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:28.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.573480+0000 mon.a (mon.0) 1566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:28.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: cluster 2024-04-19T22:51:26.584930+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-04-19T22:51:28.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.588357+0000 mon.c (mon.2) 284 : audit 1 from='client.? 172.21.15.113:0/277230769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:28.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.600028+0000 mon.a (mon.0) 1568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]: dispatch 2024-04-19T22:51:28.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.600823+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:28.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:27 smithi178 bash[23441]: audit 2024-04-19T22:51:26.647420+0000 mon.c (mon.2) 285 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:27.577372+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:27.577580+0000 mon.a (mon.0) 1571 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: cluster 2024-04-19T22:51:27.589649+0000 mon.a (mon.0) 1572 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:27.592156+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:27.607556+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:27.648388+0000 mon.c (mon.2) 287 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: cluster 2024-04-19T22:51:27.836714+0000 mgr.y (mgr.24389) 264 : cluster 0 pgmap v263: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:28.581127+0000 mon.a (mon.0) 1574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:28.591592+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: cluster 2024-04-19T22:51:28.593055+0000 mon.a (mon.0) 1575 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:28.599037+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.113:0/2824719495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:28.599993+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[28910]: audit 2024-04-19T22:51:28.600363+0000 mon.a (mon.0) 1577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:27.577372+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:27.577580+0000 mon.a (mon.0) 1571 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: cluster 2024-04-19T22:51:27.589649+0000 mon.a (mon.0) 1572 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:27.592156+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:27.607556+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:27.648388+0000 mon.c (mon.2) 287 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: cluster 2024-04-19T22:51:27.836714+0000 mgr.y (mgr.24389) 264 : cluster 0 pgmap v263: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:28.581127+0000 mon.a (mon.0) 1574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:28.591592+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: cluster 2024-04-19T22:51:28.593055+0000 mon.a (mon.0) 1575 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:28.599037+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.113:0/2824719495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:28.599993+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:28 smithi113 bash[21528]: audit 2024-04-19T22:51:28.600363+0000 mon.a (mon.0) 1577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:27.577372+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi113-63989-36"}]': finished 2024-04-19T22:51:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:27.577580+0000 mon.a (mon.0) 1571 : audit 1 from='client.? 172.21.15.113:0/436000182' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi113-63833-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: cluster 2024-04-19T22:51:27.589649+0000 mon.a (mon.0) 1572 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-04-19T22:51:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:27.592156+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:27.607556+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:27.648388+0000 mon.c (mon.2) 287 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: cluster 2024-04-19T22:51:27.836714+0000 mgr.y (mgr.24389) 264 : cluster 0 pgmap v263: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 522 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:28.581127+0000 mon.a (mon.0) 1574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:28.591592+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.113:0/3966343231' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: cluster 2024-04-19T22:51:28.593055+0000 mon.a (mon.0) 1575 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:28.599037+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.113:0/2824719495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:28.599993+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]: dispatch 2024-04-19T22:51:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:28 smithi178 bash[23441]: audit 2024-04-19T22:51:28.600363+0000 mon.a (mon.0) 1577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:30.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[28910]: audit 2024-04-19T22:51:28.649361+0000 mon.c (mon.2) 290 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[28910]: audit 2024-04-19T22:51:29.586474+0000 mon.a (mon.0) 1578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[28910]: audit 2024-04-19T22:51:29.586745+0000 mon.a (mon.0) 1579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[28910]: cluster 2024-04-19T22:51:29.599473+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[28910]: audit 2024-04-19T22:51:29.607038+0000 mon.a (mon.0) 1581 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[21528]: audit 2024-04-19T22:51:28.649361+0000 mon.c (mon.2) 290 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[21528]: audit 2024-04-19T22:51:29.586474+0000 mon.a (mon.0) 1578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[21528]: audit 2024-04-19T22:51:29.586745+0000 mon.a (mon.0) 1579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[21528]: cluster 2024-04-19T22:51:29.599473+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-04-19T22:51:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:29 smithi113 bash[21528]: audit 2024-04-19T22:51:29.607038+0000 mon.a (mon.0) 1581 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:30.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:29 smithi178 bash[23441]: audit 2024-04-19T22:51:28.649361+0000 mon.c (mon.2) 290 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:30.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:29 smithi178 bash[23441]: audit 2024-04-19T22:51:29.586474+0000 mon.a (mon.0) 1578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi113-64071-16"}]': finished 2024-04-19T22:51:30.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:29 smithi178 bash[23441]: audit 2024-04-19T22:51:29.586745+0000 mon.a (mon.0) 1579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi113-63841-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:29 smithi178 bash[23441]: cluster 2024-04-19T22:51:29.599473+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-04-19T22:51:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:29 smithi178 bash[23441]: audit 2024-04-19T22:51:29.607038+0000 mon.a (mon.0) 1581 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.644427+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.644846+0000 mon.a (mon.0) 1582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.645934+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.646634+0000 mon.a (mon.0) 1583 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.647473+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.647855+0000 mon.a (mon.0) 1584 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:29.650091+0000 mon.c (mon.2) 294 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: cluster 2024-04-19T22:51:29.839451+0000 mgr.y (mgr.24389) 265 : cluster 0 pgmap v266: 324 pgs: 32 creating+peering, 292 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: cluster 2024-04-19T22:51:30.493997+0000 mon.a (mon.0) 1585 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:30.589388+0000 mon.a (mon.0) 1586 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:30.589703+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: cluster 2024-04-19T22:51:30.599118+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:30.599448+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[28910]: audit 2024-04-19T22:51:30.601520+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.644427+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.644846+0000 mon.a (mon.0) 1582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.645934+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.646634+0000 mon.a (mon.0) 1583 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.647473+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.647855+0000 mon.a (mon.0) 1584 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:29.650091+0000 mon.c (mon.2) 294 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: cluster 2024-04-19T22:51:29.839451+0000 mgr.y (mgr.24389) 265 : cluster 0 pgmap v266: 324 pgs: 32 creating+peering, 292 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: cluster 2024-04-19T22:51:30.493997+0000 mon.a (mon.0) 1585 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:30.589388+0000 mon.a (mon.0) 1586 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:30.589703+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: cluster 2024-04-19T22:51:30.599118+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:30.599448+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:31 smithi113 bash[21528]: audit 2024-04-19T22:51:30.601520+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.644427+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.644846+0000 mon.a (mon.0) 1582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.645934+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.646634+0000 mon.a (mon.0) 1583 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.647473+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.647855+0000 mon.a (mon.0) 1584 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:29.650091+0000 mon.c (mon.2) 294 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: cluster 2024-04-19T22:51:29.839451+0000 mgr.y (mgr.24389) 265 : cluster 0 pgmap v266: 324 pgs: 32 creating+peering, 292 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: cluster 2024-04-19T22:51:30.493997+0000 mon.a (mon.0) 1585 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:30.589388+0000 mon.a (mon.0) 1586 : audit 1 from='client.? 172.21.15.113:0/921486992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi113-63833-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:30.589703+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: cluster 2024-04-19T22:51:30.599118+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:30.599448+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:31 smithi178 bash[23441]: audit 2024-04-19T22:51:30.601520+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:32.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[28910]: audit 2024-04-19T22:51:30.650905+0000 mon.c (mon.2) 296 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[28910]: audit 2024-04-19T22:51:31.651887+0000 mon.c (mon.2) 297 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[28910]: cluster 2024-04-19T22:51:32.021526+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[28910]: audit 2024-04-19T22:51:32.025851+0000 mon.a (mon.0) 1591 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[21528]: audit 2024-04-19T22:51:30.650905+0000 mon.c (mon.2) 296 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[21528]: audit 2024-04-19T22:51:31.651887+0000 mon.c (mon.2) 297 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[21528]: cluster 2024-04-19T22:51:32.021526+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-04-19T22:51:32.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:32 smithi113 bash[21528]: audit 2024-04-19T22:51:32.025851+0000 mon.a (mon.0) 1591 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:32.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:32 smithi178 bash[23441]: audit 2024-04-19T22:51:30.650905+0000 mon.c (mon.2) 296 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:32 smithi178 bash[23441]: audit 2024-04-19T22:51:31.651887+0000 mon.c (mon.2) 297 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:32.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:32 smithi178 bash[23441]: cluster 2024-04-19T22:51:32.021526+0000 mon.a (mon.0) 1590 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-04-19T22:51:32.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:32 smithi178 bash[23441]: audit 2024-04-19T22:51:32.025851+0000 mon.a (mon.0) 1591 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: cluster 2024-04-19T22:51:31.840308+0000 mgr.y (mgr.24389) 266 : cluster 0 pgmap v269: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:32.606291+0000 mon.a (mon.0) 1592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:32.606711+0000 mon.a (mon.0) 1593 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: cluster 2024-04-19T22:51:32.616403+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:32.620367+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.113:0/961053050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:32.633625+0000 mon.a (mon.0) 1595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:32.653205+0000 mon.c (mon.2) 299 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[28910]: audit 2024-04-19T22:51:33.108277+0000 mon.a (mon.0) 1596 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:33.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: cluster 2024-04-19T22:51:31.840308+0000 mgr.y (mgr.24389) 266 : cluster 0 pgmap v269: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:32.606291+0000 mon.a (mon.0) 1592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:32.606711+0000 mon.a (mon.0) 1593 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: cluster 2024-04-19T22:51:32.616403+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:32.620367+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.113:0/961053050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:32.633625+0000 mon.a (mon.0) 1595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:32.653205+0000 mon.c (mon.2) 299 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:33.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:33 smithi113 bash[21528]: audit 2024-04-19T22:51:33.108277+0000 mon.a (mon.0) 1596 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: cluster 2024-04-19T22:51:31.840308+0000 mgr.y (mgr.24389) 266 : cluster 0 pgmap v269: 292 pgs: 32 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:32.606291+0000 mon.a (mon.0) 1592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:32.606711+0000 mon.a (mon.0) 1593 : audit 1 from='client.? 172.21.15.113:0/3811092323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi113-63841-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: cluster 2024-04-19T22:51:32.616403+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:32.620367+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.113:0/961053050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:32.633625+0000 mon.a (mon.0) 1595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:33.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:32.653205+0000 mon.c (mon.2) 299 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:33.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:33 smithi178 bash[23441]: audit 2024-04-19T22:51:33.108277+0000 mon.a (mon.0) 1596 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: Running main() from gmock_main.cc 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] Global test environment set-up. 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-04-19T22:51:34.645 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.TooBig (17324 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (13240 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (5946 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (8018 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (5149 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6817 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (6251 ms) 2024-04-19T22:51:34.646 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4928 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (4180 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (4278 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3393 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3365 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3405 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3359 ms) 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-04-19T22:51:34.647 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.Flush (2200 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3027 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3359 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3035 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3010 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3457 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2565 ms) 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-04-19T22:51:34.648 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3354 ms) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2625 ms) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3024 ms) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3427 ms) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2623 ms) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] 26 tests from LibRadosAio (125360 ms total) 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: 2024-04-19T22:51:34.649 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-04-19T22:51:34.897 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:34 smithi178 bash[23441]: audit 2024-04-19T22:51:33.609422+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:34.897 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:34 smithi178 bash[23441]: cluster 2024-04-19T22:51:33.617372+0000 mon.a (mon.0) 1598 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-04-19T22:51:34.897 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:34 smithi178 bash[23441]: audit 2024-04-19T22:51:33.654557+0000 mon.c (mon.2) 300 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:34.897 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:34 smithi178 bash[23441]: cluster 2024-04-19T22:51:33.841120+0000 mgr.y (mgr.24389) 267 : cluster 0 pgmap v272: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:35.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[28910]: audit 2024-04-19T22:51:33.609422+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[28910]: cluster 2024-04-19T22:51:33.617372+0000 mon.a (mon.0) 1598 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[28910]: audit 2024-04-19T22:51:33.654557+0000 mon.c (mon.2) 300 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[28910]: cluster 2024-04-19T22:51:33.841120+0000 mgr.y (mgr.24389) 267 : cluster 0 pgmap v272: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[21528]: audit 2024-04-19T22:51:33.609422+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi113-63833-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[21528]: cluster 2024-04-19T22:51:33.617372+0000 mon.a (mon.0) 1598 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[21528]: audit 2024-04-19T22:51:33.654557+0000 mon.c (mon.2) 300 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:35.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:34 smithi113 bash[21528]: cluster 2024-04-19T22:51:33.841120+0000 mgr.y (mgr.24389) 267 : cluster 0 pgmap v272: 300 pgs: 40 unknown, 260 active+clean; 592 KiB data, 527 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:35.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:36.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: cluster 2024-04-19T22:51:34.639021+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-04-19T22:51:36.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.642652+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.113:0/819267649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.643923+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.656925+0000 mon.c (mon.2) 302 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.680268+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.681045+0000 mon.a (mon.0) 1601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.681610+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.681860+0000 mon.a (mon.0) 1602 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.682438+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.682714+0000 mon.a (mon.0) 1603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: audit 2024-04-19T22:51:34.899787+0000 mgr.y (mgr.24389) 268 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[21528]: cluster 2024-04-19T22:51:35.495467+0000 mon.a (mon.0) 1604 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: cluster 2024-04-19T22:51:34.639021+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.642652+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.113:0/819267649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.643923+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.656925+0000 mon.c (mon.2) 302 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.680268+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.681045+0000 mon.a (mon.0) 1601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.681610+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.681860+0000 mon.a (mon.0) 1602 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.682438+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.682714+0000 mon.a (mon.0) 1603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: audit 2024-04-19T22:51:34.899787+0000 mgr.y (mgr.24389) 268 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:35 smithi113 bash[28910]: cluster 2024-04-19T22:51:35.495467+0000 mon.a (mon.0) 1604 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: cluster 2024-04-19T22:51:34.639021+0000 mon.a (mon.0) 1599 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-04-19T22:51:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.642652+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.113:0/819267649' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.643923+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.656925+0000 mon.c (mon.2) 302 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.680268+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.681045+0000 mon.a (mon.0) 1601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.681610+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.681860+0000 mon.a (mon.0) 1602 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.682438+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.682714+0000 mon.a (mon.0) 1603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: audit 2024-04-19T22:51:34.899787+0000 mgr.y (mgr.24389) 268 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:35 smithi178 bash[23441]: cluster 2024-04-19T22:51:35.495467+0000 mon.a (mon.0) 1604 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: audit 2024-04-19T22:51:35.626946+0000 mon.a (mon.0) 1605 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: audit 2024-04-19T22:51:35.627194+0000 mon.a (mon.0) 1606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: cluster 2024-04-19T22:51:35.636804+0000 mon.a (mon.0) 1607 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: audit 2024-04-19T22:51:35.642761+0000 mon.c (mon.2) 306 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: audit 2024-04-19T22:51:35.661078+0000 mon.c (mon.2) 307 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: audit 2024-04-19T22:51:35.661813+0000 mon.a (mon.0) 1608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[21528]: cluster 2024-04-19T22:51:35.842022+0000 mgr.y (mgr.24389) 269 : cluster 0 pgmap v275: 300 pgs: 32 creating+peering, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: audit 2024-04-19T22:51:35.626946+0000 mon.a (mon.0) 1605 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: audit 2024-04-19T22:51:35.627194+0000 mon.a (mon.0) 1606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: cluster 2024-04-19T22:51:35.636804+0000 mon.a (mon.0) 1607 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: audit 2024-04-19T22:51:35.642761+0000 mon.c (mon.2) 306 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: audit 2024-04-19T22:51:35.661078+0000 mon.c (mon.2) 307 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: audit 2024-04-19T22:51:35.661813+0000 mon.a (mon.0) 1608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:36 smithi113 bash[28910]: cluster 2024-04-19T22:51:35.842022+0000 mgr.y (mgr.24389) 269 : cluster 0 pgmap v275: 300 pgs: 32 creating+peering, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: audit 2024-04-19T22:51:35.626946+0000 mon.a (mon.0) 1605 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi113-63841-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: audit 2024-04-19T22:51:35.627194+0000 mon.a (mon.0) 1606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi113-63833-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: cluster 2024-04-19T22:51:35.636804+0000 mon.a (mon.0) 1607 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: audit 2024-04-19T22:51:35.642761+0000 mon.c (mon.2) 306 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: audit 2024-04-19T22:51:35.661078+0000 mon.c (mon.2) 307 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: audit 2024-04-19T22:51:35.661813+0000 mon.a (mon.0) 1608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:36 smithi178 bash[23441]: cluster 2024-04-19T22:51:35.842022+0000 mgr.y (mgr.24389) 269 : cluster 0 pgmap v275: 300 pgs: 32 creating+peering, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:37.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:37 smithi113 bash[28910]: audit 2024-04-19T22:51:36.671626+0000 mon.c (mon.2) 308 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:37 smithi113 bash[28910]: cluster 2024-04-19T22:51:37.121433+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-04-19T22:51:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:37 smithi113 bash[21528]: audit 2024-04-19T22:51:36.671626+0000 mon.c (mon.2) 308 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:37 smithi113 bash[21528]: cluster 2024-04-19T22:51:37.121433+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-04-19T22:51:37.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:38.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:37 smithi178 bash[23441]: audit 2024-04-19T22:51:36.671626+0000 mon.c (mon.2) 308 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:38.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:37 smithi178 bash[23441]: cluster 2024-04-19T22:51:37.121433+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: audit 2024-04-19T22:51:37.673727+0000 mon.c (mon.2) 309 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: audit 2024-04-19T22:51:37.677272+0000 mon.a (mon.0) 1610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: cluster 2024-04-19T22:51:37.686465+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: audit 2024-04-19T22:51:37.690145+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.113:0/3746368793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: audit 2024-04-19T22:51:37.691760+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[21528]: cluster 2024-04-19T22:51:37.842963+0000 mgr.y (mgr.24389) 270 : cluster 0 pgmap v278: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: audit 2024-04-19T22:51:37.673727+0000 mon.c (mon.2) 309 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: audit 2024-04-19T22:51:37.677272+0000 mon.a (mon.0) 1610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: cluster 2024-04-19T22:51:37.686465+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-04-19T22:51:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: audit 2024-04-19T22:51:37.690145+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.113:0/3746368793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: audit 2024-04-19T22:51:37.691760+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:38 smithi113 bash[28910]: cluster 2024-04-19T22:51:37.842963+0000 mgr.y (mgr.24389) 270 : cluster 0 pgmap v278: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: audit 2024-04-19T22:51:37.673727+0000 mon.c (mon.2) 309 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: audit 2024-04-19T22:51:37.677272+0000 mon.a (mon.0) 1610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi113-63833-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: cluster 2024-04-19T22:51:37.686465+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: audit 2024-04-19T22:51:37.690145+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.113:0/3746368793' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: audit 2024-04-19T22:51:37.691760+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:39.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:38 smithi178 bash[23441]: cluster 2024-04-19T22:51:37.842963+0000 mgr.y (mgr.24389) 270 : cluster 0 pgmap v278: 308 pgs: 40 unknown, 268 active+clean; 608 KiB data, 532 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-04-19T22:51:40.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[28910]: audit 2024-04-19T22:51:38.676482+0000 mon.c (mon.2) 311 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:40.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[28910]: audit 2024-04-19T22:51:38.680362+0000 mon.a (mon.0) 1613 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:40.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[28910]: cluster 2024-04-19T22:51:38.687891+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-04-19T22:51:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[21528]: audit 2024-04-19T22:51:38.676482+0000 mon.c (mon.2) 311 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[21528]: audit 2024-04-19T22:51:38.680362+0000 mon.a (mon.0) 1613 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:39 smithi113 bash[21528]: cluster 2024-04-19T22:51:38.687891+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-04-19T22:51:40.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:39 smithi178 bash[23441]: audit 2024-04-19T22:51:38.676482+0000 mon.c (mon.2) 311 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:40.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:39 smithi178 bash[23441]: audit 2024-04-19T22:51:38.680362+0000 mon.a (mon.0) 1613 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi113-63841-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:40.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:39 smithi178 bash[23441]: cluster 2024-04-19T22:51:38.687891+0000 mon.a (mon.0) 1614 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: audit 2024-04-19T22:51:39.678172+0000 mon.c (mon.2) 312 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: cluster 2024-04-19T22:51:39.705969+0000 mon.a (mon.0) 1615 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: audit 2024-04-19T22:51:39.717608+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: audit 2024-04-19T22:51:39.719154+0000 mon.a (mon.0) 1616 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: cluster 2024-04-19T22:51:39.844573+0000 mgr.y (mgr.24389) 271 : cluster 0 pgmap v281: 268 pgs: 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[21528]: cluster 2024-04-19T22:51:40.496991+0000 mon.a (mon.0) 1617 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: audit 2024-04-19T22:51:39.678172+0000 mon.c (mon.2) 312 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: cluster 2024-04-19T22:51:39.705969+0000 mon.a (mon.0) 1615 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: audit 2024-04-19T22:51:39.717608+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: audit 2024-04-19T22:51:39.719154+0000 mon.a (mon.0) 1616 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: cluster 2024-04-19T22:51:39.844573+0000 mgr.y (mgr.24389) 271 : cluster 0 pgmap v281: 268 pgs: 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:41.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:40 smithi113 bash[28910]: cluster 2024-04-19T22:51:40.496991+0000 mon.a (mon.0) 1617 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:41.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: audit 2024-04-19T22:51:39.678172+0000 mon.c (mon.2) 312 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:41.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: cluster 2024-04-19T22:51:39.705969+0000 mon.a (mon.0) 1615 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-04-19T22:51:41.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: audit 2024-04-19T22:51:39.717608+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: audit 2024-04-19T22:51:39.719154+0000 mon.a (mon.0) 1616 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:41.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: cluster 2024-04-19T22:51:39.844573+0000 mgr.y (mgr.24389) 271 : cluster 0 pgmap v281: 268 pgs: 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:40 smithi178 bash[23441]: cluster 2024-04-19T22:51:40.496991+0000 mon.a (mon.0) 1617 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.679800+0000 mon.c (mon.2) 314 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.708846+0000 mon.a (mon.0) 1618 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: cluster 2024-04-19T22:51:40.718095+0000 mon.a (mon.0) 1619 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.718370+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.721328+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.113:0/3703106199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.736344+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[28910]: audit 2024-04-19T22:51:40.738763+0000 mon.a (mon.0) 1621 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.679800+0000 mon.c (mon.2) 314 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.708846+0000 mon.a (mon.0) 1618 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: cluster 2024-04-19T22:51:40.718095+0000 mon.a (mon.0) 1619 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.718370+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.721328+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.113:0/3703106199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.736344+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:41 smithi113 bash[21528]: audit 2024-04-19T22:51:40.738763+0000 mon.a (mon.0) 1621 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.679800+0000 mon.c (mon.2) 314 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.708846+0000 mon.a (mon.0) 1618 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: cluster 2024-04-19T22:51:40.718095+0000 mon.a (mon.0) 1619 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.718370+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.113:0/1922077773' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.721328+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.113:0/3703106199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.736344+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]: dispatch 2024-04-19T22:51:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:41 smithi178 bash[23441]: audit 2024-04-19T22:51:40.738763+0000 mon.a (mon.0) 1621 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.681787+0000 mon.c (mon.2) 317 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.683121+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.683925+0000 mon.a (mon.0) 1622 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.713503+0000 mon.a (mon.0) 1623 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.713721+0000 mon.a (mon.0) 1624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.713946+0000 mon.a (mon.0) 1625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: cluster 2024-04-19T22:51:41.722914+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.727115+0000 mon.c (mon.2) 319 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.729773+0000 mon.c (mon.2) 320 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.736453+0000 mon.c (mon.2) 321 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.737963+0000 mon.a (mon.0) 1627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.769385+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.769936+0000 mon.a (mon.0) 1628 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.771027+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.771340+0000 mon.a (mon.0) 1629 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.772196+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: audit 2024-04-19T22:51:41.772616+0000 mon.a (mon.0) 1630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[21528]: cluster 2024-04-19T22:51:41.845185+0000 mgr.y (mgr.24389) 272 : cluster 0 pgmap v284: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.681787+0000 mon.c (mon.2) 317 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.683121+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.683925+0000 mon.a (mon.0) 1622 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.713503+0000 mon.a (mon.0) 1623 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.713721+0000 mon.a (mon.0) 1624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.713946+0000 mon.a (mon.0) 1625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: cluster 2024-04-19T22:51:41.722914+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-04-19T22:51:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.727115+0000 mon.c (mon.2) 319 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.729773+0000 mon.c (mon.2) 320 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.736453+0000 mon.c (mon.2) 321 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.737963+0000 mon.a (mon.0) 1627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.769385+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.769936+0000 mon.a (mon.0) 1628 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.771027+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.771340+0000 mon.a (mon.0) 1629 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.772196+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: audit 2024-04-19T22:51:41.772616+0000 mon.a (mon.0) 1630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:42 smithi113 bash[28910]: cluster 2024-04-19T22:51:41.845185+0000 mgr.y (mgr.24389) 272 : cluster 0 pgmap v284: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.681787+0000 mon.c (mon.2) 317 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.683121+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.683925+0000 mon.a (mon.0) 1622 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.713503+0000 mon.a (mon.0) 1623 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi113-63833-27"}]': finished 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.713721+0000 mon.a (mon.0) 1624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi113-63841-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.713946+0000 mon.a (mon.0) 1625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: cluster 2024-04-19T22:51:41.722914+0000 mon.a (mon.0) 1626 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.727115+0000 mon.c (mon.2) 319 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.729773+0000 mon.c (mon.2) 320 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.736453+0000 mon.c (mon.2) 321 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.737963+0000 mon.a (mon.0) 1627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:51:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.769385+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.769936+0000 mon.a (mon.0) 1628 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.771027+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.771340+0000 mon.a (mon.0) 1629 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.772196+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: audit 2024-04-19T22:51:41.772616+0000 mon.a (mon.0) 1630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:42 smithi178 bash[23441]: cluster 2024-04-19T22:51:41.845185+0000 mgr.y (mgr.24389) 272 : cluster 0 pgmap v284: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: audit 2024-04-19T22:51:42.724760+0000 mon.a (mon.0) 1631 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: audit 2024-04-19T22:51:42.724953+0000 mon.a (mon.0) 1632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: cluster 2024-04-19T22:51:42.732409+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: audit 2024-04-19T22:51:42.734120+0000 mon.c (mon.2) 325 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: audit 2024-04-19T22:51:42.735124+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[21528]: audit 2024-04-19T22:51:42.739466+0000 mon.a (mon.0) 1634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: audit 2024-04-19T22:51:42.724760+0000 mon.a (mon.0) 1631 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: audit 2024-04-19T22:51:42.724953+0000 mon.a (mon.0) 1632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: cluster 2024-04-19T22:51:42.732409+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: audit 2024-04-19T22:51:42.734120+0000 mon.c (mon.2) 325 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: audit 2024-04-19T22:51:42.735124+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:43 smithi113 bash[28910]: audit 2024-04-19T22:51:42.739466+0000 mon.a (mon.0) 1634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: audit 2024-04-19T22:51:42.724760+0000 mon.a (mon.0) 1631 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: audit 2024-04-19T22:51:42.724953+0000 mon.a (mon.0) 1632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi113-63833-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: cluster 2024-04-19T22:51:42.732409+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: audit 2024-04-19T22:51:42.734120+0000 mon.c (mon.2) 325 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: audit 2024-04-19T22:51:42.735124+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:43 smithi178 bash[23441]: audit 2024-04-19T22:51:42.739466+0000 mon.a (mon.0) 1634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: audit 2024-04-19T22:51:43.736488+0000 mon.c (mon.2) 327 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: cluster 2024-04-19T22:51:43.845632+0000 mgr.y (mgr.24389) 273 : cluster 0 pgmap v287: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: cluster 2024-04-19T22:51:44.209031+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: audit 2024-04-19T22:51:44.211304+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.113:0/1741601447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: audit 2024-04-19T22:51:44.212908+0000 mon.a (mon.0) 1636 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: audit 2024-04-19T22:51:44.475145+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[28910]: audit 2024-04-19T22:51:44.475905+0000 mon.a (mon.0) 1637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: audit 2024-04-19T22:51:43.736488+0000 mon.c (mon.2) 327 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: cluster 2024-04-19T22:51:43.845632+0000 mgr.y (mgr.24389) 273 : cluster 0 pgmap v287: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: cluster 2024-04-19T22:51:44.209031+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: audit 2024-04-19T22:51:44.211304+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.113:0/1741601447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: audit 2024-04-19T22:51:44.212908+0000 mon.a (mon.0) 1636 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: audit 2024-04-19T22:51:44.475145+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:44 smithi113 bash[21528]: audit 2024-04-19T22:51:44.475905+0000 mon.a (mon.0) 1637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:45.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:45.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: audit 2024-04-19T22:51:43.736488+0000 mon.c (mon.2) 327 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:45.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: cluster 2024-04-19T22:51:43.845632+0000 mgr.y (mgr.24389) 273 : cluster 0 pgmap v287: 300 pgs: 32 unknown, 268 active+clean; 616 KiB data, 533 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:45.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: cluster 2024-04-19T22:51:44.209031+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-04-19T22:51:45.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: audit 2024-04-19T22:51:44.211304+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.113:0/1741601447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: audit 2024-04-19T22:51:44.212908+0000 mon.a (mon.0) 1636 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: audit 2024-04-19T22:51:44.475145+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:44 smithi178 bash[23441]: audit 2024-04-19T22:51:44.475905+0000 mon.a (mon.0) 1637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.739337+0000 mon.c (mon.2) 330 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.751247+0000 mon.a (mon.0) 1638 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.751491+0000 mon.a (mon.0) 1639 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.751695+0000 mon.a (mon.0) 1640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: cluster 2024-04-19T22:51:44.759016+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-04-19T22:51:46.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.766215+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.768890+0000 mon.a (mon.0) 1642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:44.910588+0000 mgr.y (mgr.24389) 274 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: cluster 2024-04-19T22:51:45.498995+0000 mon.a (mon.0) 1643 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: cluster 2024-04-19T22:51:45.500604+0000 mon.a (mon.0) 1644 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:45.503447+0000 mon.a (mon.0) 1645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: cluster 2024-04-19T22:51:45.513800+0000 mon.a (mon.0) 1646 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:45.518674+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[28910]: audit 2024-04-19T22:51:45.519876+0000 mon.a (mon.0) 1647 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.739337+0000 mon.c (mon.2) 330 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.751247+0000 mon.a (mon.0) 1638 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:46.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.751491+0000 mon.a (mon.0) 1639 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.751695+0000 mon.a (mon.0) 1640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: cluster 2024-04-19T22:51:44.759016+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.766215+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.768890+0000 mon.a (mon.0) 1642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:44.910588+0000 mgr.y (mgr.24389) 274 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: cluster 2024-04-19T22:51:45.498995+0000 mon.a (mon.0) 1643 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: cluster 2024-04-19T22:51:45.500604+0000 mon.a (mon.0) 1644 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:45.503447+0000 mon.a (mon.0) 1645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: cluster 2024-04-19T22:51:45.513800+0000 mon.a (mon.0) 1646 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:45.518674+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:46.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:46 smithi113 bash[21528]: audit 2024-04-19T22:51:45.519876+0000 mon.a (mon.0) 1647 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:46.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.739337+0000 mon.c (mon.2) 330 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:46.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.751247+0000 mon.a (mon.0) 1638 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi113-63833-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:46.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.751491+0000 mon.a (mon.0) 1639 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi113-63841-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:46.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.751695+0000 mon.a (mon.0) 1640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: cluster 2024-04-19T22:51:44.759016+0000 mon.a (mon.0) 1641 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.766215+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.768890+0000 mon.a (mon.0) 1642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]: dispatch 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:44.910588+0000 mgr.y (mgr.24389) 274 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: cluster 2024-04-19T22:51:45.498995+0000 mon.a (mon.0) 1643 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: cluster 2024-04-19T22:51:45.500604+0000 mon.a (mon.0) 1644 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:45.503447+0000 mon.a (mon.0) 1645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-13"}]': finished 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: cluster 2024-04-19T22:51:45.513800+0000 mon.a (mon.0) 1646 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:45.518674+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:46.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:46 smithi178 bash[23441]: audit 2024-04-19T22:51:45.519876+0000 mon.a (mon.0) 1647 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:45.740967+0000 mon.c (mon.2) 333 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: cluster 2024-04-19T22:51:45.846385+0000 mgr.y (mgr.24389) 275 : cluster 0 pgmap v290: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.513399+0000 mon.a (mon.0) 1648 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: cluster 2024-04-19T22:51:46.521675+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.522897+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.528767+0000 mon.c (mon.2) 335 : audit 1 from='client.? 172.21.15.113:0/3335799968' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.529163+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.532650+0000 mon.a (mon.0) 1650 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.533742+0000 mon.a (mon.0) 1651 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.534446+0000 mon.a (mon.0) 1652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[28910]: audit 2024-04-19T22:51:46.742520+0000 mon.c (mon.2) 337 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:45.740967+0000 mon.c (mon.2) 333 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: cluster 2024-04-19T22:51:45.846385+0000 mgr.y (mgr.24389) 275 : cluster 0 pgmap v290: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.513399+0000 mon.a (mon.0) 1648 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: cluster 2024-04-19T22:51:46.521675+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.522897+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.528767+0000 mon.c (mon.2) 335 : audit 1 from='client.? 172.21.15.113:0/3335799968' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.529163+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.532650+0000 mon.a (mon.0) 1650 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.533742+0000 mon.a (mon.0) 1651 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.534446+0000 mon.a (mon.0) 1652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21528]: audit 2024-04-19T22:51:46.742520+0000 mon.c (mon.2) 337 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:45.740967+0000 mon.c (mon.2) 333 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: cluster 2024-04-19T22:51:45.846385+0000 mgr.y (mgr.24389) 275 : cluster 0 pgmap v290: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 18 op/s 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.513399+0000 mon.a (mon.0) 1648 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: cluster 2024-04-19T22:51:46.521675+0000 mon.a (mon.0) 1649 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.522897+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.113:0/792446782' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.528767+0000 mon.c (mon.2) 335 : audit 1 from='client.? 172.21.15.113:0/3335799968' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.529163+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.532650+0000 mon.a (mon.0) 1650 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.533742+0000 mon.a (mon.0) 1651 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.534446+0000 mon.a (mon.0) 1652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:47.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:47 smithi178 bash[23441]: audit 2024-04-19T22:51:46.742520+0000 mon.c (mon.2) 337 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:47.549 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWritpp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-19T22:51:47.549 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2060 ms) 2024-04-19T22:51:47.549 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8999 ms total) 2024-04-19T22:51:47.549 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:47.549 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4522 ms) 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3579 ms) 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4045 ms) 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12146 ms total) 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (138126 ms total) 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-04-19T22:51:47.550 INFO:tasks.workunit.client.0.smithi113.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-19T22:51:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.519035+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.519320+0000 mon.a (mon.0) 1654 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.519583+0000 mon.a (mon.0) 1655 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: cluster 2024-04-19T22:51:47.528400+0000 mon.a (mon.0) 1656 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.547285+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.547699+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.553785+0000 mon.a (mon.0) 1657 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.554722+0000 mon.a (mon.0) 1658 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.744158+0000 mon.c (mon.2) 340 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:47.904228+0000 mon.a (mon.0) 1659 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:48.149399+0000 mon.a (mon.0) 1660 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[28910]: audit 2024-04-19T22:51:48.151847+0000 mon.a (mon.0) 1661 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.519035+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.519320+0000 mon.a (mon.0) 1654 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.519583+0000 mon.a (mon.0) 1655 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: cluster 2024-04-19T22:51:47.528400+0000 mon.a (mon.0) 1656 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.547285+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.547699+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.553785+0000 mon.a (mon.0) 1657 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.554722+0000 mon.a (mon.0) 1658 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.744158+0000 mon.c (mon.2) 340 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:48.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:47.904228+0000 mon.a (mon.0) 1659 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:51:48.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:48.149399+0000 mon.a (mon.0) 1660 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:48.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:48 smithi113 bash[21528]: audit 2024-04-19T22:51:48.151847+0000 mon.a (mon.0) 1661 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:48.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.519035+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi113-64071-21"}]': finished 2024-04-19T22:51:48.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.519320+0000 mon.a (mon.0) 1654 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi113-63841-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.519583+0000 mon.a (mon.0) 1655 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: cluster 2024-04-19T22:51:47.528400+0000 mon.a (mon.0) 1656 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.547285+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.113:0/4126675081' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.547699+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.553785+0000 mon.a (mon.0) 1657 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.554722+0000 mon.a (mon.0) 1658 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.744158+0000 mon.c (mon.2) 340 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:47.904228+0000 mon.a (mon.0) 1659 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:48.149399+0000 mon.a (mon.0) 1660 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:48.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:48 smithi178 bash[23441]: audit 2024-04-19T22:51:48.151847+0000 mon.a (mon.0) 1661 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:51:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: cluster 2024-04-19T22:51:47.847361+0000 mgr.y (mgr.24389) 276 : cluster 0 pgmap v293: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:48.531561+0000 mon.a (mon.0) 1662 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:48.531758+0000 mon.a (mon.0) 1663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: cluster 2024-04-19T22:51:48.543410+0000 mon.a (mon.0) 1664 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:48.600523+0000 mon.c (mon.2) 341 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:48.745842+0000 mon.c (mon.2) 342 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.039608+0000 mon.a (mon.0) 1665 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.040250+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.041200+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.041546+0000 mon.a (mon.0) 1667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.041987+0000 mon.a (mon.0) 1668 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.042788+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.043249+0000 mon.a (mon.0) 1669 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[28910]: audit 2024-04-19T22:51:49.050496+0000 mon.a (mon.0) 1670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: cluster 2024-04-19T22:51:47.847361+0000 mgr.y (mgr.24389) 276 : cluster 0 pgmap v293: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:48.531561+0000 mon.a (mon.0) 1662 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:48.531758+0000 mon.a (mon.0) 1663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: cluster 2024-04-19T22:51:48.543410+0000 mon.a (mon.0) 1664 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:48.600523+0000 mon.c (mon.2) 341 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:48.745842+0000 mon.c (mon.2) 342 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.039608+0000 mon.a (mon.0) 1665 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.040250+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.041200+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.041546+0000 mon.a (mon.0) 1667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:51:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.041987+0000 mon.a (mon.0) 1668 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.042788+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.043249+0000 mon.a (mon.0) 1669 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:49 smithi113 bash[21528]: audit 2024-04-19T22:51:49.050496+0000 mon.a (mon.0) 1670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: cluster 2024-04-19T22:51:47.847361+0000 mgr.y (mgr.24389) 276 : cluster 0 pgmap v293: 292 pgs: 64 unknown, 228 active+clean; 586 KiB data, 535 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:48.531561+0000 mon.a (mon.0) 1662 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi113-63833-28"}]': finished 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:48.531758+0000 mon.a (mon.0) 1663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: cluster 2024-04-19T22:51:48.543410+0000 mon.a (mon.0) 1664 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:48.600523+0000 mon.c (mon.2) 341 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:48.745842+0000 mon.c (mon.2) 342 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.039608+0000 mon.a (mon.0) 1665 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.040250+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.041200+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.041546+0000 mon.a (mon.0) 1667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.041987+0000 mon.a (mon.0) 1668 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.042788+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.043249+0000 mon.a (mon.0) 1669 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:49 smithi178 bash[23441]: audit 2024-04-19T22:51:49.050496+0000 mon.a (mon.0) 1670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.536999+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.546680+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: cluster 2024-04-19T22:51:49.549510+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.559147+0000 mon.a (mon.0) 1673 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.559739+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.580094+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.580507+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:49.747431+0000 mon.c (mon.2) 347 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: cluster 2024-04-19T22:51:50.502608+0000 mon.a (mon.0) 1676 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[28910]: audit 2024-04-19T22:51:50.507360+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.536999+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.546680+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: cluster 2024-04-19T22:51:49.549510+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.559147+0000 mon.a (mon.0) 1673 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.559739+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.580094+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.580507+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:49.747431+0000 mon.c (mon.2) 347 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: cluster 2024-04-19T22:51:50.502608+0000 mon.a (mon.0) 1676 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:50 smithi113 bash[21528]: audit 2024-04-19T22:51:50.507360+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:51.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.536999+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi113-63833-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:51.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.546680+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: cluster 2024-04-19T22:51:49.549510+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-04-19T22:51:51.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.559147+0000 mon.a (mon.0) 1673 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.559739+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.580094+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.580507+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:49.747431+0000 mon.c (mon.2) 347 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: cluster 2024-04-19T22:51:50.502608+0000 mon.a (mon.0) 1676 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:50 smithi178 bash[23441]: audit 2024-04-19T22:51:50.507360+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.113:0/2136480659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi113-63841-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: cluster 2024-04-19T22:51:49.849824+0000 mgr.y (mgr.24389) 277 : cluster 0 pgmap v296: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:50.507601+0000 mon.a (mon.0) 1678 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:50.517182+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:50.749043+0000 mon.c (mon.2) 349 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: cluster 2024-04-19T22:51:50.976966+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:50.984296+0000 mon.a (mon.0) 1680 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:51.510581+0000 mon.a (mon.0) 1681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:51.510863+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:52.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: cluster 2024-04-19T22:51:51.518449+0000 mon.a (mon.0) 1683 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:51.526818+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[21528]: audit 2024-04-19T22:51:51.527265+0000 mon.a (mon.0) 1684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: cluster 2024-04-19T22:51:49.849824+0000 mgr.y (mgr.24389) 277 : cluster 0 pgmap v296: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:50.507601+0000 mon.a (mon.0) 1678 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:50.517182+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:50.749043+0000 mon.c (mon.2) 349 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: cluster 2024-04-19T22:51:50.976966+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:50.984296+0000 mon.a (mon.0) 1680 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:51.510581+0000 mon.a (mon.0) 1681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: audit 2024-04-19T22:51:51.510863+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:52.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:51 smithi113 bash[28910]: cluster 2024-04-19T22:51:51.518449+0000 mon.a (mon.0) 1683 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-04-19T22:51:52.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[28910]: audit 2024-04-19T22:51:51.526818+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:52.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[28910]: audit 2024-04-19T22:51:51.527265+0000 mon.a (mon.0) 1684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:52.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: cluster 2024-04-19T22:51:49.849824+0000 mgr.y (mgr.24389) 277 : cluster 0 pgmap v296: 292 pgs: 32 creating+peering, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:50.507601+0000 mon.a (mon.0) 1678 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:50.517182+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:50.749043+0000 mon.c (mon.2) 349 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: cluster 2024-04-19T22:51:50.976966+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:50.984296+0000 mon.a (mon.0) 1680 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:51.510581+0000 mon.a (mon.0) 1681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi113-63833-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:51.510863+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: cluster 2024-04-19T22:51:51.518449+0000 mon.a (mon.0) 1683 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:51.526818+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:51 smithi178 bash[23441]: audit 2024-04-19T22:51:51.527265+0000 mon.a (mon.0) 1684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]: dispatch 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: audit 2024-04-19T22:51:51.750733+0000 mon.c (mon.2) 351 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: cluster 2024-04-19T22:51:51.850669+0000 mgr.y (mgr.24389) 278 : cluster 0 pgmap v299: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: cluster 2024-04-19T22:51:52.511794+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: audit 2024-04-19T22:51:52.514683+0000 mon.a (mon.0) 1686 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]': finished 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: cluster 2024-04-19T22:51:52.523616+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: audit 2024-04-19T22:51:52.541842+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.113:0/4111618303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: audit 2024-04-19T22:51:52.552599+0000 mon.a (mon.0) 1688 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:52 smithi113 bash[21528]: audit 2024-04-19T22:51:52.752246+0000 mon.c (mon.2) 353 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: audit 2024-04-19T22:51:51.750733+0000 mon.c (mon.2) 351 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: cluster 2024-04-19T22:51:51.850669+0000 mgr.y (mgr.24389) 278 : cluster 0 pgmap v299: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: cluster 2024-04-19T22:51:52.511794+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: audit 2024-04-19T22:51:52.514683+0000 mon.a (mon.0) 1686 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]': finished 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: cluster 2024-04-19T22:51:52.523616+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: audit 2024-04-19T22:51:52.541842+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.113:0/4111618303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: audit 2024-04-19T22:51:52.552599+0000 mon.a (mon.0) 1688 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:53 smithi113 bash[28910]: audit 2024-04-19T22:51:52.752246+0000 mon.c (mon.2) 353 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:53.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: audit 2024-04-19T22:51:51.750733+0000 mon.c (mon.2) 351 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:53.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: cluster 2024-04-19T22:51:51.850669+0000 mgr.y (mgr.24389) 278 : cluster 0 pgmap v299: 268 pgs: 8 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:51:53.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: cluster 2024-04-19T22:51:52.511794+0000 mon.a (mon.0) 1685 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:51:53.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: audit 2024-04-19T22:51:52.514683+0000 mon.a (mon.0) 1686 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-15", "mode": "writeback"}]': finished 2024-04-19T22:51:53.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: cluster 2024-04-19T22:51:52.523616+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-04-19T22:51:53.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: audit 2024-04-19T22:51:52.541842+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.113:0/4111618303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: audit 2024-04-19T22:51:52.552599+0000 mon.a (mon.0) 1688 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:53.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:52 smithi178 bash[23441]: audit 2024-04-19T22:51:52.752246+0000 mon.c (mon.2) 353 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.517844+0000 mon.a (mon.0) 1689 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: cluster 2024-04-19T22:51:53.528238+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.543387+0000 mon.c (mon.2) 354 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.545305+0000 mon.a (mon.0) 1691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.604611+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.604979+0000 mon.a (mon.0) 1692 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[21528]: audit 2024-04-19T22:51:53.753846+0000 mon.c (mon.2) 356 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:54.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.517844+0000 mon.a (mon.0) 1689 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: cluster 2024-04-19T22:51:53.528238+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.543387+0000 mon.c (mon.2) 354 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.545305+0000 mon.a (mon.0) 1691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.604611+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.604979+0000 mon.a (mon.0) 1692 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:54 smithi113 bash[28910]: audit 2024-04-19T22:51:53.753846+0000 mon.c (mon.2) 356 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:54.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.517844+0000 mon.a (mon.0) 1689 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi113-63841-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:54.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: cluster 2024-04-19T22:51:53.528238+0000 mon.a (mon.0) 1690 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-04-19T22:51:54.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.543387+0000 mon.c (mon.2) 354 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.545305+0000 mon.a (mon.0) 1691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:54.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.604611+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.604979+0000 mon.a (mon.0) 1692 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:51:54.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[23441]: audit 2024-04-19T22:51:53.753846+0000 mon.c (mon.2) 356 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:55.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:51:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:51:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: cluster 2024-04-19T22:51:53.851474+0000 mgr.y (mgr.24389) 279 : cluster 0 pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.528705+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.528952+0000 mon.a (mon.0) 1694 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: cluster 2024-04-19T22:51:54.540344+0000 mon.a (mon.0) 1695 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.541194+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.541664+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.546815+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.547777+0000 mon.a (mon.0) 1697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: audit 2024-04-19T22:51:54.755476+0000 mon.c (mon.2) 359 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[21528]: cluster 2024-04-19T22:51:55.506582+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: cluster 2024-04-19T22:51:53.851474+0000 mgr.y (mgr.24389) 279 : cluster 0 pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.528705+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.528952+0000 mon.a (mon.0) 1694 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: cluster 2024-04-19T22:51:54.540344+0000 mon.a (mon.0) 1695 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-04-19T22:51:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.541194+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.541664+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.546815+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.547777+0000 mon.a (mon.0) 1697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: audit 2024-04-19T22:51:54.755476+0000 mon.c (mon.2) 359 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:56.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:55 smithi113 bash[28910]: cluster 2024-04-19T22:51:55.506582+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:56.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: cluster 2024-04-19T22:51:53.851474+0000 mgr.y (mgr.24389) 279 : cluster 0 pgmap v302: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:51:56.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.528705+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.528952+0000 mon.a (mon.0) 1694 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: cluster 2024-04-19T22:51:54.540344+0000 mon.a (mon.0) 1695 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.541194+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.541664+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.113:0/1686027103' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.546815+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]: dispatch 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.547777+0000 mon.a (mon.0) 1697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]: dispatch 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: audit 2024-04-19T22:51:54.755476+0000 mon.c (mon.2) 359 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:55 smithi178 bash[23441]: cluster 2024-04-19T22:51:55.506582+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:51:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:54.922019+0000 mgr.y (mgr.24389) 280 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: cluster 2024-04-19T22:51:55.530668+0000 mon.a (mon.0) 1699 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.533411+0000 mon.a (mon.0) 1700 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.533742+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: cluster 2024-04-19T22:51:55.545369+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.555629+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.113:0/516957071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.571546+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.585739+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.586082+0000 mon.a (mon.0) 1704 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.587090+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.587404+0000 mon.a (mon.0) 1705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.587973+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.588291+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:55.757086+0000 mon.c (mon.2) 364 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:56.536429+0000 mon.a (mon.0) 1707 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:54.922019+0000 mgr.y (mgr.24389) 280 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: cluster 2024-04-19T22:51:55.530668+0000 mon.a (mon.0) 1699 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.533411+0000 mon.a (mon.0) 1700 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.533742+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: cluster 2024-04-19T22:51:55.545369+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.555629+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.113:0/516957071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.571546+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.585739+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.586082+0000 mon.a (mon.0) 1704 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.587090+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.587404+0000 mon.a (mon.0) 1705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.587973+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.588291+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:55.757086+0000 mon.c (mon.2) 364 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:56.536429+0000 mon.a (mon.0) 1707 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:56.536628+0000 mon.a (mon.0) 1708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: cluster 2024-04-19T22:51:56.544633+0000 mon.a (mon.0) 1709 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-04-19T22:51:57.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:56.550598+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[28910]: audit 2024-04-19T22:51:56.553411+0000 mon.a (mon.0) 1710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:56.536628+0000 mon.a (mon.0) 1708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:57.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: cluster 2024-04-19T22:51:56.544633+0000 mon.a (mon.0) 1709 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-04-19T22:51:57.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:56.550598+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21528]: audit 2024-04-19T22:51:56.553411+0000 mon.a (mon.0) 1710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:54.922019+0000 mgr.y (mgr.24389) 280 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: cluster 2024-04-19T22:51:55.530668+0000 mon.a (mon.0) 1699 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.533411+0000 mon.a (mon.0) 1700 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-15"}]': finished 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.533742+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi113-63833-29"}]': finished 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: cluster 2024-04-19T22:51:55.545369+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.555629+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.113:0/516957071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.571546+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.585739+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.586082+0000 mon.a (mon.0) 1704 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.587090+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.587404+0000 mon.a (mon.0) 1705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.587973+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.588291+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:55.757086+0000 mon.c (mon.2) 364 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:56.536429+0000 mon.a (mon.0) 1707 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi113-63841-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:56.536628+0000 mon.a (mon.0) 1708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi113-63833-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: cluster 2024-04-19T22:51:56.544633+0000 mon.a (mon.0) 1709 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-04-19T22:51:57.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:56.550598+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:57 smithi178 bash[23441]: audit 2024-04-19T22:51:56.553411+0000 mon.a (mon.0) 1710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:51:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:51:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:51:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (15025 ms) 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (47724 ms) 2024-04-19T22:51:58.001 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (9125 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (5263 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4362 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3438 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3792 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2120 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3482 ms) 2024-04-19T22:51:58.002 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2897 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3028 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3019 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3005 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3030 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (2910 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3020 ms) 2024-04-19T22:51:58.003 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3064 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3011 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3018 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3500 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2597 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3023 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2778 ms) 2024-04-19T22:51:58.004 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3032 ms) 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2969 ms) 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3026 ms) 2024-04-19T22:51:58.005 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-19T22:51:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: cluster 2024-04-19T22:51:55.852394+0000 mgr.y (mgr.24389) 281 : cluster 0 pgmap v305: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:51:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: audit 2024-04-19T22:51:56.758774+0000 mon.c (mon.2) 366 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: audit 2024-04-19T22:51:57.760378+0000 mon.c (mon.2) 367 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: cluster 2024-04-19T22:51:58.002105+0000 mon.a (mon.0) 1711 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-04-19T22:51:58.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: audit 2024-04-19T22:51:58.003451+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:58.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[28910]: audit 2024-04-19T22:51:58.007515+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:58.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: cluster 2024-04-19T22:51:55.852394+0000 mgr.y (mgr.24389) 281 : cluster 0 pgmap v305: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:51:58.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: audit 2024-04-19T22:51:56.758774+0000 mon.c (mon.2) 366 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: audit 2024-04-19T22:51:57.760378+0000 mon.c (mon.2) 367 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: cluster 2024-04-19T22:51:58.002105+0000 mon.a (mon.0) 1711 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-04-19T22:51:58.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: audit 2024-04-19T22:51:58.003451+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:58.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:58 smithi113 bash[21528]: audit 2024-04-19T22:51:58.007515+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:58.303 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: cluster 2024-04-19T22:51:55.852394+0000 mgr.y (mgr.24389) 281 : cluster 0 pgmap v305: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:51:58.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: audit 2024-04-19T22:51:56.758774+0000 mon.c (mon.2) 366 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: audit 2024-04-19T22:51:57.760378+0000 mon.c (mon.2) 367 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:51:58.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: cluster 2024-04-19T22:51:58.002105+0000 mon.a (mon.0) 1711 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-04-19T22:51:58.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: audit 2024-04-19T22:51:58.003451+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:51:58.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:58 smithi178 bash[23441]: audit 2024-04-19T22:51:58.007515+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: cluster 2024-04-19T22:51:57.853334+0000 mgr.y (mgr.24389) 282 : cluster 0 pgmap v308: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.554609+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.554868+0000 mon.a (mon.0) 1714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: cluster 2024-04-19T22:51:58.562920+0000 mon.a (mon.0) 1715 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.571084+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.609827+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.610253+0000 mon.a (mon.0) 1717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[21528]: audit 2024-04-19T22:51:58.762189+0000 mon.c (mon.2) 370 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: cluster 2024-04-19T22:51:57.853334+0000 mgr.y (mgr.24389) 282 : cluster 0 pgmap v308: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.554609+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.554868+0000 mon.a (mon.0) 1714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: cluster 2024-04-19T22:51:58.562920+0000 mon.a (mon.0) 1715 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.571084+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.609827+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.610253+0000 mon.a (mon.0) 1717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:51:59 smithi113 bash[28910]: audit 2024-04-19T22:51:58.762189+0000 mon.c (mon.2) 370 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:00.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: cluster 2024-04-19T22:51:57.853334+0000 mgr.y (mgr.24389) 282 : cluster 0 pgmap v308: 260 pgs: 32 unknown, 228 active+clean; 586 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:00.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.554609+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi113-63833-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.554868+0000 mon.a (mon.0) 1714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: cluster 2024-04-19T22:51:58.562920+0000 mon.a (mon.0) 1715 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.571084+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.609827+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.610253+0000 mon.a (mon.0) 1717 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:51:59 smithi178 bash[23441]: audit 2024-04-19T22:51:58.762189+0000 mon.c (mon.2) 370 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.557980+0000 mon.a (mon.0) 1718 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.558150+0000 mon.a (mon.0) 1719 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: cluster 2024-04-19T22:51:59.566158+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-04-19T22:52:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.572619+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.596924+0000 mon.a (mon.0) 1721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.763889+0000 mon.c (mon.2) 372 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:51:59.858528+0000 mon.a (mon.0) 1722 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: cluster 2024-04-19T22:52:00.508679+0000 mon.a (mon.0) 1723 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.512291+0000 mon.a (mon.0) 1724 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.512521+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: cluster 2024-04-19T22:52:00.519784+0000 mon.a (mon.0) 1726 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.521129+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.524276+0000 mon.a (mon.0) 1727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.525959+0000 mon.c (mon.2) 374 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[21528]: audit 2024-04-19T22:52:00.532483+0000 mon.a (mon.0) 1728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:01.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.557980+0000 mon.a (mon.0) 1718 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.558150+0000 mon.a (mon.0) 1719 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: cluster 2024-04-19T22:51:59.566158+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.572619+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.596924+0000 mon.a (mon.0) 1721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.763889+0000 mon.c (mon.2) 372 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:51:59.858528+0000 mon.a (mon.0) 1722 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: cluster 2024-04-19T22:52:00.508679+0000 mon.a (mon.0) 1723 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.512291+0000 mon.a (mon.0) 1724 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.512521+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: cluster 2024-04-19T22:52:00.519784+0000 mon.a (mon.0) 1726 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.521129+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.524276+0000 mon.a (mon.0) 1727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.525959+0000 mon.c (mon.2) 374 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:01 smithi113 bash[28910]: audit 2024-04-19T22:52:00.532483+0000 mon.a (mon.0) 1728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.557980+0000 mon.a (mon.0) 1718 : audit 1 from='client.? 172.21.15.113:0/633214036' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi113-63841-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.558150+0000 mon.a (mon.0) 1719 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: cluster 2024-04-19T22:51:59.566158+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.572619+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.596924+0000 mon.a (mon.0) 1721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.763889+0000 mon.c (mon.2) 372 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:51:59.858528+0000 mon.a (mon.0) 1722 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: cluster 2024-04-19T22:52:00.508679+0000 mon.a (mon.0) 1723 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.512291+0000 mon.a (mon.0) 1724 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.512521+0000 mon.a (mon.0) 1725 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: cluster 2024-04-19T22:52:00.519784+0000 mon.a (mon.0) 1726 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.521129+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.524276+0000 mon.a (mon.0) 1727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]: dispatch 2024-04-19T22:52:01.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.525959+0000 mon.c (mon.2) 374 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:01.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:01 smithi178 bash[23441]: audit 2024-04-19T22:52:00.532483+0000 mon.a (mon.0) 1728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: cluster 2024-04-19T22:51:59.855841+0000 mgr.y (mgr.24389) 283 : cluster 0 pgmap v311: 300 pgs: 300 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:00.765526+0000 mon.c (mon.2) 375 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: cluster 2024-04-19T22:52:01.513350+0000 mon.a (mon.0) 1729 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.517586+0000 mon.a (mon.0) 1730 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]': finished 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.517870+0000 mon.a (mon.0) 1731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:02.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: cluster 2024-04-19T22:52:01.527036+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.542016+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.543908+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.546535+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.113:0/2561942033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.547767+0000 mon.a (mon.0) 1734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.655351+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.656155+0000 mon.a (mon.0) 1735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.767105+0000 mon.c (mon.2) 379 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.919464+0000 mon.c (mon.2) 380 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.920955+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[21528]: audit 2024-04-19T22:52:01.921597+0000 mon.a (mon.0) 1736 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: cluster 2024-04-19T22:51:59.855841+0000 mgr.y (mgr.24389) 283 : cluster 0 pgmap v311: 300 pgs: 300 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:00.765526+0000 mon.c (mon.2) 375 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: cluster 2024-04-19T22:52:01.513350+0000 mon.a (mon.0) 1729 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.517586+0000 mon.a (mon.0) 1730 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]': finished 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.517870+0000 mon.a (mon.0) 1731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: cluster 2024-04-19T22:52:01.527036+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.542016+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.543908+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.546535+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.113:0/2561942033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.547767+0000 mon.a (mon.0) 1734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.655351+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.656155+0000 mon.a (mon.0) 1735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.767105+0000 mon.c (mon.2) 379 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.919464+0000 mon.c (mon.2) 380 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.920955+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:02.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:02 smithi113 bash[28910]: audit 2024-04-19T22:52:01.921597+0000 mon.a (mon.0) 1736 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: cluster 2024-04-19T22:51:59.855841+0000 mgr.y (mgr.24389) 283 : cluster 0 pgmap v311: 300 pgs: 300 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:00.765526+0000 mon.c (mon.2) 375 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: cluster 2024-04-19T22:52:01.513350+0000 mon.a (mon.0) 1729 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.517586+0000 mon.a (mon.0) 1730 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-17", "mode": "writeback"}]': finished 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.517870+0000 mon.a (mon.0) 1731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: cluster 2024-04-19T22:52:01.527036+0000 mon.a (mon.0) 1732 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.542016+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.113:0/261477329' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.543908+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.546535+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.113:0/2561942033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.547767+0000 mon.a (mon.0) 1734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.655351+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.656155+0000 mon.a (mon.0) 1735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.767105+0000 mon.c (mon.2) 379 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.919464+0000 mon.c (mon.2) 380 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.920955+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:02 smithi178 bash[23441]: audit 2024-04-19T22:52:01.921597+0000 mon.a (mon.0) 1736 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]: dispatch 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: cluster 2024-04-19T22:52:01.856808+0000 mgr.y (mgr.24389) 284 : cluster 0 pgmap v314: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.529367+0000 mon.a (mon.0) 1737 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.529569+0000 mon.a (mon.0) 1738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.529756+0000 mon.a (mon.0) 1739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.529898+0000 mon.a (mon.0) 1740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: cluster 2024-04-19T22:52:02.538509+0000 mon.a (mon.0) 1741 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.545968+0000 mon.c (mon.2) 382 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.546972+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.549153+0000 mon.a (mon.0) 1742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.584127+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.584480+0000 mon.a (mon.0) 1743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.585592+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.585987+0000 mon.a (mon.0) 1744 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.586605+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:02.586920+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:03.191979+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:03 smithi178 bash[23441]: audit 2024-04-19T22:52:03.194658+0000 mon.a (mon.0) 1747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: cluster 2024-04-19T22:52:01.856808+0000 mgr.y (mgr.24389) 284 : cluster 0 pgmap v314: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:52:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.529367+0000 mon.a (mon.0) 1737 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.529569+0000 mon.a (mon.0) 1738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.529756+0000 mon.a (mon.0) 1739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.529898+0000 mon.a (mon.0) 1740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:52:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: cluster 2024-04-19T22:52:02.538509+0000 mon.a (mon.0) 1741 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-04-19T22:52:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.545968+0000 mon.c (mon.2) 382 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.546972+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.549153+0000 mon.a (mon.0) 1742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.584127+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.584480+0000 mon.a (mon.0) 1743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.585592+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.585987+0000 mon.a (mon.0) 1744 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.586605+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:02.586920+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:03.191979+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[28910]: audit 2024-04-19T22:52:03.194658+0000 mon.a (mon.0) 1747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: cluster 2024-04-19T22:52:01.856808+0000 mgr.y (mgr.24389) 284 : cluster 0 pgmap v314: 292 pgs: 32 unknown, 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.529367+0000 mon.a (mon.0) 1737 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi113-63833-30"}]': finished 2024-04-19T22:52:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.529569+0000 mon.a (mon.0) 1738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi113-63841-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.529756+0000 mon.a (mon.0) 1739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.529898+0000 mon.a (mon.0) 1740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pg_num","val":"11"}]': finished 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: cluster 2024-04-19T22:52:02.538509+0000 mon.a (mon.0) 1741 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.545968+0000 mon.c (mon.2) 382 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.546972+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.549153+0000 mon.a (mon.0) 1742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]: dispatch 2024-04-19T22:52:04.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.584127+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.584480+0000 mon.a (mon.0) 1743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.585592+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.585987+0000 mon.a (mon.0) 1744 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.586605+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:02.586920+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:03.191979+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:04.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:03 smithi113 bash[21528]: audit 2024-04-19T22:52:03.194658+0000 mon.a (mon.0) 1747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: cluster 2024-04-19T22:52:03.529777+0000 mon.a (mon.0) 1748 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:03.532252+0000 mon.a (mon.0) 1749 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:03.532452+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: cluster 2024-04-19T22:52:03.541395+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:03.543172+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:03.544583+0000 mon.a (mon.0) 1752 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:03.565513+0000 mon.c (mon.2) 388 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:05.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:04.024163+0000 mon.a (mon.0) 1753 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[28910]: audit 2024-04-19T22:52:04.537224+0000 mon.a (mon.0) 1754 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: cluster 2024-04-19T22:52:03.529777+0000 mon.a (mon.0) 1748 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:03.532252+0000 mon.a (mon.0) 1749 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:03.532452+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: cluster 2024-04-19T22:52:03.541395+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:03.543172+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:03.544583+0000 mon.a (mon.0) 1752 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:03.565513+0000 mon.c (mon.2) 388 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:04.024163+0000 mon.a (mon.0) 1753 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:05.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:04 smithi113 bash[21528]: audit 2024-04-19T22:52:04.537224+0000 mon.a (mon.0) 1754 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-19T22:52:05.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: cluster 2024-04-19T22:52:03.529777+0000 mon.a (mon.0) 1748 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:03.532252+0000 mon.a (mon.0) 1749 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-17"}]': finished 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:03.532452+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi113-63833-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: cluster 2024-04-19T22:52:03.541395+0000 mon.a (mon.0) 1751 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:03.543172+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:03.544583+0000 mon.a (mon.0) 1752 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:03.565513+0000 mon.c (mon.2) 388 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:04.024163+0000 mon.a (mon.0) 1753 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:04 smithi178 bash[23441]: audit 2024-04-19T22:52:04.537224+0000 mon.a (mon.0) 1754 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-04-19T22:52:06.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: cluster 2024-04-19T22:52:03.857581+0000 mgr.y (mgr.24389) 285 : cluster 0 pgmap v317: 260 pgs: 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:04.567077+0000 mon.c (mon.2) 389 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:04.931569+0000 mgr.y (mgr.24389) 286 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: cluster 2024-04-19T22:52:04.977021+0000 mon.a (mon.0) 1755 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:04.978321+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.113:0/929214658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.391438+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: cluster 2024-04-19T22:52:05.511432+0000 mon.a (mon.0) 1757 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.542934+0000 mon.a (mon.0) 1758 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.543224+0000 mon.a (mon.0) 1759 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: cluster 2024-04-19T22:52:05.553332+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.558196+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.562722+0000 mon.a (mon.0) 1761 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.569209+0000 mon.c (mon.2) 392 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.570903+0000 mon.c (mon.2) 393 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.572305+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.572740+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[21528]: audit 2024-04-19T22:52:05.861450+0000 mon.a (mon.0) 1763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: cluster 2024-04-19T22:52:03.857581+0000 mgr.y (mgr.24389) 285 : cluster 0 pgmap v317: 260 pgs: 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:04.567077+0000 mon.c (mon.2) 389 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:04.931569+0000 mgr.y (mgr.24389) 286 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: cluster 2024-04-19T22:52:04.977021+0000 mon.a (mon.0) 1755 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:04.978321+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.113:0/929214658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.391438+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: cluster 2024-04-19T22:52:05.511432+0000 mon.a (mon.0) 1757 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.542934+0000 mon.a (mon.0) 1758 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.543224+0000 mon.a (mon.0) 1759 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: cluster 2024-04-19T22:52:05.553332+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.558196+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.562722+0000 mon.a (mon.0) 1761 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.569209+0000 mon.c (mon.2) 392 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.570903+0000 mon.c (mon.2) 393 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.572305+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.572740+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:05 smithi113 bash[28910]: audit 2024-04-19T22:52:05.861450+0000 mon.a (mon.0) 1763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: cluster 2024-04-19T22:52:03.857581+0000 mgr.y (mgr.24389) 285 : cluster 0 pgmap v317: 260 pgs: 260 active+clean; 586 KiB data, 520 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:04.567077+0000 mon.c (mon.2) 389 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:04.931569+0000 mgr.y (mgr.24389) 286 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: cluster 2024-04-19T22:52:04.977021+0000 mon.a (mon.0) 1755 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:04.978321+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.113:0/929214658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.391438+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: cluster 2024-04-19T22:52:05.511432+0000 mon.a (mon.0) 1757 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.542934+0000 mon.a (mon.0) 1758 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi113-63833-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.543224+0000 mon.a (mon.0) 1759 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi113-63841-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:06.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: cluster 2024-04-19T22:52:05.553332+0000 mon.a (mon.0) 1760 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.558196+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.562722+0000 mon.a (mon.0) 1761 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.569209+0000 mon.c (mon.2) 392 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.570903+0000 mon.c (mon.2) 393 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.572305+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.572740+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]: dispatch 2024-04-19T22:52:06.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:05 smithi178 bash[23441]: audit 2024-04-19T22:52:05.861450+0000 mon.a (mon.0) 1763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: cluster 2024-04-19T22:52:05.858581+0000 mgr.y (mgr.24389) 287 : cluster 0 pgmap v320: 300 pgs: 22 creating+peering, 1 peering, 50 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.546253+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.546473+0000 mon.a (mon.0) 1765 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.546688+0000 mon.a (mon.0) 1766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: cluster 2024-04-19T22:52:06.554821+0000 mon.a (mon.0) 1767 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.557555+0000 mon.c (mon.2) 395 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:07.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.584542+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[21528]: audit 2024-04-19T22:52:06.591352+0000 mon.a (mon.0) 1768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: cluster 2024-04-19T22:52:05.858581+0000 mgr.y (mgr.24389) 287 : cluster 0 pgmap v320: 300 pgs: 22 creating+peering, 1 peering, 50 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.546253+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.546473+0000 mon.a (mon.0) 1765 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.546688+0000 mon.a (mon.0) 1766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: cluster 2024-04-19T22:52:06.554821+0000 mon.a (mon.0) 1767 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.557555+0000 mon.c (mon.2) 395 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.584542+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:07 smithi113 bash[28910]: audit 2024-04-19T22:52:06.591352+0000 mon.a (mon.0) 1768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: cluster 2024-04-19T22:52:05.858581+0000 mgr.y (mgr.24389) 287 : cluster 0 pgmap v320: 300 pgs: 22 creating+peering, 1 peering, 50 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.546253+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.546473+0000 mon.a (mon.0) 1765 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi113-63873-1","var":"pgp_num","val":"11"}]': finished 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.546688+0000 mon.a (mon.0) 1766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: cluster 2024-04-19T22:52:06.554821+0000 mon.a (mon.0) 1767 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.557555+0000 mon.c (mon.2) 395 : audit 0 from='client.? 172.21.15.113:0/150173427' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.584542+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:07 smithi178 bash[23441]: audit 2024-04-19T22:52:06.591352+0000 mon.a (mon.0) 1768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:09.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.571953+0000 mon.a (mon.0) 1769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: cluster 2024-04-19T22:52:07.580272+0000 mon.a (mon.0) 1770 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.586390+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.589027+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.590182+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.595456+0000 mon.a (mon.0) 1771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.596433+0000 mon.a (mon.0) 1772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[21528]: audit 2024-04-19T22:52:07.597485+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.571953+0000 mon.a (mon.0) 1769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:09.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: cluster 2024-04-19T22:52:07.580272+0000 mon.a (mon.0) 1770 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.586390+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.589027+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.590182+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.595456+0000 mon.a (mon.0) 1771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.596433+0000 mon.a (mon.0) 1772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:08 smithi113 bash[28910]: audit 2024-04-19T22:52:07.597485+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.571953+0000 mon.a (mon.0) 1769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:09.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: cluster 2024-04-19T22:52:07.580272+0000 mon.a (mon.0) 1770 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.586390+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.589027+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.590182+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.595456+0000 mon.a (mon.0) 1771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.596433+0000 mon.a (mon.0) 1772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:08 smithi178 bash[23441]: audit 2024-04-19T22:52:07.597485+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:09.603 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: cluster 2024-04-19T22:52:07.859554+0000 mgr.y (mgr.24389) 288 : cluster 0 pgmap v323: 292 pgs: 1 peering, 64 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:09.604 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.575151+0000 mon.a (mon.0) 1774 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:09.604 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.575370+0000 mon.a (mon.0) 1775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: cluster 2024-04-19T22:52:07.859554+0000 mgr.y (mgr.24389) 288 : cluster 0 pgmap v323: 292 pgs: 1 peering, 64 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.575151+0000 mon.a (mon.0) 1774 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.575370+0000 mon.a (mon.0) 1775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.575604+0000 mon.a (mon.0) 1776 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: cluster 2024-04-19T22:52:08.586471+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-04-19T22:52:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.586966+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.590089+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.594484+0000 mon.a (mon.0) 1778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:08.595784+0000 mon.a (mon.0) 1779 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129220+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129267+0000 mon.c (mon.2) 403 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129311+0000 mon.c (mon.2) 404 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129345+0000 mon.c (mon.2) 405 : audit 1 "var": "eio", 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129375+0000 mon.c (mon.2) 406 : audit 1 "val": "true" 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.129411+0000 mon.c (mon.2) 407 : audit 1 }]: dispatch 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130368+0000 mon.a (mon.0) 1780 : audit 1 from='client.? ' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130475+0000 mon.a (mon.0) 1781 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130510+0000 mon.a (mon.0) 1782 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130537+0000 mon.a (mon.0) 1783 : audit 1 "var": "eio", 2024-04-19T22:52:10.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130621+0000 mon.a (mon.0) 1784 : audit 1 "val": "true" 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.575604+0000 mon.a (mon.0) 1776 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: cluster 2024-04-19T22:52:08.586471+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.586966+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.590089+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.594484+0000 mon.a (mon.0) 1778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.053 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:08.595784+0000 mon.a (mon.0) 1779 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129220+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129267+0000 mon.c (mon.2) 403 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129311+0000 mon.c (mon.2) 404 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129345+0000 mon.c (mon.2) 405 : audit 1 "var": "eio", 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129375+0000 mon.c (mon.2) 406 : audit 1 "val": "true" 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.129411+0000 mon.c (mon.2) 407 : audit 1 }]: dispatch 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130368+0000 mon.a (mon.0) 1780 : audit 1 from='client.? ' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130475+0000 mon.a (mon.0) 1781 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.054 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130510+0000 mon.a (mon.0) 1782 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130537+0000 mon.a (mon.0) 1783 : audit 1 "var": "eio", 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130621+0000 mon.a (mon.0) 1784 : audit 1 "val": "true" 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.130664+0000 mon.a (mon.0) 1785 : audit 1 }]: dispatch 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: cluster 2024-04-19T22:52:09.576340+0000 mon.a (mon.0) 1786 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.578921+0000 mon.a (mon.0) 1787 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579130+0000 mon.a (mon.0) 1788 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]': finished 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579244+0000 mon.a (mon.0) 1789 : audit 1 from='client.? ' entity='client.admin' cmd='[{ 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579272+0000 mon.a (mon.0) 1790 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579308+0000 mon.a (mon.0) 1791 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579336+0000 mon.a (mon.0) 1792 : audit 1 "var": "eio", 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579360+0000 mon.a (mon.0) 1793 : audit 1 "val": "true" 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: audit 2024-04-19T22:52:09.579382+0000 mon.a (mon.0) 1794 : audit 1 }]': finished 2024-04-19T22:52:10.055 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[28910]: cluster 2024-04-19T22:52:09.592667+0000 mon.a (mon.0) 1795 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.130664+0000 mon.a (mon.0) 1785 : audit 1 }]: dispatch 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: cluster 2024-04-19T22:52:09.576340+0000 mon.a (mon.0) 1786 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.578921+0000 mon.a (mon.0) 1787 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579130+0000 mon.a (mon.0) 1788 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]': finished 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579244+0000 mon.a (mon.0) 1789 : audit 1 from='client.? ' entity='client.admin' cmd='[{ 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579272+0000 mon.a (mon.0) 1790 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579308+0000 mon.a (mon.0) 1791 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579336+0000 mon.a (mon.0) 1792 : audit 1 "var": "eio", 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579360+0000 mon.a (mon.0) 1793 : audit 1 "val": "true" 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: audit 2024-04-19T22:52:09.579382+0000 mon.a (mon.0) 1794 : audit 1 }]': finished 2024-04-19T22:52:10.056 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:09 smithi113 bash[21528]: cluster 2024-04-19T22:52:09.592667+0000 mon.a (mon.0) 1795 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: cluster 2024-04-19T22:52:07.859554+0000 mgr.y (mgr.24389) 288 : cluster 0 pgmap v323: 292 pgs: 1 peering, 64 unknown, 227 active+clean; 586 KiB data, 525 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.575151+0000 mon.a (mon.0) 1774 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.575370+0000 mon.a (mon.0) 1775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.575604+0000 mon.a (mon.0) 1776 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi113-63841-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: cluster 2024-04-19T22:52:08.586471+0000 mon.a (mon.0) 1777 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.586966+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.113:0/2172159359' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.590089+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.594484+0000 mon.a (mon.0) 1778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]: dispatch 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:08.595784+0000 mon.a (mon.0) 1779 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]: dispatch 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129220+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.113:0/3421683049' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129267+0000 mon.c (mon.2) 403 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129311+0000 mon.c (mon.2) 404 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129345+0000 mon.c (mon.2) 405 : audit 1 "var": "eio", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129375+0000 mon.c (mon.2) 406 : audit 1 "val": "true" 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.129411+0000 mon.c (mon.2) 407 : audit 1 }]: dispatch 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130368+0000 mon.a (mon.0) 1780 : audit 1 from='client.? ' entity='client.admin' cmd=[{ 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130475+0000 mon.a (mon.0) 1781 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130510+0000 mon.a (mon.0) 1782 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130537+0000 mon.a (mon.0) 1783 : audit 1 "var": "eio", 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130621+0000 mon.a (mon.0) 1784 : audit 1 "val": "true" 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.130664+0000 mon.a (mon.0) 1785 : audit 1 }]: dispatch 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: cluster 2024-04-19T22:52:09.576340+0000 mon.a (mon.0) 1786 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.578921+0000 mon.a (mon.0) 1787 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi113-63833-31"}]': finished 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579130+0000 mon.a (mon.0) 1788 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-19", "mode": "writeback"}]': finished 2024-04-19T22:52:10.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579244+0000 mon.a (mon.0) 1789 : audit 1 from='client.? ' entity='client.admin' cmd='[{ 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579272+0000 mon.a (mon.0) 1790 : audit 1 "prefix": "osd pool set", 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579308+0000 mon.a (mon.0) 1791 : audit 1 "pool": "PoolEIOFlag_smithi113-63841-33", 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579336+0000 mon.a (mon.0) 1792 : audit 1 "var": "eio", 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579360+0000 mon.a (mon.0) 1793 : audit 1 "val": "true" 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: audit 2024-04-19T22:52:09.579382+0000 mon.a (mon.0) 1794 : audit 1 }]': finished 2024-04-19T22:52:10.059 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:09 smithi178 bash[23441]: cluster 2024-04-19T22:52:09.592667+0000 mon.a (mon.0) 1795 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.626486+0000 mon.a (mon.0) 1796 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.627620+0000 mon.a (mon.0) 1797 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.628175+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.680967+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.681522+0000 mon.a (mon.0) 1799 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: cluster 2024-04-19T22:52:09.861971+0000 mgr.y (mgr.24389) 289 : cluster 0 pgmap v326: 291 pgs: 291 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: audit 2024-04-19T22:52:09.864612+0000 mon.a (mon.0) 1800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:11.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[28910]: cluster 2024-04-19T22:52:10.513131+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.626486+0000 mon.a (mon.0) 1796 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.627620+0000 mon.a (mon.0) 1797 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.628175+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.680967+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.681522+0000 mon.a (mon.0) 1799 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: cluster 2024-04-19T22:52:09.861971+0000 mgr.y (mgr.24389) 289 : cluster 0 pgmap v326: 291 pgs: 291 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: audit 2024-04-19T22:52:09.864612+0000 mon.a (mon.0) 1800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:11.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:10 smithi113 bash[21528]: cluster 2024-04-19T22:52:10.513131+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:11.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.626486+0000 mon.a (mon.0) 1796 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.627620+0000 mon.a (mon.0) 1797 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.628175+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.680967+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.681522+0000 mon.a (mon.0) 1799 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: cluster 2024-04-19T22:52:09.861971+0000 mgr.y (mgr.24389) 289 : cluster 0 pgmap v326: 291 pgs: 291 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: audit 2024-04-19T22:52:09.864612+0000 mon.a (mon.0) 1800 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-04-19T22:52:11.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:10 smithi178 bash[23441]: cluster 2024-04-19T22:52:10.513131+0000 mon.a (mon.0) 1801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.617136+0000 mon.a (mon.0) 1802 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.617336+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.617559+0000 mon.a (mon.0) 1804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: cluster 2024-04-19T22:52:10.625183+0000 mon.a (mon.0) 1805 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.626314+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.629233+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.630513+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.665099+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.665496+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:10.666602+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:11.102822+0000 mon.a (mon.0) 1809 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:11.104080+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[28910]: audit 2024-04-19T22:52:11.104837+0000 mon.a (mon.0) 1810 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.617136+0000 mon.a (mon.0) 1802 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.617336+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.617559+0000 mon.a (mon.0) 1804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: cluster 2024-04-19T22:52:10.625183+0000 mon.a (mon.0) 1805 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.626314+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:12.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.629233+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.630513+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.665099+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.665496+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:10.666602+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:11.102822+0000 mon.a (mon.0) 1809 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:11.104080+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:12.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:11 smithi113 bash[21528]: audit 2024-04-19T22:52:11.104837+0000 mon.a (mon.0) 1810 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.617136+0000 mon.a (mon.0) 1802 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi113-63833-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.617336+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.617559+0000 mon.a (mon.0) 1804 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi113-63873-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: cluster 2024-04-19T22:52:10.625183+0000 mon.a (mon.0) 1805 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.626314+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.629233+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.630513+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.665099+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.665496+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:10.666602+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:11.102822+0000 mon.a (mon.0) 1809 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:11.104080+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:11 smithi178 bash[23441]: audit 2024-04-19T22:52:11.104837+0000 mon.a (mon.0) 1810 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:13.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: cluster 2024-04-19T22:52:11.619828+0000 mon.a (mon.0) 1811 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:13.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: audit 2024-04-19T22:52:11.632356+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:13.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: audit 2024-04-19T22:52:11.632605+0000 mon.a (mon.0) 1813 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: audit 2024-04-19T22:52:11.641784+0000 mon.c (mon.2) 413 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: cluster 2024-04-19T22:52:11.863105+0000 mgr.y (mgr.24389) 290 : cluster 0 pgmap v329: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:52:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: cluster 2024-04-19T22:52:12.083896+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-04-19T22:52:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: audit 2024-04-19T22:52:12.086476+0000 mon.a (mon.0) 1815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[21528]: audit 2024-04-19T22:52:12.090811+0000 mon.a (mon.0) 1816 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: cluster 2024-04-19T22:52:11.619828+0000 mon.a (mon.0) 1811 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: audit 2024-04-19T22:52:11.632356+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: audit 2024-04-19T22:52:11.632605+0000 mon.a (mon.0) 1813 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: audit 2024-04-19T22:52:11.641784+0000 mon.c (mon.2) 413 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: cluster 2024-04-19T22:52:11.863105+0000 mgr.y (mgr.24389) 290 : cluster 0 pgmap v329: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:52:13.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: cluster 2024-04-19T22:52:12.083896+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-04-19T22:52:13.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: audit 2024-04-19T22:52:12.086476+0000 mon.a (mon.0) 1815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:12 smithi113 bash[28910]: audit 2024-04-19T22:52:12.090811+0000 mon.a (mon.0) 1816 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:13.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: cluster 2024-04-19T22:52:11.619828+0000 mon.a (mon.0) 1811 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: audit 2024-04-19T22:52:11.632356+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-19"}]': finished 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: audit 2024-04-19T22:52:11.632605+0000 mon.a (mon.0) 1813 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi113-63873-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: audit 2024-04-19T22:52:11.641784+0000 mon.c (mon.2) 413 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: cluster 2024-04-19T22:52:11.863105+0000 mgr.y (mgr.24389) 290 : cluster 0 pgmap v329: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: cluster 2024-04-19T22:52:12.083896+0000 mon.a (mon.0) 1814 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-04-19T22:52:13.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: audit 2024-04-19T22:52:12.086476+0000 mon.a (mon.0) 1815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:13.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:12 smithi178 bash[23441]: audit 2024-04-19T22:52:12.090811+0000 mon.a (mon.0) 1816 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:14.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[28910]: audit 2024-04-19T22:52:12.637516+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[28910]: audit 2024-04-19T22:52:12.637733+0000 mon.a (mon.0) 1818 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[28910]: cluster 2024-04-19T22:52:13.076868+0000 mon.a (mon.0) 1819 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-04-19T22:52:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[21528]: audit 2024-04-19T22:52:12.637516+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[21528]: audit 2024-04-19T22:52:12.637733+0000 mon.a (mon.0) 1818 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:14.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:13 smithi113 bash[21528]: cluster 2024-04-19T22:52:13.076868+0000 mon.a (mon.0) 1819 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-04-19T22:52:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:13 smithi178 bash[23441]: audit 2024-04-19T22:52:12.637516+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi113-63833-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:13 smithi178 bash[23441]: audit 2024-04-19T22:52:12.637733+0000 mon.a (mon.0) 1818 : audit 1 from='client.? 172.21.15.113:0/881919687' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi113-63841-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:14.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:13 smithi178 bash[23441]: cluster 2024-04-19T22:52:13.076868+0000 mon.a (mon.0) 1819 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAid=5 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:89d3ae78:::11:head 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:89d3ae78:::11:head expected=15:89d3ae78:::11:head 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:89d3ae78:::11:head -> 11 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=11 expected=11 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:863748b0:::15:head 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:863748b0:::15:head expected=15:863748b0:::15:head 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:863748b0:::15:head -> 15 2024-04-19T22:52:14.759 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=15 expected=15 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:6cac518f:::0:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:6cac518f:::0:head expected=15:6cac518f:::0:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:6cac518f:::0:head -> 0 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=0 expected=0 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:62a1935d:::14:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:62a1935d:::14:head expected=15:62a1935d:::14:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:62a1935d:::14:head -> 14 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=14 expected=14 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:5c6b0b28:::7:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:5c6b0b28:::7:head expected=15:5c6b0b28:::7:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:5c6b0b28:::7:head -> 7 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=7 expected=7 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:02547ec2:::1:head 2024-04-19T22:52:14.760 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:02547ec2:::1:head expected=15:02547ec2:::1:head 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:02547ec2:::1:head -> 1 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=1 expected=1 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:566253c9:::13:head 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:566253c9:::13:head expected=15:566253c9:::13:head 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:566253c9:::13:head -> 13 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=13 expected=13 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : seek to 15:52ea6a34:::10:head 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : cursor()=15:52ea6a34:::10:head expected=15:52ea6a34:::10:head 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: > 15:52ea6a34:::10:head -> 10 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: : entry=10 expected=10 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (236 ms) 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (135463 ms) 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-19T22:52:14.761 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: split 0/5 -> MIN 15:33333333::::head 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: split 1/5 -> 15:33333333::::head 15:66666666::::head 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: split 2/5 -> 15:66666666::::head 15:99999999::::head 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: split 3/5 -> 15:99999999::::head 15:cccccccc::::head 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: split 4/5 -> 15:cccccccc::::head MAX 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (7838 ms) 2024-04-19T22:52:14.762 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 7 tests from LibRadosList (144017 ms total) 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1069 ms) 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo1,foo2,foo3 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo1 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo2 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo3 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo1,foo4,foo5 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo4 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo5 2024-04-19T22:52:14.764 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo1 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset foo6,foo7 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo7 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: foo6 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo4 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo5 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns2:foo7 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns2:foo6 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: ns1:foo1 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo1 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo2 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: :foo3 2024-04-19T22:52:14.765 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (37 ms) 2024-04-19T22:52:14.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:13.641405+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:14.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: cluster 2024-04-19T22:52:13.651619+0000 mon.a (mon.0) 1821 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-04-19T22:52:14.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:13.663071+0000 mon.c (mon.2) 414 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:14.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:13.684429+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:14.940 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: cluster 2024-04-19T22:52:13.863949+0000 mgr.y (mgr.24389) 291 : cluster 0 pgmap v332: 244 pgs: 48 unknown, 196 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:14.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:14.646117+0000 mon.a (mon.0) 1823 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:14.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: cluster 2024-04-19T22:52:14.659091+0000 mon.a (mon.0) 1824 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-04-19T22:52:14.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:14.662195+0000 mon.c (mon.2) 415 : audit 1 from='client.? 172.21.15.113:0/2162119847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:14.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:14.664476+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:14.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[23441]: audit 2024-04-19T22:52:14.667991+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:13.641405+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: cluster 2024-04-19T22:52:13.651619+0000 mon.a (mon.0) 1821 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:13.663071+0000 mon.c (mon.2) 414 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:13.684429+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: cluster 2024-04-19T22:52:13.863949+0000 mgr.y (mgr.24389) 291 : cluster 0 pgmap v332: 244 pgs: 48 unknown, 196 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:14.646117+0000 mon.a (mon.0) 1823 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: cluster 2024-04-19T22:52:14.659091+0000 mon.a (mon.0) 1824 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:14.662195+0000 mon.c (mon.2) 415 : audit 1 from='client.? 172.21.15.113:0/2162119847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:14.664476+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[28910]: audit 2024-04-19T22:52:14.667991+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:13.641405+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi113-63873-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: cluster 2024-04-19T22:52:13.651619+0000 mon.a (mon.0) 1821 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:13.663071+0000 mon.c (mon.2) 414 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:13.684429+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: cluster 2024-04-19T22:52:13.863949+0000 mgr.y (mgr.24389) 291 : cluster 0 pgmap v332: 244 pgs: 48 unknown, 196 active+clean; 584 KiB data, 534 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:14.646117+0000 mon.a (mon.0) 1823 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: cluster 2024-04-19T22:52:14.659091+0000 mon.a (mon.0) 1824 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:14.662195+0000 mon.c (mon.2) 415 : audit 1 from='client.? 172.21.15.113:0/2162119847' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:14.664476+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:15.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:14 smithi113 bash[21528]: audit 2024-04-19T22:52:14.667991+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:15.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:14.716529+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:14.717816+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:14.942830+0000 mgr.y (mgr.24389) 292 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: cluster 2024-04-19T22:52:15.514563+0000 mon.a (mon.0) 1828 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.649153+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.649345+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:16.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.649534+0000 mon.a (mon.0) 1831 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: cluster 2024-04-19T22:52:15.657278+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.659323+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.663495+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.664245+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.665664+0000 mon.a (mon.0) 1834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[28910]: audit 2024-04-19T22:52:15.666597+0000 mon.a (mon.0) 1835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:14.716529+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:14.717816+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:14.942830+0000 mgr.y (mgr.24389) 292 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: cluster 2024-04-19T22:52:15.514563+0000 mon.a (mon.0) 1828 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.649153+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.649345+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.649534+0000 mon.a (mon.0) 1831 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: cluster 2024-04-19T22:52:15.657278+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.659323+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.663495+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.664245+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.665664+0000 mon.a (mon.0) 1834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:15 smithi113 bash[21528]: audit 2024-04-19T22:52:15.666597+0000 mon.a (mon.0) 1835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:14.716529+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:14.717816+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:14.942830+0000 mgr.y (mgr.24389) 292 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: cluster 2024-04-19T22:52:15.514563+0000 mon.a (mon.0) 1828 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.649153+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi113-63841-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.649345+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.649534+0000 mon.a (mon.0) 1831 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: cluster 2024-04-19T22:52:15.657278+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.659323+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.663495+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.664245+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:16.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.665664+0000 mon.a (mon.0) 1834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:16.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:15 smithi178 bash[23441]: audit 2024-04-19T22:52:15.666597+0000 mon.a (mon.0) 1835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: cluster 2024-04-19T22:52:15.864772+0000 mgr.y (mgr.24389) 293 : cluster 0 pgmap v335: 260 pgs: 31 creating+peering, 8 creating+activating, 1 unknown, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.654453+0000 mon.a (mon.0) 1836 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.654655+0000 mon.a (mon.0) 1837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.654854+0000 mon.a (mon.0) 1838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: cluster 2024-04-19T22:52:16.662619+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.667147+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.668095+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.672894+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.673285+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.696216+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.696730+0000 mon.a (mon.0) 1842 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.697590+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.697942+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.698568+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[28910]: audit 2024-04-19T22:52:16.698928+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: cluster 2024-04-19T22:52:15.864772+0000 mgr.y (mgr.24389) 293 : cluster 0 pgmap v335: 260 pgs: 31 creating+peering, 8 creating+activating, 1 unknown, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.654453+0000 mon.a (mon.0) 1836 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.654655+0000 mon.a (mon.0) 1837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.654854+0000 mon.a (mon.0) 1838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: cluster 2024-04-19T22:52:16.662619+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.667147+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.668095+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.672894+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.673285+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.696216+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.696730+0000 mon.a (mon.0) 1842 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.697590+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.697942+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.698568+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21528]: audit 2024-04-19T22:52:16.698928+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: cluster 2024-04-19T22:52:15.864772+0000 mgr.y (mgr.24389) 293 : cluster 0 pgmap v335: 260 pgs: 31 creating+peering, 8 creating+activating, 1 unknown, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.654453+0000 mon.a (mon.0) 1836 : audit 1 from='client.? 172.21.15.113:0/3034470089' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi113-63833-32"}]': finished 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.654655+0000 mon.a (mon.0) 1837 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.654854+0000 mon.a (mon.0) 1838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: cluster 2024-04-19T22:52:16.662619+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.667147+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.113:0/417533126' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.668095+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.672894+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.673285+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.696216+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.696730+0000 mon.a (mon.0) 1842 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.697590+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.697942+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.698568+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:17 smithi178 bash[23441]: audit 2024-04-19T22:52:16.698928+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:18.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: cluster 2024-04-19T22:52:17.656664+0000 mon.a (mon.0) 1845 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:18.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.659320+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:18.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.659535+0000 mon.a (mon.0) 1847 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]': finished 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.659776+0000 mon.a (mon.0) 1848 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: cluster 2024-04-19T22:52:17.668853+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.670632+0000 mon.c (mon.2) 424 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.671996+0000 mon.c (mon.2) 425 : audit 1 from='client.? 172.21.15.113:0/10773551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.673574+0000 mon.a (mon.0) 1850 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.674745+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:17.753342+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[28910]: audit 2024-04-19T22:52:18.125758+0000 mon.a (mon.0) 1852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: cluster 2024-04-19T22:52:17.656664+0000 mon.a (mon.0) 1845 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.659320+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.659535+0000 mon.a (mon.0) 1847 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]': finished 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.659776+0000 mon.a (mon.0) 1848 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: cluster 2024-04-19T22:52:17.668853+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.670632+0000 mon.c (mon.2) 424 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.671996+0000 mon.c (mon.2) 425 : audit 1 from='client.? 172.21.15.113:0/10773551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.673574+0000 mon.a (mon.0) 1850 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.674745+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:17.753342+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:18.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:18 smithi113 bash[21528]: audit 2024-04-19T22:52:18.125758+0000 mon.a (mon.0) 1852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: cluster 2024-04-19T22:52:17.656664+0000 mon.a (mon.0) 1845 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.659320+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi113-63873-2"}]': finished 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.659535+0000 mon.a (mon.0) 1847 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-21", "mode": "writeback"}]': finished 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.659776+0000 mon.a (mon.0) 1848 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi113-63833-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: cluster 2024-04-19T22:52:17.668853+0000 mon.a (mon.0) 1849 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.670632+0000 mon.c (mon.2) 424 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.671996+0000 mon.c (mon.2) 425 : audit 1 from='client.? 172.21.15.113:0/10773551' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.673574+0000 mon.a (mon.0) 1850 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.674745+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:17.753342+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:18 smithi178 bash[23441]: audit 2024-04-19T22:52:18.125758+0000 mon.a (mon.0) 1852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: cluster 2024-04-19T22:52:17.865541+0000 mgr.y (mgr.24389) 294 : cluster 0 pgmap v338: 260 pgs: 32 unknown, 8 creating+activating, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:18.232560+0000 mon.a (mon.0) 1853 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:18.670394+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:18.670699+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:18.680567+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: cluster 2024-04-19T22:52:19.132320+0000 mon.a (mon.0) 1856 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:19.133846+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[21528]: audit 2024-04-19T22:52:19.134757+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: cluster 2024-04-19T22:52:17.865541+0000 mgr.y (mgr.24389) 294 : cluster 0 pgmap v338: 260 pgs: 32 unknown, 8 creating+activating, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:18.232560+0000 mon.a (mon.0) 1853 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:18.670394+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:18.670699+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:18.680567+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: cluster 2024-04-19T22:52:19.132320+0000 mon.a (mon.0) 1856 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:19.133846+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:19 smithi113 bash[28910]: audit 2024-04-19T22:52:19.134757+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: cluster 2024-04-19T22:52:17.865541+0000 mgr.y (mgr.24389) 294 : cluster 0 pgmap v338: 260 pgs: 32 unknown, 8 creating+activating, 220 active+clean; 584 KiB data, 538 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:18.232560+0000 mon.a (mon.0) 1853 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:18.670394+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:18.670699+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:18.680567+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: cluster 2024-04-19T22:52:19.132320+0000 mon.a (mon.0) 1856 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:19.133846+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:19 smithi178 bash[23441]: audit 2024-04-19T22:52:19.134757+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]: dispatch 2024-04-19T22:52:20.696 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-04-19T22:52:20.696 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 1 0 2024-04-19T22:52:20.696 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 10 0 2024-04-19T22:52:20.696 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 13 0 2024-04-19T22:52:20.696 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 7 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 14 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 0 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 15 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 11 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 5 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 8 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 6 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 3 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 4 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 12 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 9 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 2 0 2024-04-19T22:52:20.697 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (66 ms) 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 3 tests from LibRadosListEC (1172 ms total) 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3022 ms) 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] 1 test from LibRadosListNP (3022 ms total) 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [----------] Global test environment tear-down 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [==========] 11 tests from 3 test suites ran. (171369 ms total) 2024-04-19T22:52:20.698 INFO:tasks.workunit.client.0.smithi113.stdout: api_list: [ PASSED ] 11 tests. 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.574327+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: cluster 2024-04-19T22:52:19.671900+0000 mon.a (mon.0) 1859 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.676023+0000 mon.a (mon.0) 1860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.676273+0000 mon.a (mon.0) 1861 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.676505+0000 mon.a (mon.0) 1862 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: cluster 2024-04-19T22:52:19.684622+0000 mon.a (mon.0) 1863 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.692723+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.113:0/4007265165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.697617+0000 mon.a (mon.0) 1864 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.747868+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: audit 2024-04-19T22:52:19.748276+0000 mon.a (mon.0) 1865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: cluster 2024-04-19T22:52:19.868269+0000 mgr.y (mgr.24389) 295 : cluster 0 pgmap v341: 332 pgs: 16 creating+activating, 36 creating+peering, 10 unknown, 270 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[28910]: cluster 2024-04-19T22:52:20.516074+0000 mon.a (mon.0) 1866 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.574327+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: cluster 2024-04-19T22:52:19.671900+0000 mon.a (mon.0) 1859 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.676023+0000 mon.a (mon.0) 1860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.676273+0000 mon.a (mon.0) 1861 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.676505+0000 mon.a (mon.0) 1862 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: cluster 2024-04-19T22:52:19.684622+0000 mon.a (mon.0) 1863 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.692723+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.113:0/4007265165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.697617+0000 mon.a (mon.0) 1864 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.747868+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: audit 2024-04-19T22:52:19.748276+0000 mon.a (mon.0) 1865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: cluster 2024-04-19T22:52:19.868269+0000 mgr.y (mgr.24389) 295 : cluster 0 pgmap v341: 332 pgs: 16 creating+activating, 36 creating+peering, 10 unknown, 270 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-04-19T22:52:21.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:20 smithi113 bash[21528]: cluster 2024-04-19T22:52:20.516074+0000 mon.a (mon.0) 1866 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.574327+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: cluster 2024-04-19T22:52:19.671900+0000 mon.a (mon.0) 1859 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.676023+0000 mon.a (mon.0) 1860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi113-63833-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.676273+0000 mon.a (mon.0) 1861 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-21"}]': finished 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.676505+0000 mon.a (mon.0) 1862 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63873-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: cluster 2024-04-19T22:52:19.684622+0000 mon.a (mon.0) 1863 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.692723+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.113:0/4007265165' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.697617+0000 mon.a (mon.0) 1864 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.747868+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.113:0/4232283460' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: audit 2024-04-19T22:52:19.748276+0000 mon.a (mon.0) 1865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: cluster 2024-04-19T22:52:19.868269+0000 mgr.y (mgr.24389) 295 : cluster 0 pgmap v341: 332 pgs: 16 creating+activating, 36 creating+peering, 10 unknown, 270 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-04-19T22:52:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:20 smithi178 bash[23441]: cluster 2024-04-19T22:52:20.516074+0000 mon.a (mon.0) 1866 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:22.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[21528]: audit 2024-04-19T22:52:20.684428+0000 mon.a (mon.0) 1867 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[21528]: audit 2024-04-19T22:52:20.684656+0000 mon.a (mon.0) 1868 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-19T22:52:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[21528]: cluster 2024-04-19T22:52:20.692252+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-04-19T22:52:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[28910]: audit 2024-04-19T22:52:20.684428+0000 mon.a (mon.0) 1867 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[28910]: audit 2024-04-19T22:52:20.684656+0000 mon.a (mon.0) 1868 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-19T22:52:22.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:21 smithi113 bash[28910]: cluster 2024-04-19T22:52:20.692252+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-04-19T22:52:22.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:21 smithi178 bash[23441]: audit 2024-04-19T22:52:20.684428+0000 mon.a (mon.0) 1867 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:22.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:21 smithi178 bash[23441]: audit 2024-04-19T22:52:20.684656+0000 mon.a (mon.0) 1868 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi113-63873-3","pool2":"test-rados-api-smithi113-63873-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-04-19T22:52:22.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:21 smithi178 bash[23441]: cluster 2024-04-19T22:52:20.692252+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: cluster 2024-04-19T22:52:21.700285+0000 mon.a (mon.0) 1870 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.705202+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.705721+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.713897+0000 mon.a (mon.0) 1871 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.714544+0000 mon.a (mon.0) 1872 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.727798+0000 mon.c (mon.2) 433 : audit 1 from='client.? 172.21.15.113:0/381451559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:21.731488+0000 mon.a (mon.0) 1873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: cluster 2024-04-19T22:52:21.869235+0000 mgr.y (mgr.24389) 296 : cluster 0 pgmap v344: 324 pgs: 22 creating+peering, 74 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:22.692334+0000 mon.a (mon.0) 1874 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:22.692566+0000 mon.a (mon.0) 1875 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:22.692747+0000 mon.a (mon.0) 1876 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: cluster 2024-04-19T22:52:22.702945+0000 mon.a (mon.0) 1877 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:22.705431+0000 mon.c (mon.2) 434 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[21528]: audit 2024-04-19T22:52:22.706824+0000 mon.a (mon.0) 1878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: cluster 2024-04-19T22:52:21.700285+0000 mon.a (mon.0) 1870 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.705202+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.705721+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.713897+0000 mon.a (mon.0) 1871 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.714544+0000 mon.a (mon.0) 1872 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.727798+0000 mon.c (mon.2) 433 : audit 1 from='client.? 172.21.15.113:0/381451559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:21.731488+0000 mon.a (mon.0) 1873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: cluster 2024-04-19T22:52:21.869235+0000 mgr.y (mgr.24389) 296 : cluster 0 pgmap v344: 324 pgs: 22 creating+peering, 74 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:22.692334+0000 mon.a (mon.0) 1874 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:22.692566+0000 mon.a (mon.0) 1875 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:22.692747+0000 mon.a (mon.0) 1876 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: cluster 2024-04-19T22:52:22.702945+0000 mon.a (mon.0) 1877 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:22.705431+0000 mon.c (mon.2) 434 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:22 smithi113 bash[28910]: audit 2024-04-19T22:52:22.706824+0000 mon.a (mon.0) 1878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: cluster 2024-04-19T22:52:21.700285+0000 mon.a (mon.0) 1870 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.705202+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.705721+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.713897+0000 mon.a (mon.0) 1871 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.714544+0000 mon.a (mon.0) 1872 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.727798+0000 mon.c (mon.2) 433 : audit 1 from='client.? 172.21.15.113:0/381451559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:21.731488+0000 mon.a (mon.0) 1873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: cluster 2024-04-19T22:52:21.869235+0000 mgr.y (mgr.24389) 296 : cluster 0 pgmap v344: 324 pgs: 22 creating+peering, 74 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:22.692334+0000 mon.a (mon.0) 1874 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:22.692566+0000 mon.a (mon.0) 1875 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:22.692747+0000 mon.a (mon.0) 1876 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi113-63841-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: cluster 2024-04-19T22:52:22.702945+0000 mon.a (mon.0) 1877 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-04-19T22:52:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:22.705431+0000 mon.c (mon.2) 434 : audit 1 from='client.? 172.21.15.113:0/196824606' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:22 smithi178 bash[23441]: audit 2024-04-19T22:52:22.706824+0000 mon.a (mon.0) 1878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]: dispatch 2024-04-19T22:52:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.695914+0000 mon.a (mon.0) 1879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: cluster 2024-04-19T22:52:23.705846+0000 mon.a (mon.0) 1880 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.747151+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.749160+0000 mon.a (mon.0) 1882 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.749729+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.760054+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: audit 2024-04-19T22:52:23.760400+0000 mon.a (mon.0) 1884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[28910]: cluster 2024-04-19T22:52:23.870127+0000 mgr.y (mgr.24389) 297 : cluster 0 pgmap v347: 292 pgs: 22 creating+peering, 42 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.695914+0000 mon.a (mon.0) 1879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: cluster 2024-04-19T22:52:23.705846+0000 mon.a (mon.0) 1880 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-04-19T22:52:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.747151+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.749160+0000 mon.a (mon.0) 1882 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.749729+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.760054+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: audit 2024-04-19T22:52:23.760400+0000 mon.a (mon.0) 1884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:24 smithi113 bash[21528]: cluster 2024-04-19T22:52:23.870127+0000 mgr.y (mgr.24389) 297 : cluster 0 pgmap v347: 292 pgs: 22 creating+peering, 42 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:25.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.695914+0000 mon.a (mon.0) 1879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi113-63833-33"}]': finished 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: cluster 2024-04-19T22:52:23.705846+0000 mon.a (mon.0) 1880 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.747151+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.749160+0000 mon.a (mon.0) 1882 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.749729+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.760054+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: audit 2024-04-19T22:52:23.760400+0000 mon.a (mon.0) 1884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:24 smithi178 bash[23441]: cluster 2024-04-19T22:52:23.870127+0000 mgr.y (mgr.24389) 297 : cluster 0 pgmap v347: 292 pgs: 22 creating+peering, 42 unknown, 228 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.698854+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.699066+0000 mon.a (mon.0) 1886 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: cluster 2024-04-19T22:52:24.706756+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.708554+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.710677+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.715200+0000 mon.a (mon.0) 1889 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:24.954389+0000 mgr.y (mgr.24389) 298 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: cluster 2024-04-19T22:52:25.517594+0000 mon.a (mon.0) 1890 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:26.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[21528]: audit 2024-04-19T22:52:25.702181+0000 mon.a (mon.0) 1891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.698854+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.699066+0000 mon.a (mon.0) 1886 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: cluster 2024-04-19T22:52:24.706756+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.708554+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.710677+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.715200+0000 mon.a (mon.0) 1889 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:24.954389+0000 mgr.y (mgr.24389) 298 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: cluster 2024-04-19T22:52:25.517594+0000 mon.a (mon.0) 1890 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:26 smithi113 bash[28910]: audit 2024-04-19T22:52:25.702181+0000 mon.a (mon.0) 1891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:26.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.698854+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi113-63833-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.699066+0000 mon.a (mon.0) 1886 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: cluster 2024-04-19T22:52:24.706756+0000 mon.a (mon.0) 1887 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.708554+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.710677+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.715200+0000 mon.a (mon.0) 1889 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:24.954389+0000 mgr.y (mgr.24389) 298 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: cluster 2024-04-19T22:52:25.517594+0000 mon.a (mon.0) 1890 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:26.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:26 smithi178 bash[23441]: audit 2024-04-19T22:52:25.702181+0000 mon.a (mon.0) 1891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:27.477 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: audit 2024-04-19T22:52:25.712344+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: cluster 2024-04-19T22:52:25.870932+0000 mgr.y (mgr.24389) 299 : cluster 0 pgmap v350: 228 pgs: 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: cluster 2024-04-19T22:52:26.156110+0000 mon.a (mon.0) 1892 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: audit 2024-04-19T22:52:26.158751+0000 mon.a (mon.0) 1893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: cluster 2024-04-19T22:52:26.704294+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: audit 2024-04-19T22:52:26.719506+0000 mon.a (mon.0) 1895 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: audit 2024-04-19T22:52:26.719794+0000 mon.a (mon.0) 1896 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]': finished 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: cluster 2024-04-19T22:52:26.732096+0000 mon.a (mon.0) 1897 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[28910]: audit 2024-04-19T22:52:26.753527+0000 mon.a (mon.0) 1898 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: audit 2024-04-19T22:52:25.712344+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: cluster 2024-04-19T22:52:25.870932+0000 mgr.y (mgr.24389) 299 : cluster 0 pgmap v350: 228 pgs: 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: cluster 2024-04-19T22:52:26.156110+0000 mon.a (mon.0) 1892 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: audit 2024-04-19T22:52:26.158751+0000 mon.a (mon.0) 1893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: cluster 2024-04-19T22:52:26.704294+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: audit 2024-04-19T22:52:26.719506+0000 mon.a (mon.0) 1895 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: audit 2024-04-19T22:52:26.719794+0000 mon.a (mon.0) 1896 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]': finished 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: cluster 2024-04-19T22:52:26.732096+0000 mon.a (mon.0) 1897 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-04-19T22:52:27.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21528]: audit 2024-04-19T22:52:26.753527+0000 mon.a (mon.0) 1898 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: audit 2024-04-19T22:52:25.712344+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: cluster 2024-04-19T22:52:25.870932+0000 mgr.y (mgr.24389) 299 : cluster 0 pgmap v350: 228 pgs: 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: cluster 2024-04-19T22:52:26.156110+0000 mon.a (mon.0) 1892 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: audit 2024-04-19T22:52:26.158751+0000 mon.a (mon.0) 1893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]: dispatch 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: cluster 2024-04-19T22:52:26.704294+0000 mon.a (mon.0) 1894 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: audit 2024-04-19T22:52:26.719506+0000 mon.a (mon.0) 1895 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi113-63833-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: audit 2024-04-19T22:52:26.719794+0000 mon.a (mon.0) 1896 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-23", "mode": "writeback"}]': finished 2024-04-19T22:52:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: cluster 2024-04-19T22:52:26.732096+0000 mon.a (mon.0) 1897 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-04-19T22:52:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:27 smithi178 bash[23441]: audit 2024-04-19T22:52:26.753527+0000 mon.a (mon.0) 1898 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[21528]: audit 2024-04-19T22:52:27.722802+0000 mon.a (mon.0) 1899 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[21528]: cluster 2024-04-19T22:52:27.729547+0000 mon.a (mon.0) 1900 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[21528]: audit 2024-04-19T22:52:27.820249+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[21528]: audit 2024-04-19T22:52:27.820651+0000 mon.a (mon.0) 1901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[21528]: cluster 2024-04-19T22:52:27.871417+0000 mgr.y (mgr.24389) 300 : cluster 0 pgmap v353: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[28910]: audit 2024-04-19T22:52:27.722802+0000 mon.a (mon.0) 1899 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[28910]: cluster 2024-04-19T22:52:27.729547+0000 mon.a (mon.0) 1900 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-04-19T22:52:29.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[28910]: audit 2024-04-19T22:52:27.820249+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[28910]: audit 2024-04-19T22:52:27.820651+0000 mon.a (mon.0) 1901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:28 smithi113 bash[28910]: cluster 2024-04-19T22:52:27.871417+0000 mgr.y (mgr.24389) 300 : cluster 0 pgmap v353: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:28 smithi178 bash[23441]: audit 2024-04-19T22:52:27.722802+0000 mon.a (mon.0) 1899 : audit 1 from='client.? 172.21.15.113:0/1639093453' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:29.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:28 smithi178 bash[23441]: cluster 2024-04-19T22:52:27.729547+0000 mon.a (mon.0) 1900 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-04-19T22:52:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:28 smithi178 bash[23441]: audit 2024-04-19T22:52:27.820249+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:28 smithi178 bash[23441]: audit 2024-04-19T22:52:27.820651+0000 mon.a (mon.0) 1901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:28 smithi178 bash[23441]: cluster 2024-04-19T22:52:27.871417+0000 mgr.y (mgr.24389) 300 : cluster 0 pgmap v353: 268 pgs: 40 unknown, 228 active+clean; 584 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:28.727484+0000 mon.a (mon.0) 1902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: cluster 2024-04-19T22:52:28.739815+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:28.740750+0000 mon.c (mon.2) 439 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:28.743223+0000 mon.a (mon.0) 1904 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:28.744165+0000 mon.a (mon.0) 1905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:28.759750+0000 mon.a (mon.0) 1906 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:30.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: cluster 2024-04-19T22:52:29.728100+0000 mon.a (mon.0) 1907 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:29.730537+0000 mon.a (mon.0) 1908 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:29.730735+0000 mon.a (mon.0) 1909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:29.730911+0000 mon.a (mon.0) 1910 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: cluster 2024-04-19T22:52:29.747153+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[21528]: audit 2024-04-19T22:52:29.751479+0000 mon.a (mon.0) 1912 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:28.727484+0000 mon.a (mon.0) 1902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: cluster 2024-04-19T22:52:28.739815+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:28.740750+0000 mon.c (mon.2) 439 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:28.743223+0000 mon.a (mon.0) 1904 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:28.744165+0000 mon.a (mon.0) 1905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:28.759750+0000 mon.a (mon.0) 1906 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: cluster 2024-04-19T22:52:29.728100+0000 mon.a (mon.0) 1907 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:29.730537+0000 mon.a (mon.0) 1908 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:29.730735+0000 mon.a (mon.0) 1909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:29.730911+0000 mon.a (mon.0) 1910 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: cluster 2024-04-19T22:52:29.747153+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-04-19T22:52:30.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:29 smithi113 bash[28910]: audit 2024-04-19T22:52:29.751479+0000 mon.a (mon.0) 1912 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:28.727484+0000 mon.a (mon.0) 1902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: cluster 2024-04-19T22:52:28.739815+0000 mon.a (mon.0) 1903 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:28.740750+0000 mon.c (mon.2) 439 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:28.743223+0000 mon.a (mon.0) 1904 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:28.744165+0000 mon.a (mon.0) 1905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]: dispatch 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:28.759750+0000 mon.a (mon.0) 1906 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: cluster 2024-04-19T22:52:29.728100+0000 mon.a (mon.0) 1907 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:29.730537+0000 mon.a (mon.0) 1908 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:29.730735+0000 mon.a (mon.0) 1909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-23"}]': finished 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:29.730911+0000 mon.a (mon.0) 1910 : audit 1 from='client.? 172.21.15.113:0/2191719615' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: cluster 2024-04-19T22:52:29.747153+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-04-19T22:52:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:29 smithi178 bash[23441]: audit 2024-04-19T22:52:29.751479+0000 mon.a (mon.0) 1912 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]: dispatch 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: cluster 2024-04-19T22:52:29.872410+0000 mgr.y (mgr.24389) 301 : cluster 0 pgmap v356: 292 pgs: 3 creating+activating, 29 creating+peering, 260 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: cluster 2024-04-19T22:52:30.519113+0000 mon.a (mon.0) 1913 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: audit 2024-04-19T22:52:30.735598+0000 mon.a (mon.0) 1914 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: cluster 2024-04-19T22:52:30.746431+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: audit 2024-04-19T22:52:30.752348+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.113:0/3294211118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[28910]: audit 2024-04-19T22:52:30.753076+0000 mon.a (mon.0) 1916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: cluster 2024-04-19T22:52:29.872410+0000 mgr.y (mgr.24389) 301 : cluster 0 pgmap v356: 292 pgs: 3 creating+activating, 29 creating+peering, 260 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: cluster 2024-04-19T22:52:30.519113+0000 mon.a (mon.0) 1913 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:31.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: audit 2024-04-19T22:52:30.735598+0000 mon.a (mon.0) 1914 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: cluster 2024-04-19T22:52:30.746431+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-04-19T22:52:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: audit 2024-04-19T22:52:30.752348+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.113:0/3294211118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:31 smithi113 bash[21528]: audit 2024-04-19T22:52:30.753076+0000 mon.a (mon.0) 1916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:31.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: cluster 2024-04-19T22:52:29.872410+0000 mgr.y (mgr.24389) 301 : cluster 0 pgmap v356: 292 pgs: 3 creating+activating, 29 creating+peering, 260 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-19T22:52:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: cluster 2024-04-19T22:52:30.519113+0000 mon.a (mon.0) 1913 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: audit 2024-04-19T22:52:30.735598+0000 mon.a (mon.0) 1914 : audit 1 from='client.? 172.21.15.113:0/2291749461' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi113-63833-34"}]': finished 2024-04-19T22:52:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: cluster 2024-04-19T22:52:30.746431+0000 mon.a (mon.0) 1915 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-04-19T22:52:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: audit 2024-04-19T22:52:30.752348+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.113:0/3294211118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:31 smithi178 bash[23441]: audit 2024-04-19T22:52:30.753076+0000 mon.a (mon.0) 1916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:30.798903+0000 mon.c (mon.2) 441 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.209729+0000 mon.a (mon.0) 1917 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.214992+0000 mon.c (mon.2) 442 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.216619+0000 mon.a (mon.0) 1918 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.217517+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.223430+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.739517+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.739797+0000 mon.a (mon.0) 1921 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: cluster 2024-04-19T22:52:31.748772+0000 mon.a (mon.0) 1922 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.751387+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.764850+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.765802+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[21528]: audit 2024-04-19T22:52:31.766512+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:30.798903+0000 mon.c (mon.2) 441 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.209729+0000 mon.a (mon.0) 1917 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.214992+0000 mon.c (mon.2) 442 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.216619+0000 mon.a (mon.0) 1918 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.217517+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.223430+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.739517+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.739797+0000 mon.a (mon.0) 1921 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: cluster 2024-04-19T22:52:31.748772+0000 mon.a (mon.0) 1922 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.751387+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.764850+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.765802+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:32 smithi113 bash[28910]: audit 2024-04-19T22:52:31.766512+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:30.798903+0000 mon.c (mon.2) 441 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.209729+0000 mon.a (mon.0) 1917 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.214992+0000 mon.c (mon.2) 442 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.216619+0000 mon.a (mon.0) 1918 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.217517+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.223430+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.739517+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.739797+0000 mon.a (mon.0) 1921 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi113-63833-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: cluster 2024-04-19T22:52:31.748772+0000 mon.a (mon.0) 1922 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-04-19T22:52:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.751387+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.764850+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:32.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.765802+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:32.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:32 smithi178 bash[23441]: audit 2024-04-19T22:52:31.766512+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[28910]: cluster 2024-04-19T22:52:31.873169+0000 mgr.y (mgr.24389) 302 : cluster 0 pgmap v359: 324 pgs: 64 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[28910]: audit 2024-04-19T22:52:32.752479+0000 mon.a (mon.0) 1925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[28910]: cluster 2024-04-19T22:52:33.193303+0000 mon.a (mon.0) 1926 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[28910]: audit 2024-04-19T22:52:33.194846+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.113:0/1594651952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[28910]: audit 2024-04-19T22:52:33.198758+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[21528]: cluster 2024-04-19T22:52:31.873169+0000 mgr.y (mgr.24389) 302 : cluster 0 pgmap v359: 324 pgs: 64 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[21528]: audit 2024-04-19T22:52:32.752479+0000 mon.a (mon.0) 1925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:33.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[21528]: cluster 2024-04-19T22:52:33.193303+0000 mon.a (mon.0) 1926 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-04-19T22:52:33.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[21528]: audit 2024-04-19T22:52:33.194846+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.113:0/1594651952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:33 smithi113 bash[21528]: audit 2024-04-19T22:52:33.198758+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:33 smithi178 bash[23441]: cluster 2024-04-19T22:52:31.873169+0000 mgr.y (mgr.24389) 302 : cluster 0 pgmap v359: 324 pgs: 64 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:52:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:33 smithi178 bash[23441]: audit 2024-04-19T22:52:32.752479+0000 mon.a (mon.0) 1925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:33 smithi178 bash[23441]: cluster 2024-04-19T22:52:33.193303+0000 mon.a (mon.0) 1926 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-04-19T22:52:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:33 smithi178 bash[23441]: audit 2024-04-19T22:52:33.194846+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.113:0/1594651952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:33 smithi178 bash[23441]: audit 2024-04-19T22:52:33.198758+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.271918+0000 mon.a (mon.0) 1928 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.274529+0000 mon.a (mon.0) 1929 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.756113+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.756375+0000 mon.a (mon.0) 1931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: cluster 2024-04-19T22:52:33.767224+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.816710+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[28910]: audit 2024-04-19T22:52:33.817135+0000 mon.a (mon.0) 1933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.271918+0000 mon.a (mon.0) 1928 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.274529+0000 mon.a (mon.0) 1929 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.756113+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.756375+0000 mon.a (mon.0) 1931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: cluster 2024-04-19T22:52:33.767224+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.816710+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:34 smithi113 bash[21528]: audit 2024-04-19T22:52:33.817135+0000 mon.a (mon.0) 1933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.271918+0000 mon.a (mon.0) 1928 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.274529+0000 mon.a (mon.0) 1929 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.756113+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi113-63833-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.756375+0000 mon.a (mon.0) 1931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: cluster 2024-04-19T22:52:33.767224+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.816710+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[23441]: audit 2024-04-19T22:52:33.817135+0000 mon.a (mon.0) 1933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:35.278 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: cluster 2024-04-19T22:52:33.873704+0000 mgr.y (mgr.24389) 303 : cluster 0 pgmap v362: 364 pgs: 104 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: audit 2024-04-19T22:52:34.766766+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: cluster 2024-04-19T22:52:34.775710+0000 mon.a (mon.0) 1935 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: audit 2024-04-19T22:52:34.777653+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: audit 2024-04-19T22:52:34.790677+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: audit 2024-04-19T22:52:34.790894+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.113:0/3199156586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:35.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[28910]: audit 2024-04-19T22:52:34.792491+0000 mon.a (mon.0) 1937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: cluster 2024-04-19T22:52:33.873704+0000 mgr.y (mgr.24389) 303 : cluster 0 pgmap v362: 364 pgs: 104 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: audit 2024-04-19T22:52:34.766766+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: cluster 2024-04-19T22:52:34.775710+0000 mon.a (mon.0) 1935 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: audit 2024-04-19T22:52:34.777653+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: audit 2024-04-19T22:52:34.790677+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: audit 2024-04-19T22:52:34.790894+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.113:0/3199156586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:35 smithi113 bash[21528]: audit 2024-04-19T22:52:34.792491+0000 mon.a (mon.0) 1937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: cluster 2024-04-19T22:52:33.873704+0000 mgr.y (mgr.24389) 303 : cluster 0 pgmap v362: 364 pgs: 104 unknown, 3 creating+activating, 29 creating+peering, 228 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: audit 2024-04-19T22:52:34.766766+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: cluster 2024-04-19T22:52:34.775710+0000 mon.a (mon.0) 1935 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: audit 2024-04-19T22:52:34.777653+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: audit 2024-04-19T22:52:34.790677+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: audit 2024-04-19T22:52:34.790894+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.113:0/3199156586' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:35 smithi178 bash[23441]: audit 2024-04-19T22:52:34.792491+0000 mon.a (mon.0) 1937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:34.962936+0000 mgr.y (mgr.24389) 304 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.526718+0000 mon.a (mon.0) 1938 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.526945+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: cluster 2024-04-19T22:52:35.536271+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.540307+0000 mon.c (mon.2) 450 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.542293+0000 mon.c (mon.2) 451 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.545451+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[21528]: audit 2024-04-19T22:52:35.546157+0000 mon.a (mon.0) 1942 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:34.962936+0000 mgr.y (mgr.24389) 304 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.526718+0000 mon.a (mon.0) 1938 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.526945+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: cluster 2024-04-19T22:52:35.536271+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.540307+0000 mon.c (mon.2) 450 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.542293+0000 mon.c (mon.2) 451 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.545451+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:36 smithi113 bash[28910]: audit 2024-04-19T22:52:35.546157+0000 mon.a (mon.0) 1942 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:34.962936+0000 mgr.y (mgr.24389) 304 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.526718+0000 mon.a (mon.0) 1938 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.526945+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi113-63841-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: cluster 2024-04-19T22:52:35.536271+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.540307+0000 mon.c (mon.2) 450 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.542293+0000 mon.c (mon.2) 451 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.545451+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]: dispatch 2024-04-19T22:52:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:36 smithi178 bash[23441]: audit 2024-04-19T22:52:35.546157+0000 mon.a (mon.0) 1942 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: cluster 2024-04-19T22:52:35.874627+0000 mgr.y (mgr.24389) 305 : cluster 0 pgmap v365: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: cluster 2024-04-19T22:52:36.526666+0000 mon.a (mon.0) 1943 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: cluster 2024-04-19T22:52:36.527980+0000 mon.a (mon.0) 1944 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.538739+0000 mon.a (mon.0) 1945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]': finished 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.538972+0000 mon.a (mon.0) 1946 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: cluster 2024-04-19T22:52:36.551291+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.552138+0000 mon.c (mon.2) 452 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.552947+0000 mon.a (mon.0) 1948 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.637123+0000 mon.c (mon.2) 453 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[28910]: audit 2024-04-19T22:52:36.637599+0000 mon.a (mon.0) 1949 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: cluster 2024-04-19T22:52:35.874627+0000 mgr.y (mgr.24389) 305 : cluster 0 pgmap v365: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: cluster 2024-04-19T22:52:36.526666+0000 mon.a (mon.0) 1943 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: cluster 2024-04-19T22:52:36.527980+0000 mon.a (mon.0) 1944 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.538739+0000 mon.a (mon.0) 1945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]': finished 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.538972+0000 mon.a (mon.0) 1946 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: cluster 2024-04-19T22:52:36.551291+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.552138+0000 mon.c (mon.2) 452 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.552947+0000 mon.a (mon.0) 1948 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.637123+0000 mon.c (mon.2) 453 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:37 smithi113 bash[21528]: audit 2024-04-19T22:52:36.637599+0000 mon.a (mon.0) 1949 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:37.808 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: cluster 2024-04-19T22:52:35.874627+0000 mgr.y (mgr.24389) 305 : cluster 0 pgmap v365: 388 pgs: 32 unknown, 356 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:37.808 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: cluster 2024-04-19T22:52:36.526666+0000 mon.a (mon.0) 1943 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:37.808 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: cluster 2024-04-19T22:52:36.527980+0000 mon.a (mon.0) 1944 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.538739+0000 mon.a (mon.0) 1945 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-25", "mode": "writeback"}]': finished 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.538972+0000 mon.a (mon.0) 1946 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: cluster 2024-04-19T22:52:36.551291+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.552138+0000 mon.c (mon.2) 452 : audit 1 from='client.? 172.21.15.113:0/3119278751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.552947+0000 mon.a (mon.0) 1948 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]: dispatch 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.637123+0000 mon.c (mon.2) 453 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:37.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:37 smithi178 bash[23441]: audit 2024-04-19T22:52:36.637599+0000 mon.a (mon.0) 1949 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.552601+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.552836+0000 mon.a (mon.0) 1951 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: cluster 2024-04-19T22:52:37.559378+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-04-19T22:52:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.565110+0000 mon.c (mon.2) 454 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.567909+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.599141+0000 mon.c (mon.2) 455 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.599470+0000 mon.a (mon.0) 1954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.600254+0000 mon.c (mon.2) 456 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.600554+0000 mon.a (mon.0) 1955 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.601070+0000 mon.c (mon.2) 457 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[21528]: audit 2024-04-19T22:52:37.601384+0000 mon.a (mon.0) 1956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.552601+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.552836+0000 mon.a (mon.0) 1951 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: cluster 2024-04-19T22:52:37.559378+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.565110+0000 mon.c (mon.2) 454 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.567909+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.599141+0000 mon.c (mon.2) 455 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.599470+0000 mon.a (mon.0) 1954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.600254+0000 mon.c (mon.2) 456 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.600554+0000 mon.a (mon.0) 1955 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.601070+0000 mon.c (mon.2) 457 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:38 smithi113 bash[28910]: audit 2024-04-19T22:52:37.601384+0000 mon.a (mon.0) 1956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.552601+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi113-63833-35"}]': finished 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.552836+0000 mon.a (mon.0) 1951 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: cluster 2024-04-19T22:52:37.559378+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.565110+0000 mon.c (mon.2) 454 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.567909+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.599141+0000 mon.c (mon.2) 455 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.599470+0000 mon.a (mon.0) 1954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.600254+0000 mon.c (mon.2) 456 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.600554+0000 mon.a (mon.0) 1955 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.601070+0000 mon.c (mon.2) 457 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:38 smithi178 bash[23441]: audit 2024-04-19T22:52:37.601384+0000 mon.a (mon.0) 1956 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:40.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: cluster 2024-04-19T22:52:37.875489+0000 mgr.y (mgr.24389) 306 : cluster 0 pgmap v368: 324 pgs: 324 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:40.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: cluster 2024-04-19T22:52:38.553624+0000 mon.a (mon.0) 1957 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:40.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: audit 2024-04-19T22:52:38.561500+0000 mon.a (mon.0) 1958 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:40.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: audit 2024-04-19T22:52:38.561697+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:40.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: cluster 2024-04-19T22:52:38.572181+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-04-19T22:52:40.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: audit 2024-04-19T22:52:38.573934+0000 mon.c (mon.2) 458 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:40.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[28910]: audit 2024-04-19T22:52:38.575087+0000 mon.a (mon.0) 1961 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:40.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: cluster 2024-04-19T22:52:37.875489+0000 mgr.y (mgr.24389) 306 : cluster 0 pgmap v368: 324 pgs: 324 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:40.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: cluster 2024-04-19T22:52:38.553624+0000 mon.a (mon.0) 1957 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:40.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: audit 2024-04-19T22:52:38.561500+0000 mon.a (mon.0) 1958 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:40.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: audit 2024-04-19T22:52:38.561697+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:40.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: cluster 2024-04-19T22:52:38.572181+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-04-19T22:52:40.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: audit 2024-04-19T22:52:38.573934+0000 mon.c (mon.2) 458 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:40.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:40 smithi113 bash[21528]: audit 2024-04-19T22:52:38.575087+0000 mon.a (mon.0) 1961 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: cluster 2024-04-19T22:52:37.875489+0000 mgr.y (mgr.24389) 306 : cluster 0 pgmap v368: 324 pgs: 324 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:52:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: cluster 2024-04-19T22:52:38.553624+0000 mon.a (mon.0) 1957 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: audit 2024-04-19T22:52:38.561500+0000 mon.a (mon.0) 1958 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-25"}]': finished 2024-04-19T22:52:40.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: audit 2024-04-19T22:52:38.561697+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi113-63833-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:40.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: cluster 2024-04-19T22:52:38.572181+0000 mon.a (mon.0) 1960 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-04-19T22:52:40.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: audit 2024-04-19T22:52:38.573934+0000 mon.c (mon.2) 458 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:40.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:40 smithi178 bash[23441]: audit 2024-04-19T22:52:38.575087+0000 mon.a (mon.0) 1961 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: cluster 2024-04-19T22:52:39.877535+0000 mgr.y (mgr.24389) 307 : cluster 0 pgmap v371: 228 pgs: 228 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: cluster 2024-04-19T22:52:40.021073+0000 mon.a (mon.0) 1962 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: audit 2024-04-19T22:52:40.574013+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: cluster 2024-04-19T22:52:40.583295+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: audit 2024-04-19T22:52:40.588826+0000 mon.c (mon.2) 459 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[28910]: audit 2024-04-19T22:52:40.601976+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: cluster 2024-04-19T22:52:39.877535+0000 mgr.y (mgr.24389) 307 : cluster 0 pgmap v371: 228 pgs: 228 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: cluster 2024-04-19T22:52:40.021073+0000 mon.a (mon.0) 1962 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-04-19T22:52:41.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: audit 2024-04-19T22:52:40.574013+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:41.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: cluster 2024-04-19T22:52:40.583295+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-04-19T22:52:41.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: audit 2024-04-19T22:52:40.588826+0000 mon.c (mon.2) 459 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:41.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:41 smithi113 bash[21528]: audit 2024-04-19T22:52:40.601976+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: cluster 2024-04-19T22:52:39.877535+0000 mgr.y (mgr.24389) 307 : cluster 0 pgmap v371: 228 pgs: 228 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: cluster 2024-04-19T22:52:40.021073+0000 mon.a (mon.0) 1962 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: audit 2024-04-19T22:52:40.574013+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi113-63833-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: cluster 2024-04-19T22:52:40.583295+0000 mon.a (mon.0) 1964 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: audit 2024-04-19T22:52:40.588826+0000 mon.c (mon.2) 459 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:41 smithi178 bash[23441]: audit 2024-04-19T22:52:40.601976+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[28910]: audit 2024-04-19T22:52:41.578356+0000 mon.a (mon.0) 1966 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[28910]: cluster 2024-04-19T22:52:41.588380+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[28910]: audit 2024-04-19T22:52:41.593134+0000 mon.c (mon.2) 460 : audit 1 from='client.? 172.21.15.113:0/1319797149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[28910]: audit 2024-04-19T22:52:41.599754+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[21528]: audit 2024-04-19T22:52:41.578356+0000 mon.a (mon.0) 1966 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[21528]: cluster 2024-04-19T22:52:41.588380+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[21528]: audit 2024-04-19T22:52:41.593134+0000 mon.c (mon.2) 460 : audit 1 from='client.? 172.21.15.113:0/1319797149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:42 smithi113 bash[21528]: audit 2024-04-19T22:52:41.599754+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:42 smithi178 bash[23441]: audit 2024-04-19T22:52:41.578356+0000 mon.a (mon.0) 1966 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:42 smithi178 bash[23441]: cluster 2024-04-19T22:52:41.588380+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-04-19T22:52:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:42 smithi178 bash[23441]: audit 2024-04-19T22:52:41.593134+0000 mon.c (mon.2) 460 : audit 1 from='client.? 172.21.15.113:0/1319797149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:42 smithi178 bash[23441]: audit 2024-04-19T22:52:41.599754+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: cluster 2024-04-19T22:52:41.878352+0000 mgr.y (mgr.24389) 308 : cluster 0 pgmap v374: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: cluster 2024-04-19T22:52:42.578334+0000 mon.a (mon.0) 1969 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: audit 2024-04-19T22:52:42.588407+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: cluster 2024-04-19T22:52:42.599279+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: audit 2024-04-19T22:52:42.603538+0000 mon.c (mon.2) 461 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: audit 2024-04-19T22:52:42.605164+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: audit 2024-04-19T22:52:42.658553+0000 mon.c (mon.2) 462 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[28910]: audit 2024-04-19T22:52:42.658928+0000 mon.a (mon.0) 1973 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: cluster 2024-04-19T22:52:41.878352+0000 mgr.y (mgr.24389) 308 : cluster 0 pgmap v374: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: cluster 2024-04-19T22:52:42.578334+0000 mon.a (mon.0) 1969 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: audit 2024-04-19T22:52:42.588407+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: cluster 2024-04-19T22:52:42.599279+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: audit 2024-04-19T22:52:42.603538+0000 mon.c (mon.2) 461 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: audit 2024-04-19T22:52:42.605164+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: audit 2024-04-19T22:52:42.658553+0000 mon.c (mon.2) 462 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:43 smithi113 bash[21528]: audit 2024-04-19T22:52:42.658928+0000 mon.a (mon.0) 1973 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: cluster 2024-04-19T22:52:41.878352+0000 mgr.y (mgr.24389) 308 : cluster 0 pgmap v374: 268 pgs: 72 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: cluster 2024-04-19T22:52:42.578334+0000 mon.a (mon.0) 1969 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: audit 2024-04-19T22:52:42.588407+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi113-63841-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: cluster 2024-04-19T22:52:42.599279+0000 mon.a (mon.0) 1971 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: audit 2024-04-19T22:52:42.603538+0000 mon.c (mon.2) 461 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: audit 2024-04-19T22:52:42.605164+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: audit 2024-04-19T22:52:42.658553+0000 mon.c (mon.2) 462 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:43 smithi178 bash[23441]: audit 2024-04-19T22:52:42.658928+0000 mon.a (mon.0) 1973 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.601294+0000 mon.a (mon.0) 1974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.601483+0000 mon.a (mon.0) 1975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: cluster 2024-04-19T22:52:43.608612+0000 mon.a (mon.0) 1976 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.609736+0000 mon.c (mon.2) 463 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.610215+0000 mon.c (mon.2) 464 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.613010+0000 mon.a (mon.0) 1977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:44.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: audit 2024-04-19T22:52:43.614928+0000 mon.a (mon.0) 1978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:44.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[23441]: cluster 2024-04-19T22:52:43.879083+0000 mgr.y (mgr.24389) 309 : cluster 0 pgmap v377: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.601294+0000 mon.a (mon.0) 1974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.601483+0000 mon.a (mon.0) 1975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: cluster 2024-04-19T22:52:43.608612+0000 mon.a (mon.0) 1976 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.609736+0000 mon.c (mon.2) 463 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.610215+0000 mon.c (mon.2) 464 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.613010+0000 mon.a (mon.0) 1977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: audit 2024-04-19T22:52:43.614928+0000 mon.a (mon.0) 1978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[21528]: cluster 2024-04-19T22:52:43.879083+0000 mgr.y (mgr.24389) 309 : cluster 0 pgmap v377: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.601294+0000 mon.a (mon.0) 1974 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.601483+0000 mon.a (mon.0) 1975 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: cluster 2024-04-19T22:52:43.608612+0000 mon.a (mon.0) 1976 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.609736+0000 mon.c (mon.2) 463 : audit 1 from='client.? 172.21.15.113:0/171979375' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.610215+0000 mon.c (mon.2) 464 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.613010+0000 mon.a (mon.0) 1977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]: dispatch 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: audit 2024-04-19T22:52:43.614928+0000 mon.a (mon.0) 1978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:44 smithi113 bash[28910]: cluster 2024-04-19T22:52:43.879083+0000 mgr.y (mgr.24389) 309 : cluster 0 pgmap v377: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:45.306 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:44 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.618230+0000 mon.a (mon.0) 1979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.618468+0000 mon.a (mon.0) 1980 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: cluster 2024-04-19T22:52:44.629533+0000 mon.a (mon.0) 1981 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-04-19T22:52:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.637004+0000 mon.c (mon.2) 465 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.642477+0000 mon.a (mon.0) 1982 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.643150+0000 mon.c (mon.2) 466 : audit 1 from='client.? 172.21.15.113:0/35871576' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.643831+0000 mon.a (mon.0) 1983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.666754+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.668220+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.668641+0000 mon.a (mon.0) 1986 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[21528]: audit 2024-04-19T22:52:44.968451+0000 mgr.y (mgr.24389) 310 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.618230+0000 mon.a (mon.0) 1979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.618468+0000 mon.a (mon.0) 1980 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: cluster 2024-04-19T22:52:44.629533+0000 mon.a (mon.0) 1981 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.637004+0000 mon.c (mon.2) 465 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.642477+0000 mon.a (mon.0) 1982 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.643150+0000 mon.c (mon.2) 466 : audit 1 from='client.? 172.21.15.113:0/35871576' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.643831+0000 mon.a (mon.0) 1983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.666754+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.668220+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.668641+0000 mon.a (mon.0) 1986 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:45 smithi113 bash[28910]: audit 2024-04-19T22:52:44.968451+0000 mgr.y (mgr.24389) 310 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.618230+0000 mon.a (mon.0) 1979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi113-63833-36"}]': finished 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.618468+0000 mon.a (mon.0) 1980 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: cluster 2024-04-19T22:52:44.629533+0000 mon.a (mon.0) 1981 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.637004+0000 mon.c (mon.2) 465 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.642477+0000 mon.a (mon.0) 1982 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.643150+0000 mon.c (mon.2) 466 : audit 1 from='client.? 172.21.15.113:0/35871576' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.643831+0000 mon.a (mon.0) 1983 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.666754+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.668220+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.668641+0000 mon.a (mon.0) 1986 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:45 smithi178 bash[23441]: audit 2024-04-19T22:52:44.968451+0000 mgr.y (mgr.24389) 310 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: cluster 2024-04-19T22:52:45.619561+0000 mon.a (mon.0) 1987 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: audit 2024-04-19T22:52:45.631640+0000 mon.a (mon.0) 1988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]': finished 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: audit 2024-04-19T22:52:45.631928+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: audit 2024-04-19T22:52:45.632188+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: cluster 2024-04-19T22:52:45.641193+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: audit 2024-04-19T22:52:45.645283+0000 mon.a (mon.0) 1992 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[28910]: cluster 2024-04-19T22:52:45.879959+0000 mgr.y (mgr.24389) 311 : cluster 0 pgmap v380: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: cluster 2024-04-19T22:52:45.619561+0000 mon.a (mon.0) 1987 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:47.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: audit 2024-04-19T22:52:45.631640+0000 mon.a (mon.0) 1988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]': finished 2024-04-19T22:52:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: audit 2024-04-19T22:52:45.631928+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: audit 2024-04-19T22:52:45.632188+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: cluster 2024-04-19T22:52:45.641193+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-04-19T22:52:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: audit 2024-04-19T22:52:45.645283+0000 mon.a (mon.0) 1992 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:46 smithi113 bash[21528]: cluster 2024-04-19T22:52:45.879959+0000 mgr.y (mgr.24389) 311 : cluster 0 pgmap v380: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: cluster 2024-04-19T22:52:45.619561+0000 mon.a (mon.0) 1987 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: audit 2024-04-19T22:52:45.631640+0000 mon.a (mon.0) 1988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-27", "mode": "writeback"}]': finished 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: audit 2024-04-19T22:52:45.631928+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi113-63841-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: audit 2024-04-19T22:52:45.632188+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: cluster 2024-04-19T22:52:45.641193+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: audit 2024-04-19T22:52:45.645283+0000 mon.a (mon.0) 1992 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:46 smithi178 bash[23441]: cluster 2024-04-19T22:52:45.879959+0000 mgr.y (mgr.24389) 311 : cluster 0 pgmap v380: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: cluster 2024-04-19T22:52:47.097430+0000 mon.a (mon.0) 1993 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.116108+0000 mon.c (mon.2) 467 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.116412+0000 mon.a (mon.0) 1994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.117204+0000 mon.c (mon.2) 468 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.117506+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.117984+0000 mon.c (mon.2) 469 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.118302+0000 mon.a (mon.0) 1996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:47.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.120163+0000 mon.c (mon.2) 470 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[28910]: audit 2024-04-19T22:52:47.120410+0000 mon.a (mon.0) 1997 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: cluster 2024-04-19T22:52:47.097430+0000 mon.a (mon.0) 1993 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.116108+0000 mon.c (mon.2) 467 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.116412+0000 mon.a (mon.0) 1994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.117204+0000 mon.c (mon.2) 468 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.117506+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.117984+0000 mon.c (mon.2) 469 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.118302+0000 mon.a (mon.0) 1996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.120163+0000 mon.c (mon.2) 470 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:47 smithi113 bash[21528]: audit 2024-04-19T22:52:47.120410+0000 mon.a (mon.0) 1997 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: cluster 2024-04-19T22:52:47.097430+0000 mon.a (mon.0) 1993 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.116108+0000 mon.c (mon.2) 467 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.116412+0000 mon.a (mon.0) 1994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.117204+0000 mon.c (mon.2) 468 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.117506+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.117984+0000 mon.c (mon.2) 469 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.118302+0000 mon.a (mon.0) 1996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.120163+0000 mon.c (mon.2) 470 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:47 smithi178 bash[23441]: audit 2024-04-19T22:52:47.120410+0000 mon.a (mon.0) 1997 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.646578+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.646800+0000 mon.a (mon.0) 1999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.646945+0000 mon.a (mon.0) 2000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.654164+0000 mon.c (mon.2) 471 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: cluster 2024-04-19T22:52:47.655866+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.656403+0000 mon.c (mon.2) 472 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.660846+0000 mon.a (mon.0) 2002 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:47.662805+0000 mon.a (mon.0) 2003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: cluster 2024-04-19T22:52:47.880907+0000 mgr.y (mgr.24389) 312 : cluster 0 pgmap v383: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:48.315923+0000 mon.a (mon.0) 2004 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[21528]: audit 2024-04-19T22:52:48.318296+0000 mon.a (mon.0) 2005 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.646578+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.646800+0000 mon.a (mon.0) 1999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.646945+0000 mon.a (mon.0) 2000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.654164+0000 mon.c (mon.2) 471 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: cluster 2024-04-19T22:52:47.655866+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.656403+0000 mon.c (mon.2) 472 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.660846+0000 mon.a (mon.0) 2002 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:47.662805+0000 mon.a (mon.0) 2003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: cluster 2024-04-19T22:52:47.880907+0000 mgr.y (mgr.24389) 312 : cluster 0 pgmap v383: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:49.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:48.315923+0000 mon.a (mon.0) 2004 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:49.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:48 smithi113 bash[28910]: audit 2024-04-19T22:52:48.318296+0000 mon.a (mon.0) 2005 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.646578+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi113-63833-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.646800+0000 mon.a (mon.0) 1999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.646945+0000 mon.a (mon.0) 2000 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.654164+0000 mon.c (mon.2) 471 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: cluster 2024-04-19T22:52:47.655866+0000 mon.a (mon.0) 2001 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.656403+0000 mon.c (mon.2) 472 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.660846+0000 mon.a (mon.0) 2002 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:47.662805+0000 mon.a (mon.0) 2003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]: dispatch 2024-04-19T22:52:49.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: cluster 2024-04-19T22:52:47.880907+0000 mgr.y (mgr.24389) 312 : cluster 0 pgmap v383: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:52:49.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:48.315923+0000 mon.a (mon.0) 2004 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:49.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:48 smithi178 bash[23441]: audit 2024-04-19T22:52:48.318296+0000 mon.a (mon.0) 2005 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:52:50.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[28910]: cluster 2024-04-19T22:52:48.647302+0000 mon.a (mon.0) 2006 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[28910]: cluster 2024-04-19T22:52:48.648685+0000 mon.a (mon.0) 2007 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[28910]: audit 2024-04-19T22:52:48.662221+0000 mon.a (mon.0) 2008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[28910]: cluster 2024-04-19T22:52:49.120036+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[28910]: audit 2024-04-19T22:52:49.122627+0000 mon.a (mon.0) 2010 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[21528]: cluster 2024-04-19T22:52:48.647302+0000 mon.a (mon.0) 2006 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[21528]: cluster 2024-04-19T22:52:48.648685+0000 mon.a (mon.0) 2007 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[21528]: audit 2024-04-19T22:52:48.662221+0000 mon.a (mon.0) 2008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[21528]: cluster 2024-04-19T22:52:49.120036+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-04-19T22:52:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:49 smithi113 bash[21528]: audit 2024-04-19T22:52:49.122627+0000 mon.a (mon.0) 2010 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:52:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:49 smithi178 bash[23441]: cluster 2024-04-19T22:52:48.647302+0000 mon.a (mon.0) 2006 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:49 smithi178 bash[23441]: cluster 2024-04-19T22:52:48.648685+0000 mon.a (mon.0) 2007 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:52:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:49 smithi178 bash[23441]: audit 2024-04-19T22:52:48.662221+0000 mon.a (mon.0) 2008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-27"}]': finished 2024-04-19T22:52:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:49 smithi178 bash[23441]: cluster 2024-04-19T22:52:49.120036+0000 mon.a (mon.0) 2009 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-04-19T22:52:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:49 smithi178 bash[23441]: audit 2024-04-19T22:52:49.122627+0000 mon.a (mon.0) 2010 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: audit 2024-04-19T22:52:49.664712+0000 mon.a (mon.0) 2011 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: cluster 2024-04-19T22:52:49.668034+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: cluster 2024-04-19T22:52:49.882845+0000 mgr.y (mgr.24389) 313 : cluster 0 pgmap v386: 204 pgs: 7 creating+peering, 1 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: audit 2024-04-19T22:52:50.108427+0000 mon.a (mon.0) 2013 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: audit 2024-04-19T22:52:50.109687+0000 mon.a (mon.0) 2014 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: audit 2024-04-19T22:52:50.110710+0000 mon.a (mon.0) 2015 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:52:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[21528]: audit 2024-04-19T22:52:50.123543+0000 mon.a (mon.0) 2016 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: audit 2024-04-19T22:52:49.664712+0000 mon.a (mon.0) 2011 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: cluster 2024-04-19T22:52:49.668034+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: cluster 2024-04-19T22:52:49.882845+0000 mgr.y (mgr.24389) 313 : cluster 0 pgmap v386: 204 pgs: 7 creating+peering, 1 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: audit 2024-04-19T22:52:50.108427+0000 mon.a (mon.0) 2013 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: audit 2024-04-19T22:52:50.109687+0000 mon.a (mon.0) 2014 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: audit 2024-04-19T22:52:50.110710+0000 mon.a (mon.0) 2015 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:52:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:50 smithi113 bash[28910]: audit 2024-04-19T22:52:50.123543+0000 mon.a (mon.0) 2016 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: audit 2024-04-19T22:52:49.664712+0000 mon.a (mon.0) 2011 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: cluster 2024-04-19T22:52:49.668034+0000 mon.a (mon.0) 2012 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: cluster 2024-04-19T22:52:49.882845+0000 mgr.y (mgr.24389) 313 : cluster 0 pgmap v386: 204 pgs: 7 creating+peering, 1 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: audit 2024-04-19T22:52:50.108427+0000 mon.a (mon.0) 2013 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: audit 2024-04-19T22:52:50.109687+0000 mon.a (mon.0) 2014 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: audit 2024-04-19T22:52:50.110710+0000 mon.a (mon.0) 2015 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:52:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:50 smithi178 bash[23441]: audit 2024-04-19T22:52:50.123543+0000 mon.a (mon.0) 2016 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[28910]: audit 2024-04-19T22:52:50.676055+0000 mon.a (mon.0) 2017 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[28910]: cluster 2024-04-19T22:52:50.686745+0000 mon.a (mon.0) 2018 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[28910]: audit 2024-04-19T22:52:50.689707+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[28910]: audit 2024-04-19T22:52:50.689918+0000 mon.c (mon.2) 473 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[28910]: audit 2024-04-19T22:52:50.691601+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[21528]: audit 2024-04-19T22:52:50.676055+0000 mon.a (mon.0) 2017 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[21528]: cluster 2024-04-19T22:52:50.686745+0000 mon.a (mon.0) 2018 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-04-19T22:52:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[21528]: audit 2024-04-19T22:52:50.689707+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:52.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[21528]: audit 2024-04-19T22:52:50.689918+0000 mon.c (mon.2) 473 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:52.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:51 smithi113 bash[21528]: audit 2024-04-19T22:52:50.691601+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:51 smithi178 bash[23441]: audit 2024-04-19T22:52:50.676055+0000 mon.a (mon.0) 2017 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:51 smithi178 bash[23441]: cluster 2024-04-19T22:52:50.686745+0000 mon.a (mon.0) 2018 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-04-19T22:52:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:51 smithi178 bash[23441]: audit 2024-04-19T22:52:50.689707+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]: dispatch 2024-04-19T22:52:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:51 smithi178 bash[23441]: audit 2024-04-19T22:52:50.689918+0000 mon.c (mon.2) 473 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:51 smithi178 bash[23441]: audit 2024-04-19T22:52:50.691601+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.680137+0000 mon.a (mon.0) 2021 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.680343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: cluster 2024-04-19T22:52:51.691737+0000 mon.a (mon.0) 2023 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.694542+0000 mon.c (mon.2) 474 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.697247+0000 mon.a (mon.0) 2024 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.742158+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.743395+0000 mon.a (mon.0) 2026 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:51.743953+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: cluster 2024-04-19T22:52:51.883794+0000 mgr.y (mgr.24389) 314 : cluster 0 pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:52.682930+0000 mon.a (mon.0) 2028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:52.683170+0000 mon.a (mon.0) 2029 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:52.689245+0000 mon.c (mon.2) 475 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: cluster 2024-04-19T22:52:52.690939+0000 mon.a (mon.0) 2030 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:52.693410+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[28910]: audit 2024-04-19T22:52:52.695393+0000 mon.a (mon.0) 2032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.680137+0000 mon.a (mon.0) 2021 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.680343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: cluster 2024-04-19T22:52:51.691737+0000 mon.a (mon.0) 2023 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-04-19T22:52:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.694542+0000 mon.c (mon.2) 474 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.697247+0000 mon.a (mon.0) 2024 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.742158+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.743395+0000 mon.a (mon.0) 2026 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:51.743953+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: cluster 2024-04-19T22:52:51.883794+0000 mgr.y (mgr.24389) 314 : cluster 0 pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:52.682930+0000 mon.a (mon.0) 2028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:52.683170+0000 mon.a (mon.0) 2029 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:52.689245+0000 mon.c (mon.2) 475 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: cluster 2024-04-19T22:52:52.690939+0000 mon.a (mon.0) 2030 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:52.693410+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:52 smithi113 bash[21528]: audit 2024-04-19T22:52:52.695393+0000 mon.a (mon.0) 2032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.680137+0000 mon.a (mon.0) 2021 : audit 1 from='client.? 172.21.15.113:0/770594481' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi113-63833-37"}]': finished 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.680343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: cluster 2024-04-19T22:52:51.691737+0000 mon.a (mon.0) 2023 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.694542+0000 mon.c (mon.2) 474 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.697247+0000 mon.a (mon.0) 2024 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.742158+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.743395+0000 mon.a (mon.0) 2026 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:51.743953+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: cluster 2024-04-19T22:52:51.883794+0000 mgr.y (mgr.24389) 314 : cluster 0 pgmap v389: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:52.682930+0000 mon.a (mon.0) 2028 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:52.683170+0000 mon.a (mon.0) 2029 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi113-63833-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:52.689245+0000 mon.c (mon.2) 475 : audit 1 from='client.? 172.21.15.113:0/3134508077' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: cluster 2024-04-19T22:52:52.690939+0000 mon.a (mon.0) 2030 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:52.693410+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:52 smithi178 bash[23441]: audit 2024-04-19T22:52:52.695393+0000 mon.a (mon.0) 2032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]: dispatch 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:53.686169+0000 mon.a (mon.0) 2033 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:53.724797+0000 mon.c (mon.2) 476 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: cluster 2024-04-19T22:52:53.884608+0000 mgr.y (mgr.24389) 315 : cluster 0 pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: cluster 2024-04-19T22:52:54.137264+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.138870+0000 mon.a (mon.0) 2035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.140384+0000 mon.c (mon.2) 477 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.142605+0000 mon.a (mon.0) 2036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:54.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.142619+0000 mon.c (mon.2) 478 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:54.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.143459+0000 mon.a (mon.0) 2037 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:54.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.143582+0000 mon.c (mon.2) 479 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:54.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[23441]: audit 2024-04-19T22:52:54.144123+0000 mon.a (mon.0) 2038 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:53.686169+0000 mon.a (mon.0) 2033 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:53.724797+0000 mon.c (mon.2) 476 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: cluster 2024-04-19T22:52:53.884608+0000 mgr.y (mgr.24389) 315 : cluster 0 pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: cluster 2024-04-19T22:52:54.137264+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.138870+0000 mon.a (mon.0) 2035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.140384+0000 mon.c (mon.2) 477 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.142605+0000 mon.a (mon.0) 2036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.142619+0000 mon.c (mon.2) 478 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.143459+0000 mon.a (mon.0) 2037 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.143582+0000 mon.c (mon.2) 479 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[28910]: audit 2024-04-19T22:52:54.144123+0000 mon.a (mon.0) 2038 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:53.686169+0000 mon.a (mon.0) 2033 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-46"}]': finished 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:53.724797+0000 mon.c (mon.2) 476 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: cluster 2024-04-19T22:52:53.884608+0000 mgr.y (mgr.24389) 315 : cluster 0 pgmap v392: 228 pgs: 32 unknown, 196 active+clean; 584 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: cluster 2024-04-19T22:52:54.137264+0000 mon.a (mon.0) 2034 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.138870+0000 mon.a (mon.0) 2035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.140384+0000 mon.c (mon.2) 477 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.142605+0000 mon.a (mon.0) 2036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.142619+0000 mon.c (mon.2) 478 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.143459+0000 mon.a (mon.0) 2037 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.143582+0000 mon.c (mon.2) 479 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:55.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:54 smithi113 bash[21528]: audit 2024-04-19T22:52:54.144123+0000 mon.a (mon.0) 2038 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:52:55.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:52:54 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.701892+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.702075+0000 mon.a (mon.0) 2040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.702242+0000 mon.a (mon.0) 2041 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: cluster 2024-04-19T22:52:54.710158+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.711028+0000 mon.c (mon.2) 480 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.715419+0000 mon.c (mon.2) 481 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.720063+0000 mon.a (mon.0) 2043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:54.725000+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: cluster 2024-04-19T22:52:55.529006+0000 mon.a (mon.0) 2045 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[21528]: audit 2024-04-19T22:52:55.533399+0000 mon.a (mon.0) 2046 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.701892+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.702075+0000 mon.a (mon.0) 2040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.702242+0000 mon.a (mon.0) 2041 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: cluster 2024-04-19T22:52:54.710158+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.711028+0000 mon.c (mon.2) 480 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.715419+0000 mon.c (mon.2) 481 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.720063+0000 mon.a (mon.0) 2043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:54.725000+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: cluster 2024-04-19T22:52:55.529006+0000 mon.a (mon.0) 2045 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:56.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:55 smithi113 bash[28910]: audit 2024-04-19T22:52:55.533399+0000 mon.a (mon.0) 2046 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.701892+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi113-63833-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.702075+0000 mon.a (mon.0) 2040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.702242+0000 mon.a (mon.0) 2041 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi113-63841-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: cluster 2024-04-19T22:52:54.710158+0000 mon.a (mon.0) 2042 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.711028+0000 mon.c (mon.2) 480 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.715419+0000 mon.c (mon.2) 481 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.720063+0000 mon.a (mon.0) 2043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:54.725000+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:52:56.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: cluster 2024-04-19T22:52:55.529006+0000 mon.a (mon.0) 2045 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:52:56.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:55 smithi178 bash[23441]: audit 2024-04-19T22:52:55.533399+0000 mon.a (mon.0) 2046 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:54.979994+0000 mgr.y (mgr.24389) 316 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:55.544316+0000 mon.c (mon.2) 482 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: cluster 2024-04-19T22:52:55.885821+0000 mgr.y (mgr.24389) 317 : cluster 0 pgmap v395: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: cluster 2024-04-19T22:52:55.992865+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:55.996152+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: cluster 2024-04-19T22:52:56.534192+0000 mon.a (mon.0) 2049 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:56.536828+0000 mon.a (mon.0) 2050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:56.537112+0000 mon.a (mon.0) 2051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]': finished 2024-04-19T22:52:57.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: cluster 2024-04-19T22:52:56.546601+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[28910]: audit 2024-04-19T22:52:56.551949+0000 mon.a (mon.0) 2053 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:54.979994+0000 mgr.y (mgr.24389) 316 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:55.544316+0000 mon.c (mon.2) 482 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: cluster 2024-04-19T22:52:55.885821+0000 mgr.y (mgr.24389) 317 : cluster 0 pgmap v395: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: cluster 2024-04-19T22:52:55.992865+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:55.996152+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: cluster 2024-04-19T22:52:56.534192+0000 mon.a (mon.0) 2049 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:56.536828+0000 mon.a (mon.0) 2050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:56.537112+0000 mon.a (mon.0) 2051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]': finished 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: cluster 2024-04-19T22:52:56.546601+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-04-19T22:52:57.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21528]: audit 2024-04-19T22:52:56.551949+0000 mon.a (mon.0) 2053 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:56 smithi178 bash[23441]: audit 2024-04-19T22:52:54.979994+0000 mgr.y (mgr.24389) 316 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:56 smithi178 bash[23441]: audit 2024-04-19T22:52:55.544316+0000 mon.c (mon.2) 482 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:56 smithi178 bash[23441]: cluster 2024-04-19T22:52:55.885821+0000 mgr.y (mgr.24389) 317 : cluster 0 pgmap v395: 236 pgs: 7 creating+peering, 1 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:56 smithi178 bash[23441]: cluster 2024-04-19T22:52:55.992865+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: audit 2024-04-19T22:52:55.996152+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]: dispatch 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: cluster 2024-04-19T22:52:56.534192+0000 mon.a (mon.0) 2049 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: audit 2024-04-19T22:52:56.536828+0000 mon.a (mon.0) 2050 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi113-63841-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: audit 2024-04-19T22:52:56.537112+0000 mon.a (mon.0) 2051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-29", "mode": "writeback"}]': finished 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: cluster 2024-04-19T22:52:56.546601+0000 mon.a (mon.0) 2052 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-04-19T22:52:57.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:57 smithi178 bash[23441]: audit 2024-04-19T22:52:56.551949+0000 mon.a (mon.0) 2053 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:52:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:52:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:52:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:58 smithi178 bash[23441]: audit 2024-04-19T22:52:57.539954+0000 mon.a (mon.0) 2054 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:58 smithi178 bash[23441]: cluster 2024-04-19T22:52:57.548656+0000 mon.a (mon.0) 2055 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-04-19T22:52:58.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:58 smithi178 bash[23441]: audit 2024-04-19T22:52:57.562138+0000 mon.a (mon.0) 2056 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:59.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[28910]: audit 2024-04-19T22:52:57.539954+0000 mon.a (mon.0) 2054 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[28910]: cluster 2024-04-19T22:52:57.548656+0000 mon.a (mon.0) 2055 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-04-19T22:52:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[28910]: audit 2024-04-19T22:52:57.562138+0000 mon.a (mon.0) 2056 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:52:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[21528]: audit 2024-04-19T22:52:57.539954+0000 mon.a (mon.0) 2054 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:52:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[21528]: cluster 2024-04-19T22:52:57.548656+0000 mon.a (mon.0) 2055 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-04-19T22:52:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:58 smithi113 bash[21528]: audit 2024-04-19T22:52:57.562138+0000 mon.a (mon.0) 2056 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]: dispatch 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: cluster 2024-04-19T22:52:57.886762+0000 mgr.y (mgr.24389) 318 : cluster 0 pgmap v398: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.550014+0000 mon.a (mon.0) 2057 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: cluster 2024-04-19T22:52:58.560627+0000 mon.a (mon.0) 2058 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.563292+0000 mon.c (mon.2) 483 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.564919+0000 mon.a (mon.0) 2059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.591606+0000 mon.a (mon.0) 2060 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.592618+0000 mon.a (mon.0) 2061 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[21528]: audit 2024-04-19T22:52:58.593067+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: cluster 2024-04-19T22:52:57.886762+0000 mgr.y (mgr.24389) 318 : cluster 0 pgmap v398: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.550014+0000 mon.a (mon.0) 2057 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: cluster 2024-04-19T22:52:58.560627+0000 mon.a (mon.0) 2058 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.563292+0000 mon.c (mon.2) 483 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.564919+0000 mon.a (mon.0) 2059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.591606+0000 mon.a (mon.0) 2060 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.592618+0000 mon.a (mon.0) 2061 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:52:59 smithi113 bash[28910]: audit 2024-04-19T22:52:58.593067+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: cluster 2024-04-19T22:52:57.886762+0000 mgr.y (mgr.24389) 318 : cluster 0 pgmap v398: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.550014+0000 mon.a (mon.0) 2057 : audit 1 from='client.? 172.21.15.113:0/4062608546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi113-63833-38"}]': finished 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: cluster 2024-04-19T22:52:58.560627+0000 mon.a (mon.0) 2058 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.563292+0000 mon.c (mon.2) 483 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.564919+0000 mon.a (mon.0) 2059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.591606+0000 mon.a (mon.0) 2060 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.592618+0000 mon.a (mon.0) 2061 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:52:59 smithi178 bash[23441]: audit 2024-04-19T22:52:58.593067+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.552770+0000 mon.a (mon.0) 2063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.553017+0000 mon.a (mon.0) 2064 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: cluster 2024-04-19T22:52:59.570047+0000 mon.a (mon.0) 2065 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.571775+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.571782+0000 mon.c (mon.2) 484 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.572862+0000 mon.a (mon.0) 2067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.662607+0000 mon.c (mon.2) 485 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:52:59.663306+0000 mon.a (mon.0) 2068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: cluster 2024-04-19T22:53:00.532767+0000 mon.a (mon.0) 2069 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:01.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[21528]: audit 2024-04-19T22:53:00.556054+0000 mon.a (mon.0) 2070 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.552770+0000 mon.a (mon.0) 2063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.553017+0000 mon.a (mon.0) 2064 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: cluster 2024-04-19T22:52:59.570047+0000 mon.a (mon.0) 2065 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.571775+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.571782+0000 mon.c (mon.2) 484 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.572862+0000 mon.a (mon.0) 2067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.662607+0000 mon.c (mon.2) 485 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:52:59.663306+0000 mon.a (mon.0) 2068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: cluster 2024-04-19T22:53:00.532767+0000 mon.a (mon.0) 2069 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:01.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:01 smithi113 bash[28910]: audit 2024-04-19T22:53:00.556054+0000 mon.a (mon.0) 2070 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.552770+0000 mon.a (mon.0) 2063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.553017+0000 mon.a (mon.0) 2064 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi113-63833-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: cluster 2024-04-19T22:52:59.570047+0000 mon.a (mon.0) 2065 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.571775+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.571782+0000 mon.c (mon.2) 484 : audit 1 from='client.? 172.21.15.113:0/4234105270' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.572862+0000 mon.a (mon.0) 2067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]: dispatch 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.662607+0000 mon.c (mon.2) 485 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:52:59.663306+0000 mon.a (mon.0) 2068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: cluster 2024-04-19T22:53:00.532767+0000 mon.a (mon.0) 2069 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:01.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:01 smithi178 bash[23441]: audit 2024-04-19T22:53:00.556054+0000 mon.a (mon.0) 2070 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi113-63841-47"}]': finished 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: cluster 2024-04-19T22:52:59.888864+0000 mgr.y (mgr.24389) 319 : cluster 0 pgmap v401: 228 pgs: 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:00.556252+0000 mon.a (mon.0) 2071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:00.565925+0000 mon.c (mon.2) 486 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:00.596613+0000 mon.c (mon.2) 487 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: cluster 2024-04-19T22:53:01.012681+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.014692+0000 mon.a (mon.0) 2073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.015258+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.018797+0000 mon.c (mon.2) 488 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.019682+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.020522+0000 mon.c (mon.2) 489 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.027936+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: cluster 2024-04-19T22:53:01.556835+0000 mon.a (mon.0) 2077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.559393+0000 mon.a (mon.0) 2078 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.559655+0000 mon.a (mon.0) 2079 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: cluster 2024-04-19T22:52:59.888864+0000 mgr.y (mgr.24389) 319 : cluster 0 pgmap v401: 228 pgs: 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:00.556252+0000 mon.a (mon.0) 2071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:02.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:00.565925+0000 mon.c (mon.2) 486 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:00.596613+0000 mon.c (mon.2) 487 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: cluster 2024-04-19T22:53:01.012681+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.014692+0000 mon.a (mon.0) 2073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.015258+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.018797+0000 mon.c (mon.2) 488 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.019682+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.020522+0000 mon.c (mon.2) 489 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.027936+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: cluster 2024-04-19T22:53:01.556835+0000 mon.a (mon.0) 2077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.559393+0000 mon.a (mon.0) 2078 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:02.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.559655+0000 mon.a (mon.0) 2079 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.559927+0000 mon.a (mon.0) 2080 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: cluster 2024-04-19T22:53:01.569940+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.577592+0000 mon.c (mon.2) 490 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[28910]: audit 2024-04-19T22:53:01.578387+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.559927+0000 mon.a (mon.0) 2080 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: cluster 2024-04-19T22:53:01.569940+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.577592+0000 mon.c (mon.2) 490 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:02 smithi113 bash[21528]: audit 2024-04-19T22:53:01.578387+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: cluster 2024-04-19T22:52:59.888864+0000 mgr.y (mgr.24389) 319 : cluster 0 pgmap v401: 228 pgs: 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:00.556252+0000 mon.a (mon.0) 2071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:02.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:00.565925+0000 mon.c (mon.2) 486 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:00.596613+0000 mon.c (mon.2) 487 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: cluster 2024-04-19T22:53:01.012681+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.014692+0000 mon.a (mon.0) 2073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.015258+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.018797+0000 mon.c (mon.2) 488 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.019682+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.020522+0000 mon.c (mon.2) 489 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.027936+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: cluster 2024-04-19T22:53:01.556835+0000 mon.a (mon.0) 2077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.559393+0000 mon.a (mon.0) 2078 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi113-63833-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:02.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.559655+0000 mon.a (mon.0) 2079 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-29"}]': finished 2024-04-19T22:53:02.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.559927+0000 mon.a (mon.0) 2080 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi113-63841-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:02.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: cluster 2024-04-19T22:53:01.569940+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-04-19T22:53:02.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.577592+0000 mon.c (mon.2) 490 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:02.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:02 smithi178 bash[23441]: audit 2024-04-19T22:53:01.578387+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[21528]: cluster 2024-04-19T22:53:01.889906+0000 mgr.y (mgr.24389) 320 : cluster 0 pgmap v404: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[21528]: cluster 2024-04-19T22:53:03.023761+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[21528]: audit 2024-04-19T22:53:03.478699+0000 mon.a (mon.0) 2084 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[21528]: audit 2024-04-19T22:53:03.480916+0000 mon.a (mon.0) 2085 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[28910]: cluster 2024-04-19T22:53:01.889906+0000 mgr.y (mgr.24389) 320 : cluster 0 pgmap v404: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[28910]: cluster 2024-04-19T22:53:03.023761+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-04-19T22:53:04.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[28910]: audit 2024-04-19T22:53:03.478699+0000 mon.a (mon.0) 2084 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:03 smithi113 bash[28910]: audit 2024-04-19T22:53:03.480916+0000 mon.a (mon.0) 2085 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:03 smithi178 bash[23441]: cluster 2024-04-19T22:53:01.889906+0000 mgr.y (mgr.24389) 320 : cluster 0 pgmap v404: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1023 KiB/s wr, 27 op/s 2024-04-19T22:53:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:03 smithi178 bash[23441]: cluster 2024-04-19T22:53:03.023761+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-04-19T22:53:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:03 smithi178 bash[23441]: audit 2024-04-19T22:53:03.478699+0000 mon.a (mon.0) 2084 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:03 smithi178 bash[23441]: audit 2024-04-19T22:53:03.480916+0000 mon.a (mon.0) 2085 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:03.573266+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: cluster 2024-04-19T22:53:03.581282+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:03.585998+0000 mon.a (mon.0) 2088 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:03.587658+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:03.611299+0000 mon.a (mon.0) 2089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: cluster 2024-04-19T22:53:03.890792+0000 mgr.y (mgr.24389) 321 : cluster 0 pgmap v407: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:04.576284+0000 mon.a (mon.0) 2090 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:04.576487+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: cluster 2024-04-19T22:53:04.587507+0000 mon.a (mon.0) 2092 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-04-19T22:53:04.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[23441]: audit 2024-04-19T22:53:04.596838+0000 mon.a (mon.0) 2093 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:03.573266+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: cluster 2024-04-19T22:53:03.581282+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:03.585998+0000 mon.a (mon.0) 2088 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:03.587658+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:03.611299+0000 mon.a (mon.0) 2089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: cluster 2024-04-19T22:53:03.890792+0000 mgr.y (mgr.24389) 321 : cluster 0 pgmap v407: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:04.576284+0000 mon.a (mon.0) 2090 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:04.576487+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: cluster 2024-04-19T22:53:04.587507+0000 mon.a (mon.0) 2092 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[21528]: audit 2024-04-19T22:53:04.596838+0000 mon.a (mon.0) 2093 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:03.573266+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi113-63841-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: cluster 2024-04-19T22:53:03.581282+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:03.585998+0000 mon.a (mon.0) 2088 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:03.587658+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:03.611299+0000 mon.a (mon.0) 2089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: cluster 2024-04-19T22:53:03.890792+0000 mgr.y (mgr.24389) 321 : cluster 0 pgmap v407: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:04.576284+0000 mon.a (mon.0) 2090 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:04.576487+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: cluster 2024-04-19T22:53:04.587507+0000 mon.a (mon.0) 2092 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-04-19T22:53:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:04 smithi113 bash[28910]: audit 2024-04-19T22:53:04.596838+0000 mon.a (mon.0) 2093 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]: dispatch 2024-04-19T22:53:05.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:04 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:06.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:04.597321+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:04.600240+0000 mon.a (mon.0) 2094 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:04.981916+0000 mgr.y (mgr.24389) 322 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:06.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: cluster 2024-04-19T22:53:05.534313+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.541686+0000 mon.a (mon.0) 2096 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.541864+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: cluster 2024-04-19T22:53:05.549647+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.554001+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.555755+0000 mon.a (mon.0) 2099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.556318+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.558585+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.593097+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.593487+0000 mon.a (mon.0) 2101 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.594284+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.594639+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:04.597321+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:04.600240+0000 mon.a (mon.0) 2094 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:04.981916+0000 mgr.y (mgr.24389) 322 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: cluster 2024-04-19T22:53:05.534313+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.541686+0000 mon.a (mon.0) 2096 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.541864+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: cluster 2024-04-19T22:53:05.549647+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.554001+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.555755+0000 mon.a (mon.0) 2099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.556318+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.558585+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.593097+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.593487+0000 mon.a (mon.0) 2101 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.594284+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.594639+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.595194+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[21528]: audit 2024-04-19T22:53:05.595552+0000 mon.a (mon.0) 2103 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.595194+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:05 smithi113 bash[28910]: audit 2024-04-19T22:53:05.595552+0000 mon.a (mon.0) 2103 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:06.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:04.597321+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:04.600240+0000 mon.a (mon.0) 2094 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:04.981916+0000 mgr.y (mgr.24389) 322 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: cluster 2024-04-19T22:53:05.534313+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.541686+0000 mon.a (mon.0) 2096 : audit 1 from='client.? 172.21.15.113:0/2358708484' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi113-63833-39"}]': finished 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.541864+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: cluster 2024-04-19T22:53:05.549647+0000 mon.a (mon.0) 2098 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.554001+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.555755+0000 mon.a (mon.0) 2099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.556318+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.558585+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.593097+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.593487+0000 mon.a (mon.0) 2101 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.594284+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.594639+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:06.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.595194+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:06.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:05 smithi178 bash[23441]: audit 2024-04-19T22:53:05.595552+0000 mon.a (mon.0) 2103 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:07.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: cluster 2024-04-19T22:53:05.891565+0000 mgr.y (mgr.24389) 323 : cluster 0 pgmap v410: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.544367+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.544594+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.544721+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: cluster 2024-04-19T22:53:06.551620+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.553577+0000 mon.c (mon.2) 498 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.553943+0000 mon.c (mon.2) 499 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.554449+0000 mon.a (mon.0) 2108 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.554581+0000 mon.c (mon.2) 500 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.554858+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[21528]: audit 2024-04-19T22:53:06.555462+0000 mon.a (mon.0) 2110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: cluster 2024-04-19T22:53:05.891565+0000 mgr.y (mgr.24389) 323 : cluster 0 pgmap v410: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.544367+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.544594+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.544721+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: cluster 2024-04-19T22:53:06.551620+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.553577+0000 mon.c (mon.2) 498 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.553943+0000 mon.c (mon.2) 499 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.554449+0000 mon.a (mon.0) 2108 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.554581+0000 mon.c (mon.2) 500 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.554858+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:08 smithi113 bash[28910]: audit 2024-04-19T22:53:06.555462+0000 mon.a (mon.0) 2110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: cluster 2024-04-19T22:53:05.891565+0000 mgr.y (mgr.24389) 323 : cluster 0 pgmap v410: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.544367+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.544594+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.544721+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi113-63833-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: cluster 2024-04-19T22:53:06.551620+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.553577+0000 mon.c (mon.2) 498 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.553943+0000 mon.c (mon.2) 499 : audit 1 from='client.? 172.21.15.113:0/2873608537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.554449+0000 mon.a (mon.0) 2108 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]: dispatch 2024-04-19T22:53:08.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.554581+0000 mon.c (mon.2) 500 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:08.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.554858+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]: dispatch 2024-04-19T22:53:08.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:08 smithi178 bash[23441]: audit 2024-04-19T22:53:06.555462+0000 mon.a (mon.0) 2110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: cluster 2024-04-19T22:53:07.545247+0000 mon.a (mon.0) 2111 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:07.549396+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]': finished 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:07.549572+0000 mon.a (mon.0) 2113 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:07.597697+0000 mon.c (mon.2) 501 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:07.749150+0000 mon.c (mon.2) 502 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: cluster 2024-04-19T22:53:07.892450+0000 mgr.y (mgr.24389) 324 : cluster 0 pgmap v413: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: cluster 2024-04-19T22:53:08.008811+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.010070+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.011035+0000 mon.c (mon.2) 503 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.019458+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.020778+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.021930+0000 mon.c (mon.2) 504 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.022545+0000 mon.a (mon.0) 2118 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.552681+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:09.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.552856+0000 mon.a (mon.0) 2120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: cluster 2024-04-19T22:53:07.545247+0000 mon.a (mon.0) 2111 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:07.549396+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]': finished 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:07.549572+0000 mon.a (mon.0) 2113 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:07.597697+0000 mon.c (mon.2) 501 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:07.749150+0000 mon.c (mon.2) 502 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: cluster 2024-04-19T22:53:07.892450+0000 mgr.y (mgr.24389) 324 : cluster 0 pgmap v413: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: cluster 2024-04-19T22:53:08.008811+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.010070+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.011035+0000 mon.c (mon.2) 503 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.019458+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.020778+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.021930+0000 mon.c (mon.2) 504 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.022545+0000 mon.a (mon.0) 2118 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.552681+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.552856+0000 mon.a (mon.0) 2120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.553052+0000 mon.a (mon.0) 2121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: cluster 2024-04-19T22:53:08.560006+0000 mon.a (mon.0) 2122 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.566993+0000 mon.c (mon.2) 505 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.567388+0000 mon.c (mon.2) 506 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.578166+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[21528]: audit 2024-04-19T22:53:08.580895+0000 mon.a (mon.0) 2124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.553052+0000 mon.a (mon.0) 2121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:09.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: cluster 2024-04-19T22:53:08.560006+0000 mon.a (mon.0) 2122 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-04-19T22:53:09.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.566993+0000 mon.c (mon.2) 505 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.567388+0000 mon.c (mon.2) 506 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:09.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.578166+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:09 smithi113 bash[28910]: audit 2024-04-19T22:53:08.580895+0000 mon.a (mon.0) 2124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:09.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: cluster 2024-04-19T22:53:07.545247+0000 mon.a (mon.0) 2111 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:09.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:07.549396+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-31", "mode": "writeback"}]': finished 2024-04-19T22:53:09.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:07.549572+0000 mon.a (mon.0) 2113 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi113-63841-48"}]': finished 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:07.597697+0000 mon.c (mon.2) 501 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:07.749150+0000 mon.c (mon.2) 502 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: cluster 2024-04-19T22:53:07.892450+0000 mgr.y (mgr.24389) 324 : cluster 0 pgmap v413: 228 pgs: 10 creating+activating, 218 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: cluster 2024-04-19T22:53:08.008811+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.010070+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.011035+0000 mon.c (mon.2) 503 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.019458+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.020778+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.021930+0000 mon.c (mon.2) 504 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.022545+0000 mon.a (mon.0) 2118 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.552681+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi113-63833-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.552856+0000 mon.a (mon.0) 2120 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:09.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.553052+0000 mon.a (mon.0) 2121 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi113-63841-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:09.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: cluster 2024-04-19T22:53:08.560006+0000 mon.a (mon.0) 2122 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-04-19T22:53:09.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.566993+0000 mon.c (mon.2) 505 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.567388+0000 mon.c (mon.2) 506 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:09.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.578166+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:09.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:09 smithi178 bash[23441]: audit 2024-04-19T22:53:08.580895+0000 mon.a (mon.0) 2124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]: dispatch 2024-04-19T22:53:10.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:10 smithi113 bash[21528]: cluster 2024-04-19T22:53:09.553986+0000 mon.a (mon.0) 2125 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:10.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:10 smithi113 bash[21528]: audit 2024-04-19T22:53:09.556407+0000 mon.a (mon.0) 2126 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:10.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:10 smithi113 bash[28910]: cluster 2024-04-19T22:53:09.553986+0000 mon.a (mon.0) 2125 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:10.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:10 smithi113 bash[28910]: audit 2024-04-19T22:53:09.556407+0000 mon.a (mon.0) 2126 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:10.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:10 smithi178 bash[23441]: cluster 2024-04-19T22:53:09.553986+0000 mon.a (mon.0) 2125 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:10.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:10 smithi178 bash[23441]: audit 2024-04-19T22:53:09.556407+0000 mon.a (mon.0) 2126 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-31"}]': finished 2024-04-19T22:53:11.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[28910]: cluster 2024-04-19T22:53:10.017339+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[28910]: cluster 2024-04-19T22:53:10.540785+0000 mon.a (mon.0) 2128 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[28910]: audit 2024-04-19T22:53:10.566542+0000 mon.a (mon.0) 2129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[28910]: cluster 2024-04-19T22:53:10.573027+0000 mon.a (mon.0) 2130 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[28910]: audit 2024-04-19T22:53:10.582593+0000 mon.c (mon.2) 507 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[21528]: cluster 2024-04-19T22:53:10.017339+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[21528]: cluster 2024-04-19T22:53:10.540785+0000 mon.a (mon.0) 2128 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[21528]: audit 2024-04-19T22:53:10.566542+0000 mon.a (mon.0) 2129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[21528]: cluster 2024-04-19T22:53:10.573027+0000 mon.a (mon.0) 2130 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-04-19T22:53:11.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:11 smithi113 bash[21528]: audit 2024-04-19T22:53:10.582593+0000 mon.c (mon.2) 507 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:11.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:11 smithi178 bash[23441]: cluster 2024-04-19T22:53:10.017339+0000 mon.a (mon.0) 2127 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-04-19T22:53:11.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:11 smithi178 bash[23441]: cluster 2024-04-19T22:53:10.540785+0000 mon.a (mon.0) 2128 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:11.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:11 smithi178 bash[23441]: audit 2024-04-19T22:53:10.566542+0000 mon.a (mon.0) 2129 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi113-63841-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:11.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:11 smithi178 bash[23441]: cluster 2024-04-19T22:53:10.573027+0000 mon.a (mon.0) 2130 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-04-19T22:53:11.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:11 smithi178 bash[23441]: audit 2024-04-19T22:53:10.582593+0000 mon.c (mon.2) 507 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: cluster 2024-04-19T22:53:09.894606+0000 mgr.y (mgr.24389) 325 : cluster 0 pgmap v416: 236 pgs: 1 creating+activating, 235 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.029345+0000 mon.a (mon.0) 2131 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.569920+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: cluster 2024-04-19T22:53:11.578929+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.580365+0000 mon.c (mon.2) 508 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.581163+0000 mon.c (mon.2) 509 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.604821+0000 mon.a (mon.0) 2134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[28910]: audit 2024-04-19T22:53:11.605815+0000 mon.a (mon.0) 2135 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:12.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: cluster 2024-04-19T22:53:09.894606+0000 mgr.y (mgr.24389) 325 : cluster 0 pgmap v416: 236 pgs: 1 creating+activating, 235 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.029345+0000 mon.a (mon.0) 2131 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.569920+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: cluster 2024-04-19T22:53:11.578929+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.580365+0000 mon.c (mon.2) 508 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.581163+0000 mon.c (mon.2) 509 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.604821+0000 mon.a (mon.0) 2134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:12 smithi113 bash[21528]: audit 2024-04-19T22:53:11.605815+0000 mon.a (mon.0) 2135 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: cluster 2024-04-19T22:53:09.894606+0000 mgr.y (mgr.24389) 325 : cluster 0 pgmap v416: 236 pgs: 1 creating+activating, 235 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.029345+0000 mon.a (mon.0) 2131 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.569920+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: cluster 2024-04-19T22:53:11.578929+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.580365+0000 mon.c (mon.2) 508 : audit 1 from='client.? 172.21.15.113:0/276955977' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.581163+0000 mon.c (mon.2) 509 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.604821+0000 mon.a (mon.0) 2134 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]: dispatch 2024-04-19T22:53:12.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:12 smithi178 bash[23441]: audit 2024-04-19T22:53:11.605815+0000 mon.a (mon.0) 2135 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: cluster 2024-04-19T22:53:11.895505+0000 mgr.y (mgr.24389) 326 : cluster 0 pgmap v419: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.580675+0000 mon.a (mon.0) 2136 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.580917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: cluster 2024-04-19T22:53:12.589258+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.592013+0000 mon.c (mon.2) 510 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.592890+0000 mon.c (mon.2) 511 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.603072+0000 mon.a (mon.0) 2139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.603687+0000 mon.a (mon.0) 2140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.635053+0000 mon.c (mon.2) 512 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.636004+0000 mon.a (mon.0) 2141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.637258+0000 mon.c (mon.2) 513 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.637629+0000 mon.a (mon.0) 2142 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.638266+0000 mon.c (mon.2) 514 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[28910]: audit 2024-04-19T22:53:12.638564+0000 mon.a (mon.0) 2143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: cluster 2024-04-19T22:53:11.895505+0000 mgr.y (mgr.24389) 326 : cluster 0 pgmap v419: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.580675+0000 mon.a (mon.0) 2136 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.580917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: cluster 2024-04-19T22:53:12.589258+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.592013+0000 mon.c (mon.2) 510 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.592890+0000 mon.c (mon.2) 511 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.603072+0000 mon.a (mon.0) 2139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.603687+0000 mon.a (mon.0) 2140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.635053+0000 mon.c (mon.2) 512 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.636004+0000 mon.a (mon.0) 2141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.637258+0000 mon.c (mon.2) 513 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.637629+0000 mon.a (mon.0) 2142 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.638266+0000 mon.c (mon.2) 514 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:14.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:13 smithi113 bash[21528]: audit 2024-04-19T22:53:12.638564+0000 mon.a (mon.0) 2143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: cluster 2024-04-19T22:53:11.895505+0000 mgr.y (mgr.24389) 326 : cluster 0 pgmap v419: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.580675+0000 mon.a (mon.0) 2136 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi113-63833-40"}]': finished 2024-04-19T22:53:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.580917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: cluster 2024-04-19T22:53:12.589258+0000 mon.a (mon.0) 2138 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-04-19T22:53:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.592013+0000 mon.c (mon.2) 510 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.592890+0000 mon.c (mon.2) 511 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.603072+0000 mon.a (mon.0) 2139 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.603687+0000 mon.a (mon.0) 2140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.635053+0000 mon.c (mon.2) 512 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.636004+0000 mon.a (mon.0) 2141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.637258+0000 mon.c (mon.2) 513 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.637629+0000 mon.a (mon.0) 2142 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.638266+0000 mon.c (mon.2) 514 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:14.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:13 smithi178 bash[23441]: audit 2024-04-19T22:53:12.638564+0000 mon.a (mon.0) 2143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.583429+0000 mon.a (mon.0) 2144 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.583658+0000 mon.a (mon.0) 2145 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.583888+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: cluster 2024-04-19T22:53:13.591233+0000 mon.a (mon.0) 2147 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.592834+0000 mon.c (mon.2) 515 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.593993+0000 mon.c (mon.2) 516 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.594820+0000 mon.c (mon.2) 517 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.595984+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.596970+0000 mon.a (mon.0) 2149 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:13.597473+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[28910]: audit 2024-04-19T22:53:14.586791+0000 mon.a (mon.0) 2151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.583429+0000 mon.a (mon.0) 2144 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.583658+0000 mon.a (mon.0) 2145 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.583888+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: cluster 2024-04-19T22:53:13.591233+0000 mon.a (mon.0) 2147 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.592834+0000 mon.c (mon.2) 515 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.593993+0000 mon.c (mon.2) 516 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.594820+0000 mon.c (mon.2) 517 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.595984+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.596970+0000 mon.a (mon.0) 2149 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:13.597473+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:15 smithi113 bash[21528]: audit 2024-04-19T22:53:14.586791+0000 mon.a (mon.0) 2151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:15.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:14 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.583429+0000 mon.a (mon.0) 2144 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.583658+0000 mon.a (mon.0) 2145 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.583888+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi113-63833-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: cluster 2024-04-19T22:53:13.591233+0000 mon.a (mon.0) 2147 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.592834+0000 mon.c (mon.2) 515 : audit 1 from='client.? 172.21.15.113:0/1253329725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.593993+0000 mon.c (mon.2) 516 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.594820+0000 mon.c (mon.2) 517 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.595984+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]: dispatch 2024-04-19T22:53:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.596970+0000 mon.a (mon.0) 2149 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:13.597473+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:15 smithi178 bash[23441]: audit 2024-04-19T22:53:14.586791+0000 mon.a (mon.0) 2151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi113-63841-49"}]': finished 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: cluster 2024-04-19T22:53:13.896322+0000 mgr.y (mgr.24389) 327 : cluster 0 pgmap v422: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:14.586969+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:14.598700+0000 mon.c (mon.2) 518 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:14.622796+0000 mon.c (mon.2) 519 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:14.989096+0000 mgr.y (mgr.24389) 328 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:16.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: cluster 2024-04-19T22:53:15.032250+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.034049+0000 mon.a (mon.0) 2154 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.034325+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.036407+0000 mon.c (mon.2) 520 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.043330+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.050919+0000 mon.c (mon.2) 521 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.051328+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: cluster 2024-04-19T22:53:15.587466+0000 mon.a (mon.0) 2158 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.590030+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.590301+0000 mon.a (mon.0) 2160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]': finished 2024-04-19T22:53:16.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: cluster 2024-04-19T22:53:13.896322+0000 mgr.y (mgr.24389) 327 : cluster 0 pgmap v422: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:14.586969+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:14.598700+0000 mon.c (mon.2) 518 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:14.622796+0000 mon.c (mon.2) 519 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:14.989096+0000 mgr.y (mgr.24389) 328 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: cluster 2024-04-19T22:53:15.032250+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.034049+0000 mon.a (mon.0) 2154 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.034325+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.036407+0000 mon.c (mon.2) 520 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.043330+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.050919+0000 mon.c (mon.2) 521 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.051328+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: cluster 2024-04-19T22:53:15.587466+0000 mon.a (mon.0) 2158 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:16.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.590030+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.590301+0000 mon.a (mon.0) 2160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]': finished 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.590545+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: cluster 2024-04-19T22:53:15.600167+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.602831+0000 mon.c (mon.2) 522 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.604490+0000 mon.a (mon.0) 2163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.835560+0000 mon.c (mon.2) 523 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[21528]: audit 2024-04-19T22:53:15.836349+0000 mon.a (mon.0) 2164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.590545+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: cluster 2024-04-19T22:53:15.600167+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.602831+0000 mon.c (mon.2) 522 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.604490+0000 mon.a (mon.0) 2163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.835560+0000 mon.c (mon.2) 523 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:16 smithi113 bash[28910]: audit 2024-04-19T22:53:15.836349+0000 mon.a (mon.0) 2164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:16.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: cluster 2024-04-19T22:53:13.896322+0000 mgr.y (mgr.24389) 327 : cluster 0 pgmap v422: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:14.586969+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:14.598700+0000 mon.c (mon.2) 518 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:14.622796+0000 mon.c (mon.2) 519 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:14.989096+0000 mgr.y (mgr.24389) 328 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: cluster 2024-04-19T22:53:15.032250+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.034049+0000 mon.a (mon.0) 2154 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]: dispatch 2024-04-19T22:53:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.034325+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.036407+0000 mon.c (mon.2) 520 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.043330+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.050919+0000 mon.c (mon.2) 521 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.051328+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: cluster 2024-04-19T22:53:15.587466+0000 mon.a (mon.0) 2158 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.590030+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi113-63833-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.590301+0000 mon.a (mon.0) 2160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-33", "mode": "writeback"}]': finished 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.590545+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi113-63841-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: cluster 2024-04-19T22:53:15.600167+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.602831+0000 mon.c (mon.2) 522 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.604490+0000 mon.a (mon.0) 2163 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.835560+0000 mon.c (mon.2) 523 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:16 smithi178 bash[23441]: audit 2024-04-19T22:53:15.836349+0000 mon.a (mon.0) 2164 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:17.477 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:17 smithi113 bash[28910]: cluster 2024-04-19T22:53:16.591917+0000 mon.a (mon.0) 2165 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:17 smithi113 bash[28910]: audit 2024-04-19T22:53:16.593560+0000 mon.a (mon.0) 2166 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:17.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:17 smithi113 bash[21528]: cluster 2024-04-19T22:53:16.591917+0000 mon.a (mon.0) 2165 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:17.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:17 smithi113 bash[21528]: audit 2024-04-19T22:53:16.593560+0000 mon.a (mon.0) 2166 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:17 smithi178 bash[23441]: cluster 2024-04-19T22:53:16.591917+0000 mon.a (mon.0) 2165 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:17 smithi178 bash[23441]: audit 2024-04-19T22:53:16.593560+0000 mon.a (mon.0) 2166 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:17.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: cluster 2024-04-19T22:53:15.897194+0000 mgr.y (mgr.24389) 329 : cluster 0 pgmap v425: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:16.607725+0000 mon.c (mon.2) 524 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: cluster 2024-04-19T22:53:17.045569+0000 mon.a (mon.0) 2167 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:17.047441+0000 mon.a (mon.0) 2168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: cluster 2024-04-19T22:53:17.594260+0000 mon.a (mon.0) 2169 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:17.596815+0000 mon.a (mon.0) 2170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:17.597045+0000 mon.a (mon.0) 2171 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: cluster 2024-04-19T22:53:17.607152+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-04-19T22:53:18.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:17.610259+0000 mon.c (mon.2) 525 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[21528]: audit 2024-04-19T22:53:17.613564+0000 mon.a (mon.0) 2173 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: cluster 2024-04-19T22:53:15.897194+0000 mgr.y (mgr.24389) 329 : cluster 0 pgmap v425: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:16.607725+0000 mon.c (mon.2) 524 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: cluster 2024-04-19T22:53:17.045569+0000 mon.a (mon.0) 2167 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:17.047441+0000 mon.a (mon.0) 2168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: cluster 2024-04-19T22:53:17.594260+0000 mon.a (mon.0) 2169 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:17.596815+0000 mon.a (mon.0) 2170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:17.597045+0000 mon.a (mon.0) 2171 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: cluster 2024-04-19T22:53:17.607152+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:17.610259+0000 mon.c (mon.2) 525 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:18 smithi113 bash[28910]: audit 2024-04-19T22:53:17.613564+0000 mon.a (mon.0) 2173 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: cluster 2024-04-19T22:53:15.897194+0000 mgr.y (mgr.24389) 329 : cluster 0 pgmap v425: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:16.607725+0000 mon.c (mon.2) 524 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: cluster 2024-04-19T22:53:17.045569+0000 mon.a (mon.0) 2167 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-04-19T22:53:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:17.047441+0000 mon.a (mon.0) 2168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]: dispatch 2024-04-19T22:53:18.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: cluster 2024-04-19T22:53:17.594260+0000 mon.a (mon.0) 2169 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:17.596815+0000 mon.a (mon.0) 2170 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi113-63841-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:17.597045+0000 mon.a (mon.0) 2171 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-33"}]': finished 2024-04-19T22:53:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: cluster 2024-04-19T22:53:17.607152+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-04-19T22:53:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:17.610259+0000 mon.c (mon.2) 525 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:18 smithi178 bash[23441]: audit 2024-04-19T22:53:17.613564+0000 mon.a (mon.0) 2173 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: cluster 2024-04-19T22:53:17.898018+0000 mgr.y (mgr.24389) 330 : cluster 0 pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: audit 2024-04-19T22:53:18.511827+0000 mon.a (mon.0) 2174 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: audit 2024-04-19T22:53:18.606540+0000 mon.a (mon.0) 2175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: cluster 2024-04-19T22:53:18.613213+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: audit 2024-04-19T22:53:18.617351+0000 mon.c (mon.2) 526 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[28910]: audit 2024-04-19T22:53:18.621231+0000 mon.a (mon.0) 2177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: cluster 2024-04-19T22:53:17.898018+0000 mgr.y (mgr.24389) 330 : cluster 0 pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: audit 2024-04-19T22:53:18.511827+0000 mon.a (mon.0) 2174 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:19.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: audit 2024-04-19T22:53:18.606540+0000 mon.a (mon.0) 2175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: cluster 2024-04-19T22:53:18.613213+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-04-19T22:53:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: audit 2024-04-19T22:53:18.617351+0000 mon.c (mon.2) 526 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:19 smithi113 bash[21528]: audit 2024-04-19T22:53:18.621231+0000 mon.a (mon.0) 2177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: cluster 2024-04-19T22:53:17.898018+0000 mgr.y (mgr.24389) 330 : cluster 0 pgmap v428: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: audit 2024-04-19T22:53:18.511827+0000 mon.a (mon.0) 2174 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: audit 2024-04-19T22:53:18.606540+0000 mon.a (mon.0) 2175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: cluster 2024-04-19T22:53:18.613213+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: audit 2024-04-19T22:53:18.617351+0000 mon.c (mon.2) 526 : audit 1 from='client.? 172.21.15.113:0/3021482914' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:19 smithi178 bash[23441]: audit 2024-04-19T22:53:18.621231+0000 mon.a (mon.0) 2177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.610908+0000 mon.a (mon.0) 2178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: cluster 2024-04-19T22:53:19.622823+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.638938+0000 mon.c (mon.2) 527 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.639796+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.642868+0000 mon.c (mon.2) 528 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.645823+0000 mon.a (mon.0) 2181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.657812+0000 mon.c (mon.2) 529 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.658124+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.659003+0000 mon.c (mon.2) 530 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.659340+0000 mon.a (mon.0) 2183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.659838+0000 mon.c (mon.2) 531 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[21528]: audit 2024-04-19T22:53:19.660131+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.610908+0000 mon.a (mon.0) 2178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: cluster 2024-04-19T22:53:19.622823+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.638938+0000 mon.c (mon.2) 527 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.639796+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.642868+0000 mon.c (mon.2) 528 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.645823+0000 mon.a (mon.0) 2181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.657812+0000 mon.c (mon.2) 529 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.658124+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.659003+0000 mon.c (mon.2) 530 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.659340+0000 mon.a (mon.0) 2183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.659838+0000 mon.c (mon.2) 531 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:21.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:20 smithi113 bash[28910]: audit 2024-04-19T22:53:19.660131+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.610908+0000 mon.a (mon.0) 2178 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi113-63833-41"}]': finished 2024-04-19T22:53:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: cluster 2024-04-19T22:53:19.622823+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-04-19T22:53:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.638938+0000 mon.c (mon.2) 527 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.639796+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.642868+0000 mon.c (mon.2) 528 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.645823+0000 mon.a (mon.0) 2181 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.657812+0000 mon.c (mon.2) 529 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.658124+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.659003+0000 mon.c (mon.2) 530 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.659340+0000 mon.a (mon.0) 2183 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.659838+0000 mon.c (mon.2) 531 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:21.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:20 smithi178 bash[23441]: audit 2024-04-19T22:53:19.660131+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: cluster 2024-04-19T22:53:19.900081+0000 mgr.y (mgr.24389) 331 : cluster 0 pgmap v431: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.626534+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.626651+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:22.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.626727+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: cluster 2024-04-19T22:53:20.632727+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.653092+0000 mon.c (mon.2) 532 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.653889+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.655569+0000 mon.c (mon.2) 533 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.657954+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.657970+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[21528]: audit 2024-04-19T22:53:20.659392+0000 mon.a (mon.0) 2191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: cluster 2024-04-19T22:53:19.900081+0000 mgr.y (mgr.24389) 331 : cluster 0 pgmap v431: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.626534+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.626651+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.626727+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: cluster 2024-04-19T22:53:20.632727+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.653092+0000 mon.c (mon.2) 532 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.653889+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.655569+0000 mon.c (mon.2) 533 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.657954+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.657970+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:21 smithi113 bash[28910]: audit 2024-04-19T22:53:20.659392+0000 mon.a (mon.0) 2191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: cluster 2024-04-19T22:53:19.900081+0000 mgr.y (mgr.24389) 331 : cluster 0 pgmap v431: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.626534+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.626651+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.626727+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi113-63833-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: cluster 2024-04-19T22:53:20.632727+0000 mon.a (mon.0) 2188 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.653092+0000 mon.c (mon.2) 532 : audit 1 from='client.? 172.21.15.113:0/1549153107' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.653889+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]: dispatch 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.655569+0000 mon.c (mon.2) 533 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.657954+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.657970+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:21 smithi178 bash[23441]: audit 2024-04-19T22:53:20.659392+0000 mon.a (mon.0) 2191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: audit 2024-04-19T22:53:21.638174+0000 mon.a (mon.0) 2192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: audit 2024-04-19T22:53:21.638373+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:23.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: audit 2024-04-19T22:53:21.647988+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: cluster 2024-04-19T22:53:21.900834+0000 mgr.y (mgr.24389) 332 : cluster 0 pgmap v434: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: cluster 2024-04-19T22:53:22.092128+0000 mon.a (mon.0) 2194 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-04-19T22:53:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[21528]: audit 2024-04-19T22:53:22.093532+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: audit 2024-04-19T22:53:21.638174+0000 mon.a (mon.0) 2192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: audit 2024-04-19T22:53:21.638373+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: audit 2024-04-19T22:53:21.647988+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: cluster 2024-04-19T22:53:21.900834+0000 mgr.y (mgr.24389) 332 : cluster 0 pgmap v434: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: cluster 2024-04-19T22:53:22.092128+0000 mon.a (mon.0) 2194 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-04-19T22:53:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:22 smithi113 bash[28910]: audit 2024-04-19T22:53:22.093532+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: audit 2024-04-19T22:53:21.638174+0000 mon.a (mon.0) 2192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi113-63841-50"}]': finished 2024-04-19T22:53:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: audit 2024-04-19T22:53:21.638373+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: audit 2024-04-19T22:53:21.647988+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: cluster 2024-04-19T22:53:21.900834+0000 mgr.y (mgr.24389) 332 : cluster 0 pgmap v434: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:53:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: cluster 2024-04-19T22:53:22.092128+0000 mon.a (mon.0) 2194 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-04-19T22:53:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:22 smithi178 bash[23441]: audit 2024-04-19T22:53:22.093532+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: cluster 2024-04-19T22:53:22.638233+0000 mon.a (mon.0) 2196 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.652034+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.652311+0000 mon.a (mon.0) 2198 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: cluster 2024-04-19T22:53:22.663670+0000 mon.a (mon.0) 2199 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.667295+0000 mon.c (mon.2) 536 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.678627+0000 mon.a (mon.0) 2200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.678826+0000 mon.c (mon.2) 537 : audit 1 from='client.? 172.21.15.113:0/2783231828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[21528]: audit 2024-04-19T22:53:22.679375+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: cluster 2024-04-19T22:53:22.638233+0000 mon.a (mon.0) 2196 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.652034+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.652311+0000 mon.a (mon.0) 2198 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: cluster 2024-04-19T22:53:22.663670+0000 mon.a (mon.0) 2199 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.667295+0000 mon.c (mon.2) 536 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.678627+0000 mon.a (mon.0) 2200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.678826+0000 mon.c (mon.2) 537 : audit 1 from='client.? 172.21.15.113:0/2783231828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:23 smithi113 bash[28910]: audit 2024-04-19T22:53:22.679375+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: cluster 2024-04-19T22:53:22.638233+0000 mon.a (mon.0) 2196 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:24.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.652034+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi113-63833-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:24.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.652311+0000 mon.a (mon.0) 2198 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:24.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: cluster 2024-04-19T22:53:22.663670+0000 mon.a (mon.0) 2199 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-04-19T22:53:24.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.667295+0000 mon.c (mon.2) 536 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.678627+0000 mon.a (mon.0) 2200 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]: dispatch 2024-04-19T22:53:24.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.678826+0000 mon.c (mon.2) 537 : audit 1 from='client.? 172.21.15.113:0/2783231828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:23 smithi178 bash[23441]: audit 2024-04-19T22:53:22.679375+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:24.989 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[23441]: cluster 2024-04-19T22:53:23.653508+0000 mon.a (mon.0) 2202 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:24.989 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[23441]: audit 2024-04-19T22:53:23.665386+0000 mon.a (mon.0) 2203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]': finished 2024-04-19T22:53:24.989 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[23441]: audit 2024-04-19T22:53:23.665609+0000 mon.a (mon.0) 2204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:24.989 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[23441]: cluster 2024-04-19T22:53:23.674668+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-04-19T22:53:24.989 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[23441]: cluster 2024-04-19T22:53:23.901680+0000 mgr.y (mgr.24389) 333 : cluster 0 pgmap v437: 268 pgs: 40 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:25.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[28910]: cluster 2024-04-19T22:53:23.653508+0000 mon.a (mon.0) 2202 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[28910]: audit 2024-04-19T22:53:23.665386+0000 mon.a (mon.0) 2203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]': finished 2024-04-19T22:53:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[28910]: audit 2024-04-19T22:53:23.665609+0000 mon.a (mon.0) 2204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[28910]: cluster 2024-04-19T22:53:23.674668+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-04-19T22:53:25.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[28910]: cluster 2024-04-19T22:53:23.901680+0000 mgr.y (mgr.24389) 333 : cluster 0 pgmap v437: 268 pgs: 40 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:25.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[21528]: cluster 2024-04-19T22:53:23.653508+0000 mon.a (mon.0) 2202 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[21528]: audit 2024-04-19T22:53:23.665386+0000 mon.a (mon.0) 2203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-35", "mode": "writeback"}]': finished 2024-04-19T22:53:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[21528]: audit 2024-04-19T22:53:23.665609+0000 mon.a (mon.0) 2204 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi113-63841-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[21528]: cluster 2024-04-19T22:53:23.674668+0000 mon.a (mon.0) 2205 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-04-19T22:53:25.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:24 smithi113 bash[21528]: cluster 2024-04-19T22:53:23.901680+0000 mgr.y (mgr.24389) 333 : cluster 0 pgmap v437: 268 pgs: 40 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:25.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:24 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: cluster 2024-04-19T22:53:24.679300+0000 mon.a (mon.0) 2206 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.684254+0000 mon.c (mon.2) 538 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.685995+0000 mon.a (mon.0) 2207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.722897+0000 mon.c (mon.2) 539 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.723272+0000 mon.a (mon.0) 2208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.723996+0000 mon.c (mon.2) 540 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.724257+0000 mon.a (mon.0) 2209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.724741+0000 mon.c (mon.2) 541 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.725037+0000 mon.a (mon.0) 2210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[28910]: audit 2024-04-19T22:53:24.991433+0000 mgr.y (mgr.24389) 334 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: cluster 2024-04-19T22:53:24.679300+0000 mon.a (mon.0) 2206 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.684254+0000 mon.c (mon.2) 538 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.685995+0000 mon.a (mon.0) 2207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.722897+0000 mon.c (mon.2) 539 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.723272+0000 mon.a (mon.0) 2208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.723996+0000 mon.c (mon.2) 540 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.724257+0000 mon.a (mon.0) 2209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.724741+0000 mon.c (mon.2) 541 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.725037+0000 mon.a (mon.0) 2210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:25 smithi113 bash[21528]: audit 2024-04-19T22:53:24.991433+0000 mgr.y (mgr.24389) 334 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: cluster 2024-04-19T22:53:24.679300+0000 mon.a (mon.0) 2206 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-04-19T22:53:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.684254+0000 mon.c (mon.2) 538 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.685995+0000 mon.a (mon.0) 2207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.722897+0000 mon.c (mon.2) 539 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.723272+0000 mon.a (mon.0) 2208 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.723996+0000 mon.c (mon.2) 540 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.724257+0000 mon.a (mon.0) 2209 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.724741+0000 mon.c (mon.2) 541 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.725037+0000 mon.a (mon.0) 2210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:25 smithi178 bash[23441]: audit 2024-04-19T22:53:24.991433+0000 mgr.y (mgr.24389) 334 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:26.699 INFO:tasks.workunit.client.0.smithi113.stdout:e 2024-04-19T22:53:26.699 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7083 ms) 2024-04-19T22:53:26.699 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-04-19T22:53:26.699 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6827 ms) 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6994 ms) 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7000 ms) 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7044 ms) 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7072 ms) 2024-04-19T22:53:26.700 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7048 ms) 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7038 ms) 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6814 ms) 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7077 ms) 2024-04-19T22:53:26.701 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7057 ms) 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6862 ms) 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6992 ms) 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7038 ms) 2024-04-19T22:53:26.702 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7031 ms) 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7070 ms) 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112048 ms total) 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [----------] Global test environment tear-down 2024-04-19T22:53:26.703 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (237408 ms total) 2024-04-19T22:53:26.704 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio: [ PASSED ] 42 tests. 2024-04-19T22:53:27.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.676801+0000 mon.a (mon.0) 2211 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.677057+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: cluster 2024-04-19T22:53:25.685649+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.686501+0000 mon.c (mon.2) 542 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.687188+0000 mon.c (mon.2) 543 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.689601+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.690248+0000 mon.a (mon.0) 2215 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.803111+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:25.803800+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: cluster 2024-04-19T22:53:25.902485+0000 mgr.y (mgr.24389) 335 : cluster 0 pgmap v440: 228 pgs: 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[28910]: audit 2024-04-19T22:53:26.680141+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.676801+0000 mon.a (mon.0) 2211 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.677057+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: cluster 2024-04-19T22:53:25.685649+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.686501+0000 mon.c (mon.2) 542 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.687188+0000 mon.c (mon.2) 543 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.689601+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.690248+0000 mon.a (mon.0) 2215 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.803111+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:25.803800+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: cluster 2024-04-19T22:53:25.902485+0000 mgr.y (mgr.24389) 335 : cluster 0 pgmap v440: 228 pgs: 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:27.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21528]: audit 2024-04-19T22:53:26.680141+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.676801+0000 mon.a (mon.0) 2211 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.677057+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: cluster 2024-04-19T22:53:25.685649+0000 mon.a (mon.0) 2213 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.686501+0000 mon.c (mon.2) 542 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.687188+0000 mon.c (mon.2) 543 : audit 1 from='client.? 172.21.15.113:0/314447730' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.689601+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.690248+0000 mon.a (mon.0) 2215 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.803111+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:25.803800+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: cluster 2024-04-19T22:53:25.902485+0000 mgr.y (mgr.24389) 335 : cluster 0 pgmap v440: 228 pgs: 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:27.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:27 smithi178 bash[23441]: audit 2024-04-19T22:53:26.680141+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi113-63833-42"}]': finished 2024-04-19T22:53:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: audit 2024-04-19T22:53:26.680375+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: audit 2024-04-19T22:53:26.736197+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: cluster 2024-04-19T22:53:27.136544+0000 mon.a (mon.0) 2219 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: audit 2024-04-19T22:53:27.138445+0000 mon.a (mon.0) 2220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: audit 2024-04-19T22:53:27.683262+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: audit 2024-04-19T22:53:27.683485+0000 mon.a (mon.0) 2222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:28.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[21528]: cluster 2024-04-19T22:53:27.691286+0000 mon.a (mon.0) 2223 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: audit 2024-04-19T22:53:26.680375+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: audit 2024-04-19T22:53:26.736197+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: cluster 2024-04-19T22:53:27.136544+0000 mon.a (mon.0) 2219 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: audit 2024-04-19T22:53:27.138445+0000 mon.a (mon.0) 2220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: audit 2024-04-19T22:53:27.683262+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: audit 2024-04-19T22:53:27.683485+0000 mon.a (mon.0) 2222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:28.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:28 smithi113 bash[28910]: cluster 2024-04-19T22:53:27.691286+0000 mon.a (mon.0) 2223 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: audit 2024-04-19T22:53:26.680375+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: audit 2024-04-19T22:53:26.736197+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: cluster 2024-04-19T22:53:27.136544+0000 mon.a (mon.0) 2219 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: audit 2024-04-19T22:53:27.138445+0000 mon.a (mon.0) 2220 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: audit 2024-04-19T22:53:27.683262+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi113-63841-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: audit 2024-04-19T22:53:27.683485+0000 mon.a (mon.0) 2222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:28.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:28 smithi178 bash[23441]: cluster 2024-04-19T22:53:27.691286+0000 mon.a (mon.0) 2223 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[21528]: cluster 2024-04-19T22:53:27.903280+0000 mgr.y (mgr.24389) 336 : cluster 0 pgmap v443: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[21528]: cluster 2024-04-19T22:53:28.683142+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[21528]: cluster 2024-04-19T22:53:28.700073+0000 mon.a (mon.0) 2225 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[21528]: audit 2024-04-19T22:53:28.759662+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[21528]: audit 2024-04-19T22:53:28.760125+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[28910]: cluster 2024-04-19T22:53:27.903280+0000 mgr.y (mgr.24389) 336 : cluster 0 pgmap v443: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[28910]: cluster 2024-04-19T22:53:28.683142+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[28910]: cluster 2024-04-19T22:53:28.700073+0000 mon.a (mon.0) 2225 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-04-19T22:53:29.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[28910]: audit 2024-04-19T22:53:28.759662+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:29.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:29 smithi113 bash[28910]: audit 2024-04-19T22:53:28.760125+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:29 smithi178 bash[23441]: cluster 2024-04-19T22:53:27.903280+0000 mgr.y (mgr.24389) 336 : cluster 0 pgmap v443: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:53:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:29 smithi178 bash[23441]: cluster 2024-04-19T22:53:28.683142+0000 mon.a (mon.0) 2224 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:29 smithi178 bash[23441]: cluster 2024-04-19T22:53:28.700073+0000 mon.a (mon.0) 2225 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-04-19T22:53:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:29 smithi178 bash[23441]: audit 2024-04-19T22:53:28.759662+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:29 smithi178 bash[23441]: audit 2024-04-19T22:53:28.760125+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:31.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: audit 2024-04-19T22:53:29.695631+0000 mon.a (mon.0) 2227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: cluster 2024-04-19T22:53:29.703274+0000 mon.a (mon.0) 2228 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: audit 2024-04-19T22:53:29.705154+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: audit 2024-04-19T22:53:29.706372+0000 mon.a (mon.0) 2229 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: audit 2024-04-19T22:53:29.706850+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: audit 2024-04-19T22:53:29.708079+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[28910]: cluster 2024-04-19T22:53:29.905350+0000 mgr.y (mgr.24389) 337 : cluster 0 pgmap v446: 228 pgs: 228 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: audit 2024-04-19T22:53:29.695631+0000 mon.a (mon.0) 2227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:31.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: cluster 2024-04-19T22:53:29.703274+0000 mon.a (mon.0) 2228 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-04-19T22:53:31.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: audit 2024-04-19T22:53:29.705154+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: audit 2024-04-19T22:53:29.706372+0000 mon.a (mon.0) 2229 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: audit 2024-04-19T22:53:29.706850+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: audit 2024-04-19T22:53:29.708079+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:30 smithi113 bash[21528]: cluster 2024-04-19T22:53:29.905350+0000 mgr.y (mgr.24389) 337 : cluster 0 pgmap v446: 228 pgs: 228 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: audit 2024-04-19T22:53:29.695631+0000 mon.a (mon.0) 2227 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: cluster 2024-04-19T22:53:29.703274+0000 mon.a (mon.0) 2228 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: audit 2024-04-19T22:53:29.705154+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: audit 2024-04-19T22:53:29.706372+0000 mon.a (mon.0) 2229 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]: dispatch 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: audit 2024-04-19T22:53:29.706850+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: audit 2024-04-19T22:53:29.708079+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:30 smithi178 bash[23441]: cluster 2024-04-19T22:53:29.905350+0000 mgr.y (mgr.24389) 337 : cluster 0 pgmap v446: 228 pgs: 228 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-19T22:53:32.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: cluster 2024-04-19T22:53:30.696571+0000 mon.a (mon.0) 2231 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: audit 2024-04-19T22:53:30.705386+0000 mon.a (mon.0) 2232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: audit 2024-04-19T22:53:30.705635+0000 mon.a (mon.0) 2233 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: cluster 2024-04-19T22:53:30.716239+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: audit 2024-04-19T22:53:30.718893+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[28910]: audit 2024-04-19T22:53:30.719889+0000 mon.a (mon.0) 2235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: cluster 2024-04-19T22:53:30.696571+0000 mon.a (mon.0) 2231 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: audit 2024-04-19T22:53:30.705386+0000 mon.a (mon.0) 2232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: audit 2024-04-19T22:53:30.705635+0000 mon.a (mon.0) 2233 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: cluster 2024-04-19T22:53:30.716239+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-04-19T22:53:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: audit 2024-04-19T22:53:30.718893+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:31 smithi113 bash[21528]: audit 2024-04-19T22:53:30.719889+0000 mon.a (mon.0) 2235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: cluster 2024-04-19T22:53:30.696571+0000 mon.a (mon.0) 2231 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: audit 2024-04-19T22:53:30.705386+0000 mon.a (mon.0) 2232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-35"}]': finished 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: audit 2024-04-19T22:53:30.705635+0000 mon.a (mon.0) 2233 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: cluster 2024-04-19T22:53:30.716239+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: audit 2024-04-19T22:53:30.718893+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.113:0/88206795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:31 smithi178 bash[23441]: audit 2024-04-19T22:53:30.719889+0000 mon.a (mon.0) 2235 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:31.716295+0000 mon.a (mon.0) 2236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: cluster 2024-04-19T22:53:31.724265+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:31.769147+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: cluster 2024-04-19T22:53:31.906106+0000 mgr.y (mgr.24389) 338 : cluster 0 pgmap v449: 196 pgs: 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:32.177546+0000 mon.a (mon.0) 2238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:32.178747+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:32.180277+0000 mon.a (mon.0) 2239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:32.181278+0000 mon.c (mon.2) 552 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[21528]: audit 2024-04-19T22:53:32.181724+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:31.716295+0000 mon.a (mon.0) 2236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: cluster 2024-04-19T22:53:31.724265+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:31.769147+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: cluster 2024-04-19T22:53:31.906106+0000 mgr.y (mgr.24389) 338 : cluster 0 pgmap v449: 196 pgs: 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:32.177546+0000 mon.a (mon.0) 2238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:32.178747+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:32.180277+0000 mon.a (mon.0) 2239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:32.181278+0000 mon.c (mon.2) 552 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:32 smithi113 bash[28910]: audit 2024-04-19T22:53:32.181724+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:31.716295+0000 mon.a (mon.0) 2236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi113-63841-52"}]': finished 2024-04-19T22:53:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: cluster 2024-04-19T22:53:31.724265+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-04-19T22:53:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:31.769147+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: cluster 2024-04-19T22:53:31.906106+0000 mgr.y (mgr.24389) 338 : cluster 0 pgmap v449: 196 pgs: 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:53:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:32.177546+0000 mon.a (mon.0) 2238 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:32.178747+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:32.180277+0000 mon.a (mon.0) 2239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:32.181278+0000 mon.c (mon.2) 552 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:32 smithi178 bash[23441]: audit 2024-04-19T22:53:32.181724+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:32.728621+0000 mon.a (mon.0) 2241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: cluster 2024-04-19T22:53:32.740167+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:32.741923+0000 mon.c (mon.2) 553 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:32.749809+0000 mon.c (mon.2) 554 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:32.754615+0000 mon.a (mon.0) 2243 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:32.758621+0000 mon.a (mon.0) 2244 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[21528]: audit 2024-04-19T22:53:33.545107+0000 mon.a (mon.0) 2245 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:32.728621+0000 mon.a (mon.0) 2241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: cluster 2024-04-19T22:53:32.740167+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:32.741923+0000 mon.c (mon.2) 553 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:32.749809+0000 mon.c (mon.2) 554 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:32.754615+0000 mon.a (mon.0) 2243 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:32.758621+0000 mon.a (mon.0) 2244 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:34 smithi113 bash[28910]: audit 2024-04-19T22:53:33.545107+0000 mon.a (mon.0) 2245 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:32.728621+0000 mon.a (mon.0) 2241 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: cluster 2024-04-19T22:53:32.740167+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-04-19T22:53:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:32.741923+0000 mon.c (mon.2) 553 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:32.749809+0000 mon.c (mon.2) 554 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:32.754615+0000 mon.a (mon.0) 2243 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:32.758621+0000 mon.a (mon.0) 2244 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[23441]: audit 2024-04-19T22:53:33.545107+0000 mon.a (mon.0) 2245 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:35.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:34 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:33.732383+0000 mon.a (mon.0) 2246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:33.747852+0000 mon.c (mon.2) 555 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: cluster 2024-04-19T22:53:33.906879+0000 mgr.y (mgr.24389) 339 : cluster 0 pgmap v452: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: cluster 2024-04-19T22:53:34.188021+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:34.204485+0000 mon.a (mon.0) 2248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:34.735694+0000 mon.a (mon.0) 2249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:34.735958+0000 mon.a (mon.0) 2250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: cluster 2024-04-19T22:53:34.743909+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:34.746944+0000 mon.c (mon.2) 556 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:35.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:35 smithi178 bash[23441]: audit 2024-04-19T22:53:34.752183+0000 mon.a (mon.0) 2252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:35.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:33.732383+0000 mon.a (mon.0) 2246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:35.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:33.747852+0000 mon.c (mon.2) 555 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: cluster 2024-04-19T22:53:33.906879+0000 mgr.y (mgr.24389) 339 : cluster 0 pgmap v452: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: cluster 2024-04-19T22:53:34.188021+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:34.204485+0000 mon.a (mon.0) 2248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:34.735694+0000 mon.a (mon.0) 2249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:34.735958+0000 mon.a (mon.0) 2250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: cluster 2024-04-19T22:53:34.743909+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:34.746944+0000 mon.c (mon.2) 556 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[21528]: audit 2024-04-19T22:53:34.752183+0000 mon.a (mon.0) 2252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:33.732383+0000 mon.a (mon.0) 2246 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:33.747852+0000 mon.c (mon.2) 555 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: cluster 2024-04-19T22:53:33.906879+0000 mgr.y (mgr.24389) 339 : cluster 0 pgmap v452: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: cluster 2024-04-19T22:53:34.188021+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-04-19T22:53:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:34.204485+0000 mon.a (mon.0) 2248 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:34.735694+0000 mon.a (mon.0) 2249 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi113-63841-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:34.735958+0000 mon.a (mon.0) 2250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: cluster 2024-04-19T22:53:34.743909+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-04-19T22:53:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:34.746944+0000 mon.c (mon.2) 556 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:35 smithi113 bash[28910]: audit 2024-04-19T22:53:34.752183+0000 mon.a (mon.0) 2252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: audit 2024-04-19T22:53:34.999871+0000 mgr.y (mgr.24389) 340 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: cluster 2024-04-19T22:53:35.553076+0000 mon.a (mon.0) 2253 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: audit 2024-04-19T22:53:35.556691+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: cluster 2024-04-19T22:53:35.565162+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: audit 2024-04-19T22:53:35.576150+0000 mon.c (mon.2) 557 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[21528]: audit 2024-04-19T22:53:35.583517+0000 mon.a (mon.0) 2256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:36.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: audit 2024-04-19T22:53:34.999871+0000 mgr.y (mgr.24389) 340 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:36.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: cluster 2024-04-19T22:53:35.553076+0000 mon.a (mon.0) 2253 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:36.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: audit 2024-04-19T22:53:35.556691+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:36.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: cluster 2024-04-19T22:53:35.565162+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-04-19T22:53:36.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: audit 2024-04-19T22:53:35.576150+0000 mon.c (mon.2) 557 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:36.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:36 smithi113 bash[28910]: audit 2024-04-19T22:53:35.583517+0000 mon.a (mon.0) 2256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:36.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: audit 2024-04-19T22:53:34.999871+0000 mgr.y (mgr.24389) 340 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:36.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: cluster 2024-04-19T22:53:35.553076+0000 mon.a (mon.0) 2253 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:36.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: audit 2024-04-19T22:53:35.556691+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:36.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: cluster 2024-04-19T22:53:35.565162+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-04-19T22:53:36.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: audit 2024-04-19T22:53:35.576150+0000 mon.c (mon.2) 557 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:36.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:36 smithi178 bash[23441]: audit 2024-04-19T22:53:35.583517+0000 mon.a (mon.0) 2256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]: dispatch 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: cluster 2024-04-19T22:53:35.907692+0000 mgr.y (mgr.24389) 341 : cluster 0 pgmap v455: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: cluster 2024-04-19T22:53:36.557758+0000 mon.a (mon.0) 2257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: audit 2024-04-19T22:53:36.568163+0000 mon.a (mon.0) 2258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]': finished 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: cluster 2024-04-19T22:53:36.580194+0000 mon.a (mon.0) 2259 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: audit 2024-04-19T22:53:36.586561+0000 mon.c (mon.2) 558 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: audit 2024-04-19T22:53:36.590121+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: audit 2024-04-19T22:53:36.692416+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[28910]: audit 2024-04-19T22:53:36.693265+0000 mon.a (mon.0) 2261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: cluster 2024-04-19T22:53:35.907692+0000 mgr.y (mgr.24389) 341 : cluster 0 pgmap v455: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: cluster 2024-04-19T22:53:36.557758+0000 mon.a (mon.0) 2257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: audit 2024-04-19T22:53:36.568163+0000 mon.a (mon.0) 2258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]': finished 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: cluster 2024-04-19T22:53:36.580194+0000 mon.a (mon.0) 2259 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: audit 2024-04-19T22:53:36.586561+0000 mon.c (mon.2) 558 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: audit 2024-04-19T22:53:36.590121+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: audit 2024-04-19T22:53:36.692416+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.482 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21528]: audit 2024-04-19T22:53:36.693265+0000 mon.a (mon.0) 2261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: cluster 2024-04-19T22:53:35.907692+0000 mgr.y (mgr.24389) 341 : cluster 0 pgmap v455: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:37.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: cluster 2024-04-19T22:53:36.557758+0000 mon.a (mon.0) 2257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:37.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: audit 2024-04-19T22:53:36.568163+0000 mon.a (mon.0) 2258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-37", "mode": "writeback"}]': finished 2024-04-19T22:53:37.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: cluster 2024-04-19T22:53:36.580194+0000 mon.a (mon.0) 2259 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-04-19T22:53:37.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: audit 2024-04-19T22:53:36.586561+0000 mon.c (mon.2) 558 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: audit 2024-04-19T22:53:36.590121+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:37.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: audit 2024-04-19T22:53:36.692416+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:37 smithi178 bash[23441]: audit 2024-04-19T22:53:36.693265+0000 mon.a (mon.0) 2261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.572520+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.572695+0000 mon.a (mon.0) 2263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: cluster 2024-04-19T22:53:37.580480+0000 mon.a (mon.0) 2264 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.587420+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.588057+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.588618+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[28910]: audit 2024-04-19T22:53:37.589881+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.572520+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.572695+0000 mon.a (mon.0) 2263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: cluster 2024-04-19T22:53:37.580480+0000 mon.a (mon.0) 2264 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-04-19T22:53:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.587420+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.588057+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.588618+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:38 smithi113 bash[21528]: audit 2024-04-19T22:53:37.589881+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.572520+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.572695+0000 mon.a (mon.0) 2263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: cluster 2024-04-19T22:53:37.580480+0000 mon.a (mon.0) 2264 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-04-19T22:53:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.587420+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.113:0/195798953' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.588057+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.588618+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]: dispatch 2024-04-19T22:53:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:38 smithi178 bash[23441]: audit 2024-04-19T22:53:37.589881+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]: dispatch 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: cluster 2024-04-19T22:53:37.908543+0000 mgr.y (mgr.24389) 342 : cluster 0 pgmap v458: 228 pgs: 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: cluster 2024-04-19T22:53:38.574181+0000 mon.a (mon.0) 2267 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.586496+0000 mon.a (mon.0) 2268 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.586648+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: cluster 2024-04-19T22:53:38.600821+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.648724+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.649167+0000 mon.a (mon.0) 2271 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.650164+0000 mon.c (mon.2) 563 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.650510+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.651106+0000 mon.c (mon.2) 564 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[21528]: audit 2024-04-19T22:53:38.651417+0000 mon.a (mon.0) 2273 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: cluster 2024-04-19T22:53:37.908543+0000 mgr.y (mgr.24389) 342 : cluster 0 pgmap v458: 228 pgs: 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: cluster 2024-04-19T22:53:38.574181+0000 mon.a (mon.0) 2267 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.586496+0000 mon.a (mon.0) 2268 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.586648+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: cluster 2024-04-19T22:53:38.600821+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.648724+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.649167+0000 mon.a (mon.0) 2271 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.650164+0000 mon.c (mon.2) 563 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.650510+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.651106+0000 mon.c (mon.2) 564 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:39 smithi113 bash[28910]: audit 2024-04-19T22:53:38.651417+0000 mon.a (mon.0) 2273 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: cluster 2024-04-19T22:53:37.908543+0000 mgr.y (mgr.24389) 342 : cluster 0 pgmap v458: 228 pgs: 228 active+clean; 4.6 MiB data, 598 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: cluster 2024-04-19T22:53:38.574181+0000 mon.a (mon.0) 2267 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.586496+0000 mon.a (mon.0) 2268 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi113-63841-53"}]': finished 2024-04-19T22:53:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.586648+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-37"}]': finished 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: cluster 2024-04-19T22:53:38.600821+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.648724+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.649167+0000 mon.a (mon.0) 2271 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.650164+0000 mon.c (mon.2) 563 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.650510+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.651106+0000 mon.c (mon.2) 564 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:39 smithi178 bash[23441]: audit 2024-04-19T22:53:38.651417+0000 mon.a (mon.0) 2273 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:41.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[28910]: audit 2024-04-19T22:53:39.589018+0000 mon.a (mon.0) 2274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[28910]: cluster 2024-04-19T22:53:39.597328+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[28910]: audit 2024-04-19T22:53:39.602493+0000 mon.c (mon.2) 565 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[28910]: audit 2024-04-19T22:53:39.618401+0000 mon.a (mon.0) 2276 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[21528]: audit 2024-04-19T22:53:39.589018+0000 mon.a (mon.0) 2274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[21528]: cluster 2024-04-19T22:53:39.597328+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[21528]: audit 2024-04-19T22:53:39.602493+0000 mon.c (mon.2) 565 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:41.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:40 smithi113 bash[21528]: audit 2024-04-19T22:53:39.618401+0000 mon.a (mon.0) 2276 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:40 smithi178 bash[23441]: audit 2024-04-19T22:53:39.589018+0000 mon.a (mon.0) 2274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi113-63841-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:40 smithi178 bash[23441]: cluster 2024-04-19T22:53:39.597328+0000 mon.a (mon.0) 2275 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-04-19T22:53:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:40 smithi178 bash[23441]: audit 2024-04-19T22:53:39.602493+0000 mon.c (mon.2) 565 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:40 smithi178 bash[23441]: audit 2024-04-19T22:53:39.618401+0000 mon.a (mon.0) 2276 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:42.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[28910]: cluster 2024-04-19T22:53:39.910084+0000 mgr.y (mgr.24389) 343 : cluster 0 pgmap v461: 196 pgs: 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[28910]: cluster 2024-04-19T22:53:41.077257+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[28910]: audit 2024-04-19T22:53:41.078779+0000 mon.c (mon.2) 566 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[28910]: audit 2024-04-19T22:53:41.079859+0000 mon.a (mon.0) 2278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[21528]: cluster 2024-04-19T22:53:39.910084+0000 mgr.y (mgr.24389) 343 : cluster 0 pgmap v461: 196 pgs: 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[21528]: cluster 2024-04-19T22:53:41.077257+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[21528]: audit 2024-04-19T22:53:41.078779+0000 mon.c (mon.2) 566 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:41 smithi113 bash[21528]: audit 2024-04-19T22:53:41.079859+0000 mon.a (mon.0) 2278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:41 smithi178 bash[23441]: cluster 2024-04-19T22:53:39.910084+0000 mgr.y (mgr.24389) 343 : cluster 0 pgmap v461: 196 pgs: 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:41 smithi178 bash[23441]: cluster 2024-04-19T22:53:41.077257+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-04-19T22:53:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:41 smithi178 bash[23441]: audit 2024-04-19T22:53:41.078779+0000 mon.c (mon.2) 566 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:41 smithi178 bash[23441]: audit 2024-04-19T22:53:41.079859+0000 mon.a (mon.0) 2278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: audit 2024-04-19T22:53:41.631343+0000 mon.a (mon.0) 2279 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: audit 2024-04-19T22:53:41.631637+0000 mon.a (mon.0) 2280 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: cluster 2024-04-19T22:53:41.639724+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: audit 2024-04-19T22:53:41.656727+0000 mon.c (mon.2) 567 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: audit 2024-04-19T22:53:41.658003+0000 mon.a (mon.0) 2282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[21528]: cluster 2024-04-19T22:53:41.910933+0000 mgr.y (mgr.24389) 344 : cluster 0 pgmap v464: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: audit 2024-04-19T22:53:41.631343+0000 mon.a (mon.0) 2279 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: audit 2024-04-19T22:53:41.631637+0000 mon.a (mon.0) 2280 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:43.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: cluster 2024-04-19T22:53:41.639724+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-04-19T22:53:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: audit 2024-04-19T22:53:41.656727+0000 mon.c (mon.2) 567 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: audit 2024-04-19T22:53:41.658003+0000 mon.a (mon.0) 2282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:42 smithi113 bash[28910]: cluster 2024-04-19T22:53:41.910933+0000 mgr.y (mgr.24389) 344 : cluster 0 pgmap v464: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: audit 2024-04-19T22:53:41.631343+0000 mon.a (mon.0) 2279 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi113-63841-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: audit 2024-04-19T22:53:41.631637+0000 mon.a (mon.0) 2280 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: cluster 2024-04-19T22:53:41.639724+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: audit 2024-04-19T22:53:41.656727+0000 mon.c (mon.2) 567 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: audit 2024-04-19T22:53:41.658003+0000 mon.a (mon.0) 2282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:42 smithi178 bash[23441]: cluster 2024-04-19T22:53:41.910933+0000 mgr.y (mgr.24389) 344 : cluster 0 pgmap v464: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: cluster 2024-04-19T22:53:42.632873+0000 mon.a (mon.0) 2283 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:42.634410+0000 mon.a (mon.0) 2284 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: cluster 2024-04-19T22:53:42.642401+0000 mon.a (mon.0) 2285 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:42.643481+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:42.648195+0000 mon.a (mon.0) 2286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:43.637138+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: cluster 2024-04-19T22:53:43.644646+0000 mon.a (mon.0) 2288 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:43.646881+0000 mon.c (mon.2) 569 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[21528]: audit 2024-04-19T22:53:43.647822+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: cluster 2024-04-19T22:53:42.632873+0000 mon.a (mon.0) 2283 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:42.634410+0000 mon.a (mon.0) 2284 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: cluster 2024-04-19T22:53:42.642401+0000 mon.a (mon.0) 2285 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:42.643481+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:42.648195+0000 mon.a (mon.0) 2286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:43.637138+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: cluster 2024-04-19T22:53:43.644646+0000 mon.a (mon.0) 2288 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:43.646881+0000 mon.c (mon.2) 569 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:44.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:43 smithi113 bash[28910]: audit 2024-04-19T22:53:43.647822+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: cluster 2024-04-19T22:53:42.632873+0000 mon.a (mon.0) 2283 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:42.634410+0000 mon.a (mon.0) 2284 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: cluster 2024-04-19T22:53:42.642401+0000 mon.a (mon.0) 2285 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-04-19T22:53:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:42.643481+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:42.648195+0000 mon.a (mon.0) 2286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:43.637138+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: cluster 2024-04-19T22:53:43.644646+0000 mon.a (mon.0) 2288 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-04-19T22:53:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:43.646881+0000 mon.c (mon.2) 569 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:43 smithi178 bash[23441]: audit 2024-04-19T22:53:43.647822+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]: dispatch 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: audit 2024-04-19T22:53:43.650352+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: audit 2024-04-19T22:53:43.651344+0000 mon.a (mon.0) 2290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: cluster 2024-04-19T22:53:43.911719+0000 mgr.y (mgr.24389) 345 : cluster 0 pgmap v467: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: cluster 2024-04-19T22:53:44.637460+0000 mon.a (mon.0) 2291 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: audit 2024-04-19T22:53:44.639782+0000 mon.a (mon.0) 2292 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]': finished 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: audit 2024-04-19T22:53:44.640022+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: cluster 2024-04-19T22:53:44.648959+0000 mon.a (mon.0) 2294 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-04-19T22:53:45.009 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:44 smithi178 bash[23441]: audit 2024-04-19T22:53:44.651114+0000 mon.a (mon.0) 2295 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: audit 2024-04-19T22:53:43.650352+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: audit 2024-04-19T22:53:43.651344+0000 mon.a (mon.0) 2290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: cluster 2024-04-19T22:53:43.911719+0000 mgr.y (mgr.24389) 345 : cluster 0 pgmap v467: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: cluster 2024-04-19T22:53:44.637460+0000 mon.a (mon.0) 2291 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: audit 2024-04-19T22:53:44.639782+0000 mon.a (mon.0) 2292 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]': finished 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: audit 2024-04-19T22:53:44.640022+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: cluster 2024-04-19T22:53:44.648959+0000 mon.a (mon.0) 2294 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[28910]: audit 2024-04-19T22:53:44.651114+0000 mon.a (mon.0) 2295 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: audit 2024-04-19T22:53:43.650352+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: audit 2024-04-19T22:53:43.651344+0000 mon.a (mon.0) 2290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: cluster 2024-04-19T22:53:43.911719+0000 mgr.y (mgr.24389) 345 : cluster 0 pgmap v467: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: cluster 2024-04-19T22:53:44.637460+0000 mon.a (mon.0) 2291 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: audit 2024-04-19T22:53:44.639782+0000 mon.a (mon.0) 2292 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-39", "mode": "writeback"}]': finished 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: audit 2024-04-19T22:53:44.640022+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: cluster 2024-04-19T22:53:44.648959+0000 mon.a (mon.0) 2294 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-04-19T22:53:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:44 smithi113 bash[21528]: audit 2024-04-19T22:53:44.651114+0000 mon.a (mon.0) 2295 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:45.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:44.650052+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:44.855927+0000 mon.c (mon.2) 572 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:44.856541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:45.011519+0000 mgr.y (mgr.24389) 346 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:45.656004+0000 mon.a (mon.0) 2297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:45.656208+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:45.660266+0000 mon.c (mon.2) 573 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: cluster 2024-04-19T22:53:45.665857+0000 mon.a (mon.0) 2299 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-04-19T22:53:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[28910]: audit 2024-04-19T22:53:45.667874+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:44.650052+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:44.855927+0000 mon.c (mon.2) 572 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:44.856541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:45.011519+0000 mgr.y (mgr.24389) 346 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:45.656004+0000 mon.a (mon.0) 2297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:45.656208+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:45.660266+0000 mon.c (mon.2) 573 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: cluster 2024-04-19T22:53:45.665857+0000 mon.a (mon.0) 2299 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-04-19T22:53:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:45 smithi113 bash[21528]: audit 2024-04-19T22:53:45.667874+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:44.650052+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.113:0/1666220637' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]: dispatch 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:44.855927+0000 mon.c (mon.2) 572 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:44.856541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:45.011519+0000 mgr.y (mgr.24389) 346 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:45.656004+0000 mon.a (mon.0) 2297 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi113-63841-54"}]': finished 2024-04-19T22:53:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:45.656208+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:53:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:45.660266+0000 mon.c (mon.2) 573 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: cluster 2024-04-19T22:53:45.665857+0000 mon.a (mon.0) 2299 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-04-19T22:53:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:45 smithi178 bash[23441]: audit 2024-04-19T22:53:45.667874+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]: dispatch 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: audit 2024-04-19T22:53:45.705408+0000 mon.a (mon.0) 2301 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: audit 2024-04-19T22:53:45.706999+0000 mon.a (mon.0) 2302 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: audit 2024-04-19T22:53:45.707508+0000 mon.a (mon.0) 2303 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: cluster 2024-04-19T22:53:45.912584+0000 mgr.y (mgr.24389) 347 : cluster 0 pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 7 op/s 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: cluster 2024-04-19T22:53:46.656174+0000 mon.a (mon.0) 2304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: audit 2024-04-19T22:53:46.658510+0000 mon.a (mon.0) 2305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: audit 2024-04-19T22:53:46.658749+0000 mon.a (mon.0) 2306 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[28910]: cluster 2024-04-19T22:53:46.666881+0000 mon.a (mon.0) 2307 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-04-19T22:53:47.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: audit 2024-04-19T22:53:45.705408+0000 mon.a (mon.0) 2301 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: audit 2024-04-19T22:53:45.706999+0000 mon.a (mon.0) 2302 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: audit 2024-04-19T22:53:45.707508+0000 mon.a (mon.0) 2303 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: cluster 2024-04-19T22:53:45.912584+0000 mgr.y (mgr.24389) 347 : cluster 0 pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 7 op/s 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: cluster 2024-04-19T22:53:46.656174+0000 mon.a (mon.0) 2304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: audit 2024-04-19T22:53:46.658510+0000 mon.a (mon.0) 2305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: audit 2024-04-19T22:53:46.658749+0000 mon.a (mon.0) 2306 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:47.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:46 smithi113 bash[21528]: cluster 2024-04-19T22:53:46.666881+0000 mon.a (mon.0) 2307 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: audit 2024-04-19T22:53:45.705408+0000 mon.a (mon.0) 2301 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: audit 2024-04-19T22:53:45.706999+0000 mon.a (mon.0) 2302 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: audit 2024-04-19T22:53:45.707508+0000 mon.a (mon.0) 2303 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: cluster 2024-04-19T22:53:45.912584+0000 mgr.y (mgr.24389) 347 : cluster 0 pgmap v470: 228 pgs: 228 active+clean; 8.4 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 7 op/s 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: cluster 2024-04-19T22:53:46.656174+0000 mon.a (mon.0) 2304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: audit 2024-04-19T22:53:46.658510+0000 mon.a (mon.0) 2305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-39"}]': finished 2024-04-19T22:53:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: audit 2024-04-19T22:53:46.658749+0000 mon.a (mon.0) 2306 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi113-63841-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:46 smithi178 bash[23441]: cluster 2024-04-19T22:53:46.666881+0000 mon.a (mon.0) 2307 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-04-19T22:53:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: seed 63998 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (325 ms) 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-19T22:53:48.114 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (34200 ms) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (29 ms) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (34554 ms total) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (11142 ms) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (10578 ms) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (11343 ms) 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: my_snaps [3] 2024-04-19T22:53:48.115 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: my_snaps [4,3] 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: my_snaps [5,4,3] 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: promoting some heads 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: promoting from clones for snap 6 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: promoting from clones for snap 5 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: promoting from clones for snap 4 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: promoting from clones for snap 3 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: waiting for scrubs... 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: done waiting 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46382 ms) 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10024 ms) 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8425 ms) 2024-04-19T22:53:48.116 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8101 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (7616 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10058 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9269 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (9647 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (13355 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7556 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8038 ms) 2024-04-19T22:53:48.117 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-19T22:53:48.118 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13108 ms) 2024-04-19T22:53:48.118 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-19T22:53:48.118 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7876 ms) 2024-04-19T22:53:48.118 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-19T22:53:48.118 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8516 ms) 2024-04-19T22:53:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:48 smithi113 bash[21528]: audit 2024-04-19T22:53:46.675572+0000 mon.a (mon.0) 2308 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:48 smithi113 bash[28910]: audit 2024-04-19T22:53:46.675572+0000 mon.a (mon.0) 2308 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:48.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:48 smithi178 bash[23441]: audit 2024-04-19T22:53:46.675572+0000 mon.a (mon.0) 2308 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:49.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: cluster 2024-04-19T22:53:47.913300+0000 mgr.y (mgr.24389) 348 : cluster 0 pgmap v473: 196 pgs: 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: cluster 2024-04-19T22:53:48.117339+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: audit 2024-04-19T22:53:48.578304+0000 mon.a (mon.0) 2310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: audit 2024-04-19T22:53:48.673105+0000 mon.a (mon.0) 2311 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: cluster 2024-04-19T22:53:48.680460+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: audit 2024-04-19T22:53:48.683946+0000 mon.c (mon.2) 574 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[28910]: audit 2024-04-19T22:53:48.695029+0000 mon.a (mon.0) 2313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: cluster 2024-04-19T22:53:47.913300+0000 mgr.y (mgr.24389) 348 : cluster 0 pgmap v473: 196 pgs: 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: cluster 2024-04-19T22:53:48.117339+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: audit 2024-04-19T22:53:48.578304+0000 mon.a (mon.0) 2310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: audit 2024-04-19T22:53:48.673105+0000 mon.a (mon.0) 2311 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:49.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: cluster 2024-04-19T22:53:48.680460+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-04-19T22:53:49.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: audit 2024-04-19T22:53:48.683946+0000 mon.c (mon.2) 574 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:49.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:49 smithi113 bash[21528]: audit 2024-04-19T22:53:48.695029+0000 mon.a (mon.0) 2313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: cluster 2024-04-19T22:53:47.913300+0000 mgr.y (mgr.24389) 348 : cluster 0 pgmap v473: 196 pgs: 196 active+clean; 4.6 MiB data, 587 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: cluster 2024-04-19T22:53:48.117339+0000 mon.a (mon.0) 2309 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-04-19T22:53:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: audit 2024-04-19T22:53:48.578304+0000 mon.a (mon.0) 2310 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:53:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: audit 2024-04-19T22:53:48.673105+0000 mon.a (mon.0) 2311 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi113-63841-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:49.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: cluster 2024-04-19T22:53:48.680460+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-04-19T22:53:49.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: audit 2024-04-19T22:53:48.683946+0000 mon.c (mon.2) 574 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:49.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:49 smithi178 bash[23441]: audit 2024-04-19T22:53:48.695029+0000 mon.a (mon.0) 2313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: audit 2024-04-19T22:53:49.675960+0000 mon.a (mon.0) 2314 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: cluster 2024-04-19T22:53:49.685961+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: audit 2024-04-19T22:53:49.690431+0000 mon.c (mon.2) 575 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: audit 2024-04-19T22:53:49.701637+0000 mon.a (mon.0) 2316 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: cluster 2024-04-19T22:53:49.915419+0000 mgr.y (mgr.24389) 349 : cluster 0 pgmap v476: 236 pgs: 8 creating+activating, 228 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: audit 2024-04-19T22:53:50.184958+0000 mon.a (mon.0) 2317 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:53:51.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[21528]: cluster 2024-04-19T22:53:50.563810+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: audit 2024-04-19T22:53:49.675960+0000 mon.a (mon.0) 2314 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: cluster 2024-04-19T22:53:49.685961+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: audit 2024-04-19T22:53:49.690431+0000 mon.c (mon.2) 575 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: audit 2024-04-19T22:53:49.701637+0000 mon.a (mon.0) 2316 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: cluster 2024-04-19T22:53:49.915419+0000 mgr.y (mgr.24389) 349 : cluster 0 pgmap v476: 236 pgs: 8 creating+activating, 228 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: audit 2024-04-19T22:53:50.184958+0000 mon.a (mon.0) 2317 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:53:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:50 smithi113 bash[28910]: cluster 2024-04-19T22:53:50.563810+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: audit 2024-04-19T22:53:49.675960+0000 mon.a (mon.0) 2314 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: cluster 2024-04-19T22:53:49.685961+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: audit 2024-04-19T22:53:49.690431+0000 mon.c (mon.2) 575 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: audit 2024-04-19T22:53:49.701637+0000 mon.a (mon.0) 2316 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: cluster 2024-04-19T22:53:49.915419+0000 mgr.y (mgr.24389) 349 : cluster 0 pgmap v476: 236 pgs: 8 creating+activating, 228 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-04-19T22:53:51.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: audit 2024-04-19T22:53:50.184958+0000 mon.a (mon.0) 2317 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:53:51.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:50 smithi178 bash[23441]: cluster 2024-04-19T22:53:50.563810+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.683745+0000 mon.a (mon.0) 2319 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.695596+0000 mon.c (mon.2) 576 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: cluster 2024-04-19T22:53:50.696123+0000 mon.a (mon.0) 2320 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.698141+0000 mon.a (mon.0) 2321 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.699121+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.916449+0000 mon.a (mon.0) 2323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.918137+0000 mon.a (mon.0) 2324 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:53:52.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[21528]: audit 2024-04-19T22:53:50.927706+0000 mon.a (mon.0) 2325 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.683745+0000 mon.a (mon.0) 2319 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.695596+0000 mon.c (mon.2) 576 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: cluster 2024-04-19T22:53:50.696123+0000 mon.a (mon.0) 2320 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.698141+0000 mon.a (mon.0) 2321 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.699121+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.916449+0000 mon.a (mon.0) 2323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.918137+0000 mon.a (mon.0) 2324 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:53:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:51 smithi113 bash[28910]: audit 2024-04-19T22:53:50.927706+0000 mon.a (mon.0) 2325 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.683745+0000 mon.a (mon.0) 2319 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:53:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.695596+0000 mon.c (mon.2) 576 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: cluster 2024-04-19T22:53:50.696123+0000 mon.a (mon.0) 2320 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-04-19T22:53:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.698141+0000 mon.a (mon.0) 2321 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:53:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.699121+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.916449+0000 mon.a (mon.0) 2323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:53:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.918137+0000 mon.a (mon.0) 2324 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:53:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:51 smithi178 bash[23441]: audit 2024-04-19T22:53:50.927706+0000 mon.a (mon.0) 2325 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:53:53.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:51.686145+0000 mon.a (mon.0) 2326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:53:53.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:51.686301+0000 mon.a (mon.0) 2327 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: cluster 2024-04-19T22:53:51.693458+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:51.695753+0000 mon.a (mon.0) 2329 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:51.696678+0000 mon.c (mon.2) 577 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:51.698178+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: cluster 2024-04-19T22:53:51.916217+0000 mgr.y (mgr.24389) 350 : cluster 0 pgmap v479: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:52.689609+0000 mon.a (mon.0) 2331 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: audit 2024-04-19T22:53:52.689783+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[21528]: cluster 2024-04-19T22:53:52.697249+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:51.686145+0000 mon.a (mon.0) 2326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:51.686301+0000 mon.a (mon.0) 2327 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: cluster 2024-04-19T22:53:51.693458+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:51.695753+0000 mon.a (mon.0) 2329 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:51.696678+0000 mon.c (mon.2) 577 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:51.698178+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: cluster 2024-04-19T22:53:51.916217+0000 mgr.y (mgr.24389) 350 : cluster 0 pgmap v479: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:52.689609+0000 mon.a (mon.0) 2331 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: audit 2024-04-19T22:53:52.689783+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:53:53.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:52 smithi113 bash[28910]: cluster 2024-04-19T22:53:52.697249+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-04-19T22:53:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:51.686145+0000 mon.a (mon.0) 2326 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:53:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:51.686301+0000 mon.a (mon.0) 2327 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: cluster 2024-04-19T22:53:51.693458+0000 mon.a (mon.0) 2328 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-04-19T22:53:53.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:51.695753+0000 mon.a (mon.0) 2329 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]: dispatch 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:51.696678+0000 mon.c (mon.2) 577 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:51.698178+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: cluster 2024-04-19T22:53:51.916217+0000 mgr.y (mgr.24389) 350 : cluster 0 pgmap v479: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:52.689609+0000 mon.a (mon.0) 2331 : audit 1 from='client.? 172.21.15.113:0/2713806952' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi113-63841-55"}]': finished 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: audit 2024-04-19T22:53:52.689783+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:53:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:52 smithi178 bash[23441]: cluster 2024-04-19T22:53:52.697249+0000 mon.a (mon.0) 2333 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-04-19T22:53:54.045 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.701934+0000 mon.c (mon.2) 578 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.706925+0000 mon.a (mon.0) 2334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.723220+0000 mon.c (mon.2) 579 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.723550+0000 mon.a (mon.0) 2335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.724320+0000 mon.c (mon.2) 580 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.724632+0000 mon.a (mon.0) 2336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.725152+0000 mon.c (mon.2) 581 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:52.725449+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[28910]: audit 2024-04-19T22:53:53.705366+0000 mon.a (mon.0) 2338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:53:54.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.701934+0000 mon.c (mon.2) 578 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.706925+0000 mon.a (mon.0) 2334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.723220+0000 mon.c (mon.2) 579 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.723550+0000 mon.a (mon.0) 2335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.724320+0000 mon.c (mon.2) 580 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.724632+0000 mon.a (mon.0) 2336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.725152+0000 mon.c (mon.2) 581 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:52.725449+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:53 smithi113 bash[21528]: audit 2024-04-19T22:53:53.705366+0000 mon.a (mon.0) 2338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:53:54.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.701934+0000 mon.c (mon.2) 578 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.706925+0000 mon.a (mon.0) 2334 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:53:54.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.723220+0000 mon.c (mon.2) 579 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.723550+0000 mon.a (mon.0) 2335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.724320+0000 mon.c (mon.2) 580 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.724632+0000 mon.a (mon.0) 2336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.725152+0000 mon.c (mon.2) 581 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:52.725449+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:53:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:53 smithi178 bash[23441]: audit 2024-04-19T22:53:53.705366+0000 mon.a (mon.0) 2338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:53:55.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:53:55.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[23441]: audit 2024-04-19T22:53:53.705579+0000 mon.a (mon.0) 2339 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:55.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[23441]: cluster 2024-04-19T22:53:53.713176+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-04-19T22:53:55.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[23441]: audit 2024-04-19T22:53:53.717421+0000 mon.c (mon.2) 582 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[23441]: audit 2024-04-19T22:53:53.721592+0000 mon.a (mon.0) 2341 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:55 smithi178 bash[23441]: cluster 2024-04-19T22:53:53.917039+0000 mgr.y (mgr.24389) 351 : cluster 0 pgmap v482: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[21528]: audit 2024-04-19T22:53:53.705579+0000 mon.a (mon.0) 2339 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[21528]: cluster 2024-04-19T22:53:53.713176+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[21528]: audit 2024-04-19T22:53:53.717421+0000 mon.c (mon.2) 582 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[21528]: audit 2024-04-19T22:53:53.721592+0000 mon.a (mon.0) 2341 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[21528]: cluster 2024-04-19T22:53:53.917039+0000 mgr.y (mgr.24389) 351 : cluster 0 pgmap v482: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[28910]: audit 2024-04-19T22:53:53.705579+0000 mon.a (mon.0) 2339 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi113-63841-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:53:55.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[28910]: cluster 2024-04-19T22:53:53.713176+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-04-19T22:53:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[28910]: audit 2024-04-19T22:53:53.717421+0000 mon.c (mon.2) 582 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[28910]: audit 2024-04-19T22:53:53.721592+0000 mon.a (mon.0) 2341 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:55 smithi113 bash[28910]: cluster 2024-04-19T22:53:53.917039+0000 mgr.y (mgr.24389) 351 : cluster 0 pgmap v482: 228 pgs: 6 creating+activating, 222 active+clean; 8.4 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.019612+0000 mgr.y (mgr.24389) 352 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: cluster 2024-04-19T22:53:55.159942+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.202212+0000 mon.c (mon.2) 583 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.202795+0000 mon.a (mon.0) 2343 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.203650+0000 mon.c (mon.2) 584 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.204184+0000 mon.a (mon.0) 2344 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.712135+0000 mon.a (mon.0) 2345 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: audit 2024-04-19T22:53:55.712368+0000 mon.a (mon.0) 2346 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]': finished 2024-04-19T22:53:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[21528]: cluster 2024-04-19T22:53:55.720085+0000 mon.a (mon.0) 2347 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.019612+0000 mgr.y (mgr.24389) 352 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: cluster 2024-04-19T22:53:55.159942+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.202212+0000 mon.c (mon.2) 583 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.202795+0000 mon.a (mon.0) 2343 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.203650+0000 mon.c (mon.2) 584 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.204184+0000 mon.a (mon.0) 2344 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.712135+0000 mon.a (mon.0) 2345 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: audit 2024-04-19T22:53:55.712368+0000 mon.a (mon.0) 2346 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]': finished 2024-04-19T22:53:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:56 smithi113 bash[28910]: cluster 2024-04-19T22:53:55.720085+0000 mon.a (mon.0) 2347 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.019612+0000 mgr.y (mgr.24389) 352 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: cluster 2024-04-19T22:53:55.159942+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.202212+0000 mon.c (mon.2) 583 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.202795+0000 mon.a (mon.0) 2343 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.203650+0000 mon.c (mon.2) 584 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.204184+0000 mon.a (mon.0) 2344 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]: dispatch 2024-04-19T22:53:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.712135+0000 mon.a (mon.0) 2345 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi113-63841-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:53:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: audit 2024-04-19T22:53:55.712368+0000 mon.a (mon.0) 2346 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-41"}]': finished 2024-04-19T22:53:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:56 smithi178 bash[23441]: cluster 2024-04-19T22:53:55.720085+0000 mon.a (mon.0) 2347 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-04-19T22:53:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[28910]: cluster 2024-04-19T22:53:55.917897+0000 mgr.y (mgr.24389) 353 : cluster 0 pgmap v485: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[28910]: cluster 2024-04-19T22:53:56.712054+0000 mon.a (mon.0) 2348 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[28910]: cluster 2024-04-19T22:53:56.730676+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-04-19T22:53:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[21528]: cluster 2024-04-19T22:53:55.917897+0000 mgr.y (mgr.24389) 353 : cluster 0 pgmap v485: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[21528]: cluster 2024-04-19T22:53:56.712054+0000 mon.a (mon.0) 2348 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[21528]: cluster 2024-04-19T22:53:56.730676+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-04-19T22:53:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:57 smithi178 bash[23441]: cluster 2024-04-19T22:53:55.917897+0000 mgr.y (mgr.24389) 353 : cluster 0 pgmap v485: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:57 smithi178 bash[23441]: cluster 2024-04-19T22:53:56.712054+0000 mon.a (mon.0) 2348 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:53:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:57 smithi178 bash[23441]: cluster 2024-04-19T22:53:56.730676+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-04-19T22:53:57.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:53:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:53:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:53:59.045 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: cluster 2024-04-19T22:53:57.732797+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: audit 2024-04-19T22:53:57.738775+0000 mon.c (mon.2) 585 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: audit 2024-04-19T22:53:57.739323+0000 mon.c (mon.2) 586 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: audit 2024-04-19T22:53:57.740541+0000 mon.a (mon.0) 2351 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: audit 2024-04-19T22:53:57.740976+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[21528]: cluster 2024-04-19T22:53:57.918814+0000 mgr.y (mgr.24389) 354 : cluster 0 pgmap v488: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: cluster 2024-04-19T22:53:57.732797+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: audit 2024-04-19T22:53:57.738775+0000 mon.c (mon.2) 585 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: audit 2024-04-19T22:53:57.739323+0000 mon.c (mon.2) 586 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: audit 2024-04-19T22:53:57.740541+0000 mon.a (mon.0) 2351 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: audit 2024-04-19T22:53:57.740976+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:58 smithi113 bash[28910]: cluster 2024-04-19T22:53:57.918814+0000 mgr.y (mgr.24389) 354 : cluster 0 pgmap v488: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: cluster 2024-04-19T22:53:57.732797+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: audit 2024-04-19T22:53:57.738775+0000 mon.c (mon.2) 585 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: audit 2024-04-19T22:53:57.739323+0000 mon.c (mon.2) 586 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: audit 2024-04-19T22:53:57.740541+0000 mon.a (mon.0) 2351 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: audit 2024-04-19T22:53:57.740976+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:53:59.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:58 smithi178 bash[23441]: cluster 2024-04-19T22:53:57.918814+0000 mgr.y (mgr.24389) 354 : cluster 0 pgmap v488: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.736072+0000 mon.a (mon.0) 2353 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.736318+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: cluster 2024-04-19T22:53:58.748277+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.751681+0000 mon.c (mon.2) 587 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.753129+0000 mon.a (mon.0) 2356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.756392+0000 mon.c (mon.2) 588 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-6","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.757913+0000 mon.c (mon.2) 589 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[21528]: audit 2024-04-19T22:53:58.759572+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:00.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.736072+0000 mon.a (mon.0) 2353 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.736318+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: cluster 2024-04-19T22:53:58.748277+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.751681+0000 mon.c (mon.2) 587 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.753129+0000 mon.a (mon.0) 2356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.756392+0000 mon.c (mon.2) 588 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-6","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.757913+0000 mon.c (mon.2) 589 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:53:59 smithi113 bash[28910]: audit 2024-04-19T22:53:58.759572+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.736072+0000 mon.a (mon.0) 2353 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.736318+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: cluster 2024-04-19T22:53:58.748277+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-04-19T22:54:00.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.751681+0000 mon.c (mon.2) 587 : audit 1 from='client.? 172.21.15.113:0/1668696052' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.753129+0000 mon.a (mon.0) 2356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]: dispatch 2024-04-19T22:54:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.756392+0000 mon.c (mon.2) 588 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-6","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.757913+0000 mon.c (mon.2) 589 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:53:59 smithi178 bash[23441]: audit 2024-04-19T22:53:58.759572+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.739968+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.740229+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: cluster 2024-04-19T22:53:59.748072+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.751251+0000 mon.c (mon.2) 590 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.753173+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.774522+0000 mon.a (mon.0) 2362 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.776065+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:53:59.776511+0000 mon.a (mon.0) 2364 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: cluster 2024-04-19T22:53:59.920423+0000 mgr.y (mgr.24389) 355 : cluster 0 pgmap v491: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:54:00.742602+0000 mon.a (mon.0) 2365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]': finished 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:54:00.742822+0000 mon.a (mon.0) 2366 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: cluster 2024-04-19T22:54:00.750518+0000 mon.a (mon.0) 2367 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[28910]: audit 2024-04-19T22:54:00.752217+0000 mon.a (mon.0) 2368 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.739968+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.740229+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: cluster 2024-04-19T22:53:59.748072+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.751251+0000 mon.c (mon.2) 590 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.753173+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.774522+0000 mon.a (mon.0) 2362 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.776065+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:53:59.776511+0000 mon.a (mon.0) 2364 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: cluster 2024-04-19T22:53:59.920423+0000 mgr.y (mgr.24389) 355 : cluster 0 pgmap v491: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:54:00.742602+0000 mon.a (mon.0) 2365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]': finished 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:54:00.742822+0000 mon.a (mon.0) 2366 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: cluster 2024-04-19T22:54:00.750518+0000 mon.a (mon.0) 2367 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-04-19T22:54:01.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:00 smithi113 bash[21528]: audit 2024-04-19T22:54:00.752217+0000 mon.a (mon.0) 2368 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.739968+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi113-63841-56"}]': finished 2024-04-19T22:54:01.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.740229+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:01.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: cluster 2024-04-19T22:53:59.748072+0000 mon.a (mon.0) 2360 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.751251+0000 mon.c (mon.2) 590 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.753173+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]: dispatch 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.774522+0000 mon.a (mon.0) 2362 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.776065+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:53:59.776511+0000 mon.a (mon.0) 2364 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: cluster 2024-04-19T22:53:59.920423+0000 mgr.y (mgr.24389) 355 : cluster 0 pgmap v491: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:54:00.742602+0000 mon.a (mon.0) 2365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_count","val": "8"}]': finished 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:54:00.742822+0000 mon.a (mon.0) 2366 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi113-63841-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: cluster 2024-04-19T22:54:00.750518+0000 mon.a (mon.0) 2367 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-04-19T22:54:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:00 smithi178 bash[23441]: audit 2024-04-19T22:54:00.752217+0000 mon.a (mon.0) 2368 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:02.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[21528]: audit 2024-04-19T22:54:00.754361+0000 mon.c (mon.2) 591 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[21528]: audit 2024-04-19T22:54:00.756114+0000 mon.a (mon.0) 2369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[21528]: audit 2024-04-19T22:54:01.745836+0000 mon.a (mon.0) 2370 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:02.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[28910]: audit 2024-04-19T22:54:00.754361+0000 mon.c (mon.2) 591 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[28910]: audit 2024-04-19T22:54:00.756114+0000 mon.a (mon.0) 2369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:02 smithi113 bash[28910]: audit 2024-04-19T22:54:01.745836+0000 mon.a (mon.0) 2370 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:02 smithi178 bash[23441]: audit 2024-04-19T22:54:00.754361+0000 mon.c (mon.2) 591 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:02 smithi178 bash[23441]: audit 2024-04-19T22:54:00.756114+0000 mon.a (mon.0) 2369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:02 smithi178 bash[23441]: audit 2024-04-19T22:54:01.745836+0000 mon.a (mon.0) 2370 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: ok, hit_set contains 275:602f83fe:::foo:head 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (8618 ms) 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg_num = 32 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 0 ls 1713567243,0 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 1 ls 1713567243,0 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 2 ls 1713567243,0 2024-04-19T22:54:03.341 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 3 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 4 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 5 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 6 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 7 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 8 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 9 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 10 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 11 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 12 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 13 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 14 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 15 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 16 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 17 ls 1713567243,0 2024-04-19T22:54:03.342 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 18 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 19 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 20 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 21 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 22 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 23 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 24 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 25 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 26 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 27 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 28 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 29 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 30 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg 31 ls 1713567243,0 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: pg_num = 32 2024-04-19T22:54:03.343 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6cac518f:::0:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:02547ec2:::1:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f905c69b:::2:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:cfc208b3:::3:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d83876eb:::4:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b29083e3:::5:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c4fdafeb:::6:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:5c6b0b28:::7:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:bd63b0f1:::8:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e960b815:::9:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:52ea6a34:::10:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:89d3ae78:::11:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:de5d7c5f:::12:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:566253c9:::13:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:62a1935d:::14:head 2024-04-19T22:54:03.344 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:863748b0:::15:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3958e169:::16:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4d4dabf9:::17:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:8391935d:::18:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:28883081:::19:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:69259c59:::20:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4bdb80b7:::21:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a11c5d71:::22:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:271af37b:::23:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:95b121be:::24:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:58d1031b:::25:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:0a050783:::26:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c709704c:::27:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:cbe56eaf:::28:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:86b4b162:::29:head 2024-04-19T22:54:03.345 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:70d89383:::30:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:dd450c7c:::31:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6d5729b1:::32:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c388f3fb:::33:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:56cfea31:::34:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9dbc1bf7:::35:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:40b74ccd:::36:head 2024-04-19T22:54:03.346 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4d5aaf42:::37:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:920f362c:::38:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6cc53222:::39:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9cad833f:::40:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:1ea84d41:::41:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c4480ef6:::42:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a694361e:::43:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d1bd33e9:::44:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ddc2cd5d:::45:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:2b782207:::46:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7b187fca:::47:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:90ecdf6f:::48:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a5ed95fe:::49:head 2024-04-19T22:54:03.347 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ea0eaa55:::50:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f33ef17b:::51:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a0d1b2f6:::52:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:60c5229e:::53:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:edcbc575:::54:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:102cf253:::55:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:efb7fb0b:::56:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:50d0a326:::57:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d4dc5daf:::58:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3a130462:::59:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ec87ed71:::60:head 2024-04-19T22:54:03.348 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d5bc9454:::61:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3ddfe313:::62:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7c2816b9:::63:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:47e00e4d:::64:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c6410c18:::65:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b48ed237:::66:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:cd63ad31:::67:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b179e92b:::68:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:0d9f741a:::69:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6d3352ae:::70:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c6d5c19e:::71:head 2024-04-19T22:54:03.349 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:bc4729c3:::72:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:77e930b9:::73:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:0abeecfd:::74:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b7c37e15:::75:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b6378398:::76:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:02bd68de:::77:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:cc795d2d:::78:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:630d4fea:::79:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e0d29ef5:::80:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:fd6f13d2:::81:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:606461d5:::82:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:eadbdc43:::83:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:8761d0bb:::84:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9ef0186f:::85:head 2024-04-19T22:54:03.350 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e0d41294:::86:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:961de695:::87:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:1423148f:::88:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:633a8fa2:::89:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a8653809:::90:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3dac8b33:::91:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:35aad435:::92:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f6dcc343:::93:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:dbbdad87:::94:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:1cb48ce0:::95:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:03cd461c:::96:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:17a4ea99:::97:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9993c9a7:::98:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6394211c:::99:head 2024-04-19T22:54:03.351 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:94c7ae57:::100:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6fdee5bb:::101:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9a477fd1:::102:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:eb850916:::103:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:affc56b9:::104:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b42dc814:::105:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f319f8f0:::106:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9a40b9de:::107:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:8b524f28:::108:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e3de589f:::109:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:90f90a5b:::110:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a7b4f1d7:::111:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:af51766e:::112:head 2024-04-19T22:54:03.352 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b6f90bd1:::113:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e0261208:::114:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c9569ef7:::115:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:61bebe50:::116:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:fe93412b:::117:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d3d38bee:::118:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3100ba0c:::119:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d0560ada:::120:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f0ea8b35:::121:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:766f231a:::122:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a07a2582:::123:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:bd7c6b3a:::124:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:fb2ddaff:::125:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4408e1fe:::126:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ee1df7a7:::127:head 2024-04-19T22:54:03.353 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c3002909:::128:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4f48ffa9:::129:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:edf38733:::130:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c08425c0:::131:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:5f902d98:::132:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:41ea2c93:::133:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:813cee13:::134:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:0131818d:::135:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:26ba5a85:::136:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:381b8a5a:::137:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:28797e47:::138:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:bfca7f22:::139:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:36807075:::140:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:80b03975:::141:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:5c15709b:::142:head 2024-04-19T22:54:03.354 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f39ea15e:::143:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ea992956:::144:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:48887b1c:::145:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:9f24a9dd:::146:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:987f100b:::147:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d2dd3581:::148:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7fed1808:::149:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c80b70e9:::150:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:85ed90f9:::151:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:36428b24:::152:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d044c34a:::153:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7c18bf58:::154:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d1c21232:::155:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a7a3c575:::156:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:87da0633:::157:head 2024-04-19T22:54:03.355 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d5ac3822:::158:head 2024-04-19T22:54:03.356 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3f20522d:::159:head 2024-04-19T22:54:03.356 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6ca26563:::160:head 2024-04-19T22:54:03.356 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:532ce135:::161:head 2024-04-19T22:54:03.356 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:c78863e6:::162:head 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: audit 2024-04-19T22:54:01.755006+0000 mon.c (mon.2) 592 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: cluster 2024-04-19T22:54:01.921197+0000 mgr.y (mgr.24389) 356 : cluster 0 pgmap v494: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: cluster 2024-04-19T22:54:02.195591+0000 mon.a (mon.0) 2371 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: audit 2024-04-19T22:54:02.196906+0000 mon.a (mon.0) 2372 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: audit 2024-04-19T22:54:02.754677+0000 mon.a (mon.0) 2373 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: audit 2024-04-19T22:54:02.754914+0000 mon.a (mon.0) 2374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[28910]: cluster 2024-04-19T22:54:02.760834+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-04-19T22:54:03.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: audit 2024-04-19T22:54:01.755006+0000 mon.c (mon.2) 592 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: cluster 2024-04-19T22:54:01.921197+0000 mgr.y (mgr.24389) 356 : cluster 0 pgmap v494: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: cluster 2024-04-19T22:54:02.195591+0000 mon.a (mon.0) 2371 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: audit 2024-04-19T22:54:02.196906+0000 mon.a (mon.0) 2372 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: audit 2024-04-19T22:54:02.754677+0000 mon.a (mon.0) 2373 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: audit 2024-04-19T22:54:02.754914+0000 mon.a (mon.0) 2374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-19T22:54:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:03 smithi113 bash[21528]: cluster 2024-04-19T22:54:02.760834+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-04-19T22:54:03.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: audit 2024-04-19T22:54:01.755006+0000 mon.c (mon.2) 592 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: cluster 2024-04-19T22:54:01.921197+0000 mgr.y (mgr.24389) 356 : cluster 0 pgmap v494: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: cluster 2024-04-19T22:54:02.195591+0000 mon.a (mon.0) 2371 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: audit 2024-04-19T22:54:02.196906+0000 mon.a (mon.0) 2372 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: audit 2024-04-19T22:54:02.754677+0000 mon.a (mon.0) 2373 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi113-63841-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: audit 2024-04-19T22:54:02.754914+0000 mon.a (mon.0) 2374 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-04-19T22:54:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:03 smithi178 bash[23441]: cluster 2024-04-19T22:54:02.760834+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.343986+0000 mon.c (mon.2) 593 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-43","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.609877+0000 mon.a (mon.0) 2376 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.659385+0000 mon.c (mon.2) 594 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.660298+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.661742+0000 mon.c (mon.2) 595 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.662629+0000 mon.a (mon.0) 2378 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: audit 2024-04-19T22:54:03.757786+0000 mon.a (mon.0) 2379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]': finished 2024-04-19T22:54:04.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[21528]: cluster 2024-04-19T22:54:03.768272+0000 mon.a (mon.0) 2380 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.343986+0000 mon.c (mon.2) 593 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-43","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.609877+0000 mon.a (mon.0) 2376 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.659385+0000 mon.c (mon.2) 594 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.660298+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.661742+0000 mon.c (mon.2) 595 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.662629+0000 mon.a (mon.0) 2378 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: audit 2024-04-19T22:54:03.757786+0000 mon.a (mon.0) 2379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]': finished 2024-04-19T22:54:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:04 smithi113 bash[28910]: cluster 2024-04-19T22:54:03.768272+0000 mon.a (mon.0) 2380 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-04-19T22:54:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.343986+0000 mon.c (mon.2) 593 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi113-63998-43","var": "pg_num","format": "json"}]: dispatch 2024-04-19T22:54:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.609877+0000 mon.a (mon.0) 2376 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.659385+0000 mon.c (mon.2) 594 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.660298+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:04.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.661742+0000 mon.c (mon.2) 595 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.662629+0000 mon.a (mon.0) 2378 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]: dispatch 2024-04-19T22:54:04.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: audit 2024-04-19T22:54:03.757786+0000 mon.a (mon.0) 2379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-43"}]': finished 2024-04-19T22:54:04.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:04 smithi178 bash[23441]: cluster 2024-04-19T22:54:03.768272+0000 mon.a (mon.0) 2380 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-04-19T22:54:05.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:05 smithi178 bash[23441]: cluster 2024-04-19T22:54:03.921934+0000 mgr.y (mgr.24389) 357 : cluster 0 pgmap v497: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:05.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:05 smithi178 bash[23441]: cluster 2024-04-19T22:54:04.757822+0000 mon.a (mon.0) 2381 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:05.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:05 smithi178 bash[23441]: cluster 2024-04-19T22:54:04.776682+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-04-19T22:54:05.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:05 smithi178 bash[23441]: audit 2024-04-19T22:54:04.779065+0000 mon.a (mon.0) 2383 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:05.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[21528]: cluster 2024-04-19T22:54:03.921934+0000 mgr.y (mgr.24389) 357 : cluster 0 pgmap v497: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[21528]: cluster 2024-04-19T22:54:04.757822+0000 mon.a (mon.0) 2381 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[21528]: cluster 2024-04-19T22:54:04.776682+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[21528]: audit 2024-04-19T22:54:04.779065+0000 mon.a (mon.0) 2383 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[28910]: cluster 2024-04-19T22:54:03.921934+0000 mgr.y (mgr.24389) 357 : cluster 0 pgmap v497: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[28910]: cluster 2024-04-19T22:54:04.757822+0000 mon.a (mon.0) 2381 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[28910]: cluster 2024-04-19T22:54:04.776682+0000 mon.a (mon.0) 2382 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-04-19T22:54:05.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:05 smithi113 bash[28910]: audit 2024-04-19T22:54:04.779065+0000 mon.a (mon.0) 2383 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:06.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: audit 2024-04-19T22:54:05.031066+0000 mgr.y (mgr.24389) 358 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: audit 2024-04-19T22:54:05.772070+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: cluster 2024-04-19T22:54:05.779586+0000 mon.a (mon.0) 2385 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: audit 2024-04-19T22:54:05.783864+0000 mon.c (mon.2) 596 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: audit 2024-04-19T22:54:05.787395+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[28910]: audit 2024-04-19T22:54:05.788652+0000 mon.a (mon.0) 2387 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: audit 2024-04-19T22:54:05.031066+0000 mgr.y (mgr.24389) 358 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: audit 2024-04-19T22:54:05.772070+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: cluster 2024-04-19T22:54:05.779586+0000 mon.a (mon.0) 2385 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-04-19T22:54:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: audit 2024-04-19T22:54:05.783864+0000 mon.c (mon.2) 596 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: audit 2024-04-19T22:54:05.787395+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:06 smithi113 bash[21528]: audit 2024-04-19T22:54:05.788652+0000 mon.a (mon.0) 2387 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: audit 2024-04-19T22:54:05.031066+0000 mgr.y (mgr.24389) 358 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: audit 2024-04-19T22:54:05.772070+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: cluster 2024-04-19T22:54:05.779586+0000 mon.a (mon.0) 2385 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-04-19T22:54:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: audit 2024-04-19T22:54:05.783864+0000 mon.c (mon.2) 596 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: audit 2024-04-19T22:54:05.787395+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]: dispatch 2024-04-19T22:54:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:06 smithi178 bash[23441]: audit 2024-04-19T22:54:05.788652+0000 mon.a (mon.0) 2387 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:07.545 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: cluster 2024-04-19T22:54:05.922786+0000 mgr.y (mgr.24389) 359 : cluster 0 pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.782801+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.782954+0000 mon.a (mon.0) 2389 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: cluster 2024-04-19T22:54:06.791341+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.796953+0000 mon.c (mon.2) 597 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.800216+0000 mon.a (mon.0) 2391 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.837231+0000 mon.c (mon.2) 598 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.838106+0000 mon.a (mon.0) 2392 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.839063+0000 mon.c (mon.2) 599 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.839383+0000 mon.a (mon.0) 2393 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.840131+0000 mon.c (mon.2) 600 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[21528]: audit 2024-04-19T22:54:06.840541+0000 mon.a (mon.0) 2394 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:07.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: cluster 2024-04-19T22:54:05.922786+0000 mgr.y (mgr.24389) 359 : cluster 0 pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.782801+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.782954+0000 mon.a (mon.0) 2389 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: cluster 2024-04-19T22:54:06.791341+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.796953+0000 mon.c (mon.2) 597 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.800216+0000 mon.a (mon.0) 2391 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.837231+0000 mon.c (mon.2) 598 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.838106+0000 mon.a (mon.0) 2392 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.839063+0000 mon.c (mon.2) 599 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.839383+0000 mon.a (mon.0) 2393 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.840131+0000 mon.c (mon.2) 600 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:07.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:07 smithi113 bash[28910]: audit 2024-04-19T22:54:06.840541+0000 mon.a (mon.0) 2394 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: cluster 2024-04-19T22:54:05.922786+0000 mgr.y (mgr.24389) 359 : cluster 0 pgmap v500: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.782801+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.113:0/1523399423' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi113-63841-57"}]': finished 2024-04-19T22:54:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.782954+0000 mon.a (mon.0) 2389 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: cluster 2024-04-19T22:54:06.791341+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-04-19T22:54:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.796953+0000 mon.c (mon.2) 597 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.800216+0000 mon.a (mon.0) 2391 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.837231+0000 mon.c (mon.2) 598 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.838106+0000 mon.a (mon.0) 2392 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.839063+0000 mon.c (mon.2) 599 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.839383+0000 mon.a (mon.0) 2393 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.840131+0000 mon.c (mon.2) 600 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:07.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:07 smithi178 bash[23441]: audit 2024-04-19T22:54:06.840541+0000 mon.a (mon.0) 2394 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:09.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.785530+0000 mon.a (mon.0) 2395 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:09.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.785721+0000 mon.a (mon.0) 2396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:09.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: cluster 2024-04-19T22:54:07.793185+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.798357+0000 mon.c (mon.2) 601 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.799999+0000 mon.a (mon.0) 2398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.800065+0000 mon.c (mon.2) 602 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: audit 2024-04-19T22:54:07.800651+0000 mon.a (mon.0) 2399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[21528]: cluster 2024-04-19T22:54:07.923577+0000 mgr.y (mgr.24389) 360 : cluster 0 pgmap v503: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.785530+0000 mon.a (mon.0) 2395 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.785721+0000 mon.a (mon.0) 2396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: cluster 2024-04-19T22:54:07.793185+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.798357+0000 mon.c (mon.2) 601 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.799999+0000 mon.a (mon.0) 2398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.800065+0000 mon.c (mon.2) 602 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: audit 2024-04-19T22:54:07.800651+0000 mon.a (mon.0) 2399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:09 smithi113 bash[28910]: cluster 2024-04-19T22:54:07.923577+0000 mgr.y (mgr.24389) 360 : cluster 0 pgmap v503: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.785530+0000 mon.a (mon.0) 2395 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.785721+0000 mon.a (mon.0) 2396 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi113-63841-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: cluster 2024-04-19T22:54:07.793185+0000 mon.a (mon.0) 2397 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-04-19T22:54:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.798357+0000 mon.c (mon.2) 601 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.799999+0000 mon.a (mon.0) 2398 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T22:54:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.800065+0000 mon.c (mon.2) 602 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: audit 2024-04-19T22:54:07.800651+0000 mon.a (mon.0) 2399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:09 smithi178 bash[23441]: cluster 2024-04-19T22:54:07.923577+0000 mgr.y (mgr.24389) 360 : cluster 0 pgmap v503: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:08.788602+0000 mon.a (mon.0) 2400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]': finished 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:08.797162+0000 mon.c (mon.2) 603 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: cluster 2024-04-19T22:54:09.240168+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:09.241574+0000 mon.a (mon.0) 2402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:09.791825+0000 mon.a (mon.0) 2403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:09.792022+0000 mon.a (mon.0) 2404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]': finished 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: cluster 2024-04-19T22:54:09.800854+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:09.806474+0000 mon.c (mon.2) 604 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:10.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[21528]: audit 2024-04-19T22:54:09.810016+0000 mon.a (mon.0) 2406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:08.788602+0000 mon.a (mon.0) 2400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]': finished 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:08.797162+0000 mon.c (mon.2) 603 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: cluster 2024-04-19T22:54:09.240168+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:09.241574+0000 mon.a (mon.0) 2402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:09.791825+0000 mon.a (mon.0) 2403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:09.792022+0000 mon.a (mon.0) 2404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]': finished 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: cluster 2024-04-19T22:54:09.800854+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:09.806474+0000 mon.c (mon.2) 604 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:10.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:10 smithi113 bash[28910]: audit 2024-04-19T22:54:09.810016+0000 mon.a (mon.0) 2406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:10.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:08.788602+0000 mon.a (mon.0) 2400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_count","val": "3"}]': finished 2024-04-19T22:54:10.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:08.797162+0000 mon.c (mon.2) 603 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: cluster 2024-04-19T22:54:09.240168+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:09.241574+0000 mon.a (mon.0) 2402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:09.791825+0000 mon.a (mon.0) 2403 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi113-63841-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:09.792022+0000 mon.a (mon.0) 2404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_period","val": "3"}]': finished 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: cluster 2024-04-19T22:54:09.800854+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-04-19T22:54:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:09.806474+0000 mon.c (mon.2) 604 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:10.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:10 smithi178 bash[23441]: audit 2024-04-19T22:54:09.810016+0000 mon.a (mon.0) 2406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:11.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: cluster 2024-04-19T22:54:09.924368+0000 mgr.y (mgr.24389) 361 : cluster 0 pgmap v506: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: cluster 2024-04-19T22:54:10.569933+0000 mon.a (mon.0) 2407 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: audit 2024-04-19T22:54:10.794529+0000 mon.a (mon.0) 2408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: cluster 2024-04-19T22:54:10.801641+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: audit 2024-04-19T22:54:10.805564+0000 mon.c (mon.2) 605 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[28910]: audit 2024-04-19T22:54:10.807157+0000 mon.a (mon.0) 2410 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: cluster 2024-04-19T22:54:09.924368+0000 mgr.y (mgr.24389) 361 : cluster 0 pgmap v506: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: cluster 2024-04-19T22:54:10.569933+0000 mon.a (mon.0) 2407 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: audit 2024-04-19T22:54:10.794529+0000 mon.a (mon.0) 2408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:11.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: cluster 2024-04-19T22:54:10.801641+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-04-19T22:54:11.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: audit 2024-04-19T22:54:10.805564+0000 mon.c (mon.2) 605 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:11.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:11 smithi113 bash[21528]: audit 2024-04-19T22:54:10.807157+0000 mon.a (mon.0) 2410 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: cluster 2024-04-19T22:54:09.924368+0000 mgr.y (mgr.24389) 361 : cluster 0 pgmap v506: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: cluster 2024-04-19T22:54:10.569933+0000 mon.a (mon.0) 2407 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: audit 2024-04-19T22:54:10.794529+0000 mon.a (mon.0) 2408 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: cluster 2024-04-19T22:54:10.801641+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-04-19T22:54:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: audit 2024-04-19T22:54:10.805564+0000 mon.c (mon.2) 605 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:11.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:11 smithi178 bash[23441]: audit 2024-04-19T22:54:10.807157+0000 mon.a (mon.0) 2410 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T22:54:13.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[28910]: audit 2024-04-19T22:54:11.797322+0000 mon.a (mon.0) 2411 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[28910]: cluster 2024-04-19T22:54:11.806910+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[28910]: audit 2024-04-19T22:54:11.810563+0000 mon.c (mon.2) 606 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[28910]: audit 2024-04-19T22:54:11.812211+0000 mon.a (mon.0) 2413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[28910]: cluster 2024-04-19T22:54:11.925229+0000 mgr.y (mgr.24389) 362 : cluster 0 pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[21528]: audit 2024-04-19T22:54:11.797322+0000 mon.a (mon.0) 2411 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[21528]: cluster 2024-04-19T22:54:11.806910+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[21528]: audit 2024-04-19T22:54:11.810563+0000 mon.c (mon.2) 606 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[21528]: audit 2024-04-19T22:54:11.812211+0000 mon.a (mon.0) 2413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:12 smithi113 bash[21528]: cluster 2024-04-19T22:54:11.925229+0000 mgr.y (mgr.24389) 362 : cluster 0 pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:13.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:12 smithi178 bash[23441]: audit 2024-04-19T22:54:11.797322+0000 mon.a (mon.0) 2411 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T22:54:13.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:12 smithi178 bash[23441]: cluster 2024-04-19T22:54:11.806910+0000 mon.a (mon.0) 2412 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-04-19T22:54:13.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:12 smithi178 bash[23441]: audit 2024-04-19T22:54:11.810563+0000 mon.c (mon.2) 606 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:12 smithi178 bash[23441]: audit 2024-04-19T22:54:11.812211+0000 mon.a (mon.0) 2413 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:13.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:12 smithi178 bash[23441]: cluster 2024-04-19T22:54:11.925229+0000 mgr.y (mgr.24389) 362 : cluster 0 pgmap v509: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:14.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[28910]: audit 2024-04-19T22:54:12.806758+0000 mon.a (mon.0) 2414 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:14.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[28910]: cluster 2024-04-19T22:54:12.816300+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-04-19T22:54:14.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[28910]: audit 2024-04-19T22:54:12.817699+0000 mon.c (mon.2) 607 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:14.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[28910]: audit 2024-04-19T22:54:12.818881+0000 mon.a (mon.0) 2416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:14.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[21528]: audit 2024-04-19T22:54:12.806758+0000 mon.a (mon.0) 2414 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:14.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[21528]: cluster 2024-04-19T22:54:12.816300+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-04-19T22:54:14.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[21528]: audit 2024-04-19T22:54:12.817699+0000 mon.c (mon.2) 607 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:14.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:13 smithi113 bash[21528]: audit 2024-04-19T22:54:12.818881+0000 mon.a (mon.0) 2416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:14.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:13 smithi178 bash[23441]: audit 2024-04-19T22:54:12.806758+0000 mon.a (mon.0) 2414 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:14.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:13 smithi178 bash[23441]: cluster 2024-04-19T22:54:12.816300+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-04-19T22:54:14.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:13 smithi178 bash[23441]: audit 2024-04-19T22:54:12.817699+0000 mon.c (mon.2) 607 : audit 1 from='client.? 172.21.15.113:0/305221110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:14.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:13 smithi178 bash[23441]: audit 2024-04-19T22:54:12.818881+0000 mon.a (mon.0) 2416 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.817562+0000 mon.a (mon.0) 2417 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: cluster 2024-04-19T22:54:13.824689+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.851744+0000 mon.c (mon.2) 608 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.852173+0000 mon.a (mon.0) 2419 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.852978+0000 mon.c (mon.2) 609 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.853307+0000 mon.a (mon.0) 2420 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.853859+0000 mon.c (mon.2) 610 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: audit 2024-04-19T22:54:13.854197+0000 mon.a (mon.0) 2421 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[21528]: cluster 2024-04-19T22:54:13.926056+0000 mgr.y (mgr.24389) 363 : cluster 0 pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.817562+0000 mon.a (mon.0) 2417 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: cluster 2024-04-19T22:54:13.824689+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.851744+0000 mon.c (mon.2) 608 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.852173+0000 mon.a (mon.0) 2419 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.852978+0000 mon.c (mon.2) 609 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.853307+0000 mon.a (mon.0) 2420 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.853859+0000 mon.c (mon.2) 610 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: audit 2024-04-19T22:54:13.854197+0000 mon.a (mon.0) 2421 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:14 smithi113 bash[28910]: cluster 2024-04-19T22:54:13.926056+0000 mgr.y (mgr.24389) 363 : cluster 0 pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:15.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.817562+0000 mon.a (mon.0) 2417 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi113-63841-58"}]': finished 2024-04-19T22:54:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: cluster 2024-04-19T22:54:13.824689+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-04-19T22:54:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.851744+0000 mon.c (mon.2) 608 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.852173+0000 mon.a (mon.0) 2419 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.852978+0000 mon.c (mon.2) 609 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.853307+0000 mon.a (mon.0) 2420 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.853859+0000 mon.c (mon.2) 610 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: audit 2024-04-19T22:54:13.854197+0000 mon.a (mon.0) 2421 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:14 smithi178 bash[23441]: cluster 2024-04-19T22:54:13.926056+0000 mgr.y (mgr.24389) 363 : cluster 0 pgmap v512: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:16.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[21528]: audit 2024-04-19T22:54:14.834900+0000 mon.a (mon.0) 2422 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[21528]: cluster 2024-04-19T22:54:14.844956+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[21528]: audit 2024-04-19T22:54:14.847256+0000 mon.c (mon.2) 611 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[21528]: audit 2024-04-19T22:54:14.849373+0000 mon.a (mon.0) 2424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[21528]: audit 2024-04-19T22:54:15.037351+0000 mgr.y (mgr.24389) 364 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[28910]: audit 2024-04-19T22:54:14.834900+0000 mon.a (mon.0) 2422 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[28910]: cluster 2024-04-19T22:54:14.844956+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[28910]: audit 2024-04-19T22:54:14.847256+0000 mon.c (mon.2) 611 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[28910]: audit 2024-04-19T22:54:14.849373+0000 mon.a (mon.0) 2424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:16 smithi113 bash[28910]: audit 2024-04-19T22:54:15.037351+0000 mgr.y (mgr.24389) 364 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:16 smithi178 bash[23441]: audit 2024-04-19T22:54:14.834900+0000 mon.a (mon.0) 2422 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:16 smithi178 bash[23441]: cluster 2024-04-19T22:54:14.844956+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-04-19T22:54:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:16 smithi178 bash[23441]: audit 2024-04-19T22:54:14.847256+0000 mon.c (mon.2) 611 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:16 smithi178 bash[23441]: audit 2024-04-19T22:54:14.849373+0000 mon.a (mon.0) 2424 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:16 smithi178 bash[23441]: audit 2024-04-19T22:54:15.037351+0000 mgr.y (mgr.24389) 364 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:17.545 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[28910]: cluster 2024-04-19T22:54:15.926882+0000 mgr.y (mgr.24389) 365 : cluster 0 pgmap v515: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[28910]: cluster 2024-04-19T22:54:16.288282+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[28910]: audit 2024-04-19T22:54:16.841497+0000 mon.a (mon.0) 2426 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[28910]: cluster 2024-04-19T22:54:16.849639+0000 mon.a (mon.0) 2427 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[21528]: cluster 2024-04-19T22:54:15.926882+0000 mgr.y (mgr.24389) 365 : cluster 0 pgmap v515: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[21528]: cluster 2024-04-19T22:54:16.288282+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[21528]: audit 2024-04-19T22:54:16.841497+0000 mon.a (mon.0) 2426 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:17.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:17 smithi113 bash[21528]: cluster 2024-04-19T22:54:16.849639+0000 mon.a (mon.0) 2427 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-04-19T22:54:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:17 smithi178 bash[23441]: cluster 2024-04-19T22:54:15.926882+0000 mgr.y (mgr.24389) 365 : cluster 0 pgmap v515: 228 pgs: 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:17 smithi178 bash[23441]: cluster 2024-04-19T22:54:16.288282+0000 mon.a (mon.0) 2425 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-04-19T22:54:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:17 smithi178 bash[23441]: audit 2024-04-19T22:54:16.841497+0000 mon.a (mon.0) 2426 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi113-63841-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:17 smithi178 bash[23441]: cluster 2024-04-19T22:54:16.849639+0000 mon.a (mon.0) 2427 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-04-19T22:54:19.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[28910]: cluster 2024-04-19T22:54:17.852072+0000 mon.a (mon.0) 2428 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-04-19T22:54:19.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[28910]: cluster 2024-04-19T22:54:17.927684+0000 mgr.y (mgr.24389) 366 : cluster 0 pgmap v518: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:19.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[28910]: audit 2024-04-19T22:54:18.645122+0000 mon.a (mon.0) 2429 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[21528]: cluster 2024-04-19T22:54:17.852072+0000 mon.a (mon.0) 2428 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-04-19T22:54:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[21528]: cluster 2024-04-19T22:54:17.927684+0000 mgr.y (mgr.24389) 366 : cluster 0 pgmap v518: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:19.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:18 smithi113 bash[21528]: audit 2024-04-19T22:54:18.645122+0000 mon.a (mon.0) 2429 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:19.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:18 smithi178 bash[23441]: cluster 2024-04-19T22:54:17.852072+0000 mon.a (mon.0) 2428 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-04-19T22:54:19.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:18 smithi178 bash[23441]: cluster 2024-04-19T22:54:17.927684+0000 mgr.y (mgr.24389) 366 : cluster 0 pgmap v518: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:19.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:18 smithi178 bash[23441]: audit 2024-04-19T22:54:18.645122+0000 mon.a (mon.0) 2429 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:20.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[28910]: cluster 2024-04-19T22:54:18.844111+0000 mon.a (mon.0) 2430 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[28910]: cluster 2024-04-19T22:54:18.870722+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[28910]: audit 2024-04-19T22:54:18.872903+0000 mon.c (mon.2) 612 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[28910]: audit 2024-04-19T22:54:18.873783+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[21528]: cluster 2024-04-19T22:54:18.844111+0000 mon.a (mon.0) 2430 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[21528]: cluster 2024-04-19T22:54:18.870722+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[21528]: audit 2024-04-19T22:54:18.872903+0000 mon.c (mon.2) 612 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:20.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:19 smithi113 bash[21528]: audit 2024-04-19T22:54:18.873783+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:20.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:19 smithi178 bash[23441]: cluster 2024-04-19T22:54:18.844111+0000 mon.a (mon.0) 2430 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:20.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:19 smithi178 bash[23441]: cluster 2024-04-19T22:54:18.870722+0000 mon.a (mon.0) 2431 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-04-19T22:54:20.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:19 smithi178 bash[23441]: audit 2024-04-19T22:54:18.872903+0000 mon.c (mon.2) 612 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:20.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:19 smithi178 bash[23441]: audit 2024-04-19T22:54:18.873783+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[21528]: audit 2024-04-19T22:54:19.859922+0000 mon.a (mon.0) 2433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:21.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[21528]: cluster 2024-04-19T22:54:19.867287+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[21528]: audit 2024-04-19T22:54:19.869079+0000 mon.c (mon.2) 613 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[21528]: audit 2024-04-19T22:54:19.870939+0000 mon.a (mon.0) 2435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[21528]: cluster 2024-04-19T22:54:19.928504+0000 mgr.y (mgr.24389) 367 : cluster 0 pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[28910]: audit 2024-04-19T22:54:19.859922+0000 mon.a (mon.0) 2433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[28910]: cluster 2024-04-19T22:54:19.867287+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[28910]: audit 2024-04-19T22:54:19.869079+0000 mon.c (mon.2) 613 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[28910]: audit 2024-04-19T22:54:19.870939+0000 mon.a (mon.0) 2435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:20 smithi113 bash[28910]: cluster 2024-04-19T22:54:19.928504+0000 mgr.y (mgr.24389) 367 : cluster 0 pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:21.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:20 smithi178 bash[23441]: audit 2024-04-19T22:54:19.859922+0000 mon.a (mon.0) 2433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:21.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:20 smithi178 bash[23441]: cluster 2024-04-19T22:54:19.867287+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-04-19T22:54:21.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:20 smithi178 bash[23441]: audit 2024-04-19T22:54:19.869079+0000 mon.c (mon.2) 613 : audit 1 from='client.? 172.21.15.113:0/1783115700' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:20 smithi178 bash[23441]: audit 2024-04-19T22:54:19.870939+0000 mon.a (mon.0) 2435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]: dispatch 2024-04-19T22:54:21.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:20 smithi178 bash[23441]: cluster 2024-04-19T22:54:19.928504+0000 mgr.y (mgr.24389) 367 : cluster 0 pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:22.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:21 smithi113 bash[21528]: audit 2024-04-19T22:54:20.863030+0000 mon.a (mon.0) 2436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:22.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:21 smithi113 bash[21528]: cluster 2024-04-19T22:54:20.870996+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-04-19T22:54:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:21 smithi113 bash[28910]: audit 2024-04-19T22:54:20.863030+0000 mon.a (mon.0) 2436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:22.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:21 smithi113 bash[28910]: cluster 2024-04-19T22:54:20.870996+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-04-19T22:54:22.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:21 smithi178 bash[23441]: audit 2024-04-19T22:54:20.863030+0000 mon.a (mon.0) 2436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi113-63841-59"}]': finished 2024-04-19T22:54:22.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:21 smithi178 bash[23441]: cluster 2024-04-19T22:54:20.870996+0000 mon.a (mon.0) 2437 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-04-19T22:54:23.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[21528]: cluster 2024-04-19T22:54:21.907854+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[21528]: audit 2024-04-19T22:54:21.914268+0000 mon.c (mon.2) 614 : audit 1 from='client.? 172.21.15.113:0/3148694043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[21528]: audit 2024-04-19T22:54:21.923717+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[21528]: cluster 2024-04-19T22:54:21.929885+0000 mgr.y (mgr.24389) 368 : cluster 0 pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[28910]: cluster 2024-04-19T22:54:21.907854+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[28910]: audit 2024-04-19T22:54:21.914268+0000 mon.c (mon.2) 614 : audit 1 from='client.? 172.21.15.113:0/3148694043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[28910]: audit 2024-04-19T22:54:21.923717+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:22 smithi113 bash[28910]: cluster 2024-04-19T22:54:21.929885+0000 mgr.y (mgr.24389) 368 : cluster 0 pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:23.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:22 smithi178 bash[23441]: cluster 2024-04-19T22:54:21.907854+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-04-19T22:54:23.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:22 smithi178 bash[23441]: audit 2024-04-19T22:54:21.914268+0000 mon.c (mon.2) 614 : audit 1 from='client.? 172.21.15.113:0/3148694043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:22 smithi178 bash[23441]: audit 2024-04-19T22:54:21.923717+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:23.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:22 smithi178 bash[23441]: cluster 2024-04-19T22:54:21.929885+0000 mgr.y (mgr.24389) 368 : cluster 0 pgmap v524: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:23.926 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7462ddf6:o.RoundTripAppendPP (3457 ms) 2024-04-19T22:54:23.926 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-04-19T22:54:23.926 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2521 ms) 2024-04-19T22:54:23.926 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-19T22:54:23.926 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3021 ms) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3021 ms) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: setting pool EIO 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: max_success 94, min_failed 95 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4065 ms) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3024 ms) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (164368 ms total) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3018 ms) 2024-04-19T22:54:23.927 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9484 ms) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14433 ms) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3024 ms) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29959 ms total) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3482 ms) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3482 ms total) 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-19T22:54:23.928 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13472 ms) 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6994 ms) 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7038 ms) 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7049 ms) 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3034 ms) 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-19T22:54:23.929 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7045 ms) 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6875 ms) 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7066 ms) 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7030 ms) 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7052 ms) 2024-04-19T22:54:23.930 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7042 ms) 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7032 ms) 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7048 ms) 2024-04-19T22:54:23.931 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-19T22:54:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:23 smithi113 bash[28910]: audit 2024-04-19T22:54:22.909951+0000 mon.a (mon.0) 2440 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:24.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:23 smithi113 bash[28910]: cluster 2024-04-19T22:54:22.920580+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-04-19T22:54:24.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:23 smithi113 bash[21528]: audit 2024-04-19T22:54:22.909951+0000 mon.a (mon.0) 2440 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:24.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:23 smithi113 bash[21528]: cluster 2024-04-19T22:54:22.920580+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-04-19T22:54:24.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:23 smithi178 bash[23441]: audit 2024-04-19T22:54:22.909951+0000 mon.a (mon.0) 2440 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi113-63841-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:24.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:23 smithi178 bash[23441]: cluster 2024-04-19T22:54:22.920580+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-04-19T22:54:25.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: cluster 2024-04-19T22:54:23.921422+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-04-19T22:54:25.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: cluster 2024-04-19T22:54:23.930724+0000 mgr.y (mgr.24389) 369 : cluster 0 pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:25.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.975724+0000 mon.c (mon.2) 615 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.976134+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.977022+0000 mon.c (mon.2) 616 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.977333+0000 mon.a (mon.0) 2444 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.977916+0000 mon.c (mon.2) 617 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.978225+0000 mon.a (mon.0) 2445 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.993153+0000 mon.c (mon.2) 618 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.993463+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.994042+0000 mon.c (mon.2) 619 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: audit 2024-04-19T22:54:23.994324+0000 mon.a (mon.0) 2447 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[28910]: cluster 2024-04-19T22:54:24.912830+0000 mon.a (mon.0) 2448 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: cluster 2024-04-19T22:54:23.921422+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: cluster 2024-04-19T22:54:23.930724+0000 mgr.y (mgr.24389) 369 : cluster 0 pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.975724+0000 mon.c (mon.2) 615 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.976134+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.977022+0000 mon.c (mon.2) 616 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.977333+0000 mon.a (mon.0) 2444 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.977916+0000 mon.c (mon.2) 617 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.978225+0000 mon.a (mon.0) 2445 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.993153+0000 mon.c (mon.2) 618 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.993463+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.994042+0000 mon.c (mon.2) 619 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: audit 2024-04-19T22:54:23.994324+0000 mon.a (mon.0) 2447 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:24 smithi113 bash[21528]: cluster 2024-04-19T22:54:24.912830+0000 mon.a (mon.0) 2448 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:25.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:25.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: cluster 2024-04-19T22:54:23.921422+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-04-19T22:54:25.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: cluster 2024-04-19T22:54:23.930724+0000 mgr.y (mgr.24389) 369 : cluster 0 pgmap v527: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.975724+0000 mon.c (mon.2) 615 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.976134+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.977022+0000 mon.c (mon.2) 616 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.977333+0000 mon.a (mon.0) 2444 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.977916+0000 mon.c (mon.2) 617 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.978225+0000 mon.a (mon.0) 2445 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.993153+0000 mon.c (mon.2) 618 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.993463+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.994042+0000 mon.c (mon.2) 619 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: audit 2024-04-19T22:54:23.994324+0000 mon.a (mon.0) 2447 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]: dispatch 2024-04-19T22:54:25.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:24 smithi178 bash[23441]: cluster 2024-04-19T22:54:24.912830+0000 mon.a (mon.0) 2448 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: audit 2024-04-19T22:54:24.946198+0000 mon.a (mon.0) 2449 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: audit 2024-04-19T22:54:24.946409+0000 mon.a (mon.0) 2450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]': finished 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: cluster 2024-04-19T22:54:24.955375+0000 mon.a (mon.0) 2451 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: audit 2024-04-19T22:54:24.957357+0000 mon.c (mon.2) 620 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: audit 2024-04-19T22:54:24.960293+0000 mon.a (mon.0) 2452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[21528]: audit 2024-04-19T22:54:25.047808+0000 mgr.y (mgr.24389) 370 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: audit 2024-04-19T22:54:24.946198+0000 mon.a (mon.0) 2449 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: audit 2024-04-19T22:54:24.946409+0000 mon.a (mon.0) 2450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]': finished 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: cluster 2024-04-19T22:54:24.955375+0000 mon.a (mon.0) 2451 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-04-19T22:54:26.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: audit 2024-04-19T22:54:24.957357+0000 mon.c (mon.2) 620 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: audit 2024-04-19T22:54:24.960293+0000 mon.a (mon.0) 2452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:25 smithi113 bash[28910]: audit 2024-04-19T22:54:25.047808+0000 mgr.y (mgr.24389) 370 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:26.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: audit 2024-04-19T22:54:24.946198+0000 mon.a (mon.0) 2449 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi113-63841-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:26.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: audit 2024-04-19T22:54:24.946409+0000 mon.a (mon.0) 2450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-45"}]': finished 2024-04-19T22:54:26.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: cluster 2024-04-19T22:54:24.955375+0000 mon.a (mon.0) 2451 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-04-19T22:54:26.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: audit 2024-04-19T22:54:24.957357+0000 mon.c (mon.2) 620 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: audit 2024-04-19T22:54:24.960293+0000 mon.a (mon.0) 2452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:26.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:25 smithi178 bash[23441]: audit 2024-04-19T22:54:25.047808+0000 mgr.y (mgr.24389) 370 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:27.295 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:26 smithi113 bash[21528]: cluster 2024-04-19T22:54:25.931485+0000 mgr.y (mgr.24389) 371 : cluster 0 pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:27.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:26 smithi113 bash[21528]: cluster 2024-04-19T22:54:26.413433+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-04-19T22:54:27.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:26 smithi113 bash[28910]: cluster 2024-04-19T22:54:25.931485+0000 mgr.y (mgr.24389) 371 : cluster 0 pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:27.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:26 smithi113 bash[28910]: cluster 2024-04-19T22:54:26.413433+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-04-19T22:54:27.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:26 smithi178 bash[23441]: cluster 2024-04-19T22:54:25.931485+0000 mgr.y (mgr.24389) 371 : cluster 0 pgmap v529: 228 pgs: 228 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-04-19T22:54:27.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:26 smithi178 bash[23441]: cluster 2024-04-19T22:54:26.413433+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-04-19T22:54:27.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:28.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: audit 2024-04-19T22:54:26.962915+0000 mon.a (mon.0) 2454 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:28.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: cluster 2024-04-19T22:54:26.980701+0000 mon.a (mon.0) 2455 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: audit 2024-04-19T22:54:26.991032+0000 mon.c (mon.2) 621 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: audit 2024-04-19T22:54:27.004626+0000 mon.a (mon.0) 2456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: audit 2024-04-19T22:54:27.965668+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[28910]: cluster 2024-04-19T22:54:27.975446+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: audit 2024-04-19T22:54:26.962915+0000 mon.a (mon.0) 2454 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: cluster 2024-04-19T22:54:26.980701+0000 mon.a (mon.0) 2455 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: audit 2024-04-19T22:54:26.991032+0000 mon.c (mon.2) 621 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: audit 2024-04-19T22:54:27.004626+0000 mon.a (mon.0) 2456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: audit 2024-04-19T22:54:27.965668+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:28.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:28 smithi113 bash[21528]: cluster 2024-04-19T22:54:27.975446+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-04-19T22:54:28.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: audit 2024-04-19T22:54:26.962915+0000 mon.a (mon.0) 2454 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi113-63841-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:28.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: cluster 2024-04-19T22:54:26.980701+0000 mon.a (mon.0) 2455 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-04-19T22:54:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: audit 2024-04-19T22:54:26.991032+0000 mon.c (mon.2) 621 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: audit 2024-04-19T22:54:27.004626+0000 mon.a (mon.0) 2456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: audit 2024-04-19T22:54:27.965668+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:28 smithi178 bash[23441]: cluster 2024-04-19T22:54:27.975446+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: cluster 2024-04-19T22:54:27.932268+0000 mgr.y (mgr.24389) 372 : cluster 0 pgmap v532: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.059829+0000 mon.c (mon.2) 622 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.060279+0000 mon.a (mon.0) 2459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.968554+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: cluster 2024-04-19T22:54:28.976862+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.982869+0000 mon.c (mon.2) 623 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.984131+0000 mon.a (mon.0) 2462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.986486+0000 mon.c (mon.2) 624 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:29.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[28910]: audit 2024-04-19T22:54:28.987376+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: cluster 2024-04-19T22:54:27.932268+0000 mgr.y (mgr.24389) 372 : cluster 0 pgmap v532: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.059829+0000 mon.c (mon.2) 622 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.060279+0000 mon.a (mon.0) 2459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.968554+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: cluster 2024-04-19T22:54:28.976862+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.982869+0000 mon.c (mon.2) 623 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.984131+0000 mon.a (mon.0) 2462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.986486+0000 mon.c (mon.2) 624 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:29.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:29 smithi113 bash[21528]: audit 2024-04-19T22:54:28.987376+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:29.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: cluster 2024-04-19T22:54:27.932268+0000 mgr.y (mgr.24389) 372 : cluster 0 pgmap v532: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:29.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.059829+0000 mon.c (mon.2) 622 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.060279+0000 mon.a (mon.0) 2459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.968554+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: cluster 2024-04-19T22:54:28.976862+0000 mon.a (mon.0) 2461 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.982869+0000 mon.c (mon.2) 623 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.984131+0000 mon.a (mon.0) 2462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.986486+0000 mon.c (mon.2) 624 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:29 smithi178 bash[23441]: audit 2024-04-19T22:54:28.987376+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: cluster 2024-04-19T22:54:29.934308+0000 mgr.y (mgr.24389) 373 : cluster 0 pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.971273+0000 mon.a (mon.0) 2464 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.971523+0000 mon.a (mon.0) 2465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: cluster 2024-04-19T22:54:29.978375+0000 mon.a (mon.0) 2466 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.983492+0000 mon.c (mon.2) 625 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.984214+0000 mon.c (mon.2) 626 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.984523+0000 mon.a (mon.0) 2467 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: audit 2024-04-19T22:54:29.985396+0000 mon.a (mon.0) 2468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[28910]: cluster 2024-04-19T22:54:30.028898+0000 mon.a (mon.0) 2469 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: cluster 2024-04-19T22:54:29.934308+0000 mgr.y (mgr.24389) 373 : cluster 0 pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.971273+0000 mon.a (mon.0) 2464 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.971523+0000 mon.a (mon.0) 2465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: cluster 2024-04-19T22:54:29.978375+0000 mon.a (mon.0) 2466 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.983492+0000 mon.c (mon.2) 625 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.984214+0000 mon.c (mon.2) 626 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.984523+0000 mon.a (mon.0) 2467 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: audit 2024-04-19T22:54:29.985396+0000 mon.a (mon.0) 2468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:30 smithi113 bash[21528]: cluster 2024-04-19T22:54:30.028898+0000 mon.a (mon.0) 2469 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:31.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: cluster 2024-04-19T22:54:29.934308+0000 mgr.y (mgr.24389) 373 : cluster 0 pgmap v535: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.971273+0000 mon.a (mon.0) 2464 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.971523+0000 mon.a (mon.0) 2465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: cluster 2024-04-19T22:54:29.978375+0000 mon.a (mon.0) 2466 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.983492+0000 mon.c (mon.2) 625 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.984214+0000 mon.c (mon.2) 626 : audit 1 from='client.? 172.21.15.113:0/4283172382' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.984523+0000 mon.a (mon.0) 2467 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]: dispatch 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: audit 2024-04-19T22:54:29.985396+0000 mon.a (mon.0) 2468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]: dispatch 2024-04-19T22:54:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:30 smithi178 bash[23441]: cluster 2024-04-19T22:54:30.028898+0000 mon.a (mon.0) 2469 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: cluster 2024-04-19T22:54:30.972211+0000 mon.a (mon.0) 2470 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:30.974725+0000 mon.a (mon.0) 2471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]': finished 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:30.975108+0000 mon.a (mon.0) 2472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: cluster 2024-04-19T22:54:30.984928+0000 mon.a (mon.0) 2473 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:30.985406+0000 mon.c (mon.2) 627 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:30.987198+0000 mon.a (mon.0) 2474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.017587+0000 mon.a (mon.0) 2475 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.018652+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.019103+0000 mon.a (mon.0) 2477 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.977457+0000 mon.a (mon.0) 2478 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.977704+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: cluster 2024-04-19T22:54:31.984870+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.986134+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.987099+0000 mon.c (mon.2) 628 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[28910]: audit 2024-04-19T22:54:31.987976+0000 mon.a (mon.0) 2482 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: cluster 2024-04-19T22:54:30.972211+0000 mon.a (mon.0) 2470 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:30.974725+0000 mon.a (mon.0) 2471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]': finished 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:30.975108+0000 mon.a (mon.0) 2472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:32.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: cluster 2024-04-19T22:54:30.984928+0000 mon.a (mon.0) 2473 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:30.985406+0000 mon.c (mon.2) 627 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:30.987198+0000 mon.a (mon.0) 2474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.017587+0000 mon.a (mon.0) 2475 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.018652+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.019103+0000 mon.a (mon.0) 2477 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.977457+0000 mon.a (mon.0) 2478 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.977704+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: cluster 2024-04-19T22:54:31.984870+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.986134+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.987099+0000 mon.c (mon.2) 628 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:32.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:31 smithi113 bash[21528]: audit 2024-04-19T22:54:31.987976+0000 mon.a (mon.0) 2482 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: cluster 2024-04-19T22:54:30.972211+0000 mon.a (mon.0) 2470 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:30.974725+0000 mon.a (mon.0) 2471 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-47", "mode": "writeback"}]': finished 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:30.975108+0000 mon.a (mon.0) 2472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi113-63841-61"}]': finished 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: cluster 2024-04-19T22:54:30.984928+0000 mon.a (mon.0) 2473 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:30.985406+0000 mon.c (mon.2) 627 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:30.987198+0000 mon.a (mon.0) 2474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.017587+0000 mon.a (mon.0) 2475 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.018652+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.019103+0000 mon.a (mon.0) 2477 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.977457+0000 mon.a (mon.0) 2478 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.977704+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: cluster 2024-04-19T22:54:31.984870+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.986134+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:32.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.987099+0000 mon.c (mon.2) 628 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:32.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:31 smithi178 bash[23441]: audit 2024-04-19T22:54:31.987976+0000 mon.a (mon.0) 2482 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:54:33.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:33 smithi113 bash[28910]: cluster 2024-04-19T22:54:31.935111+0000 mgr.y (mgr.24389) 374 : cluster 0 pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T22:54:33.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:33 smithi113 bash[28910]: audit 2024-04-19T22:54:32.980757+0000 mon.a (mon.0) 2483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:33.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:33 smithi113 bash[21528]: cluster 2024-04-19T22:54:31.935111+0000 mgr.y (mgr.24389) 374 : cluster 0 pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T22:54:33.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:33 smithi113 bash[21528]: audit 2024-04-19T22:54:32.980757+0000 mon.a (mon.0) 2483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:33.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:33 smithi178 bash[23441]: cluster 2024-04-19T22:54:31.935111+0000 mgr.y (mgr.24389) 374 : cluster 0 pgmap v538: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T22:54:33.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:33 smithi178 bash[23441]: audit 2024-04-19T22:54:32.980757+0000 mon.a (mon.0) 2483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:32.991566+0000 mon.c (mon.2) 629 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: cluster 2024-04-19T22:54:33.432001+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.433613+0000 mon.a (mon.0) 2485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.684684+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.687156+0000 mon.a (mon.0) 2487 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: cluster 2024-04-19T22:54:33.981369+0000 mon.a (mon.0) 2488 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.983844+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.984093+0000 mon.a (mon.0) 2490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: cluster 2024-04-19T22:54:33.989698+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-04-19T22:54:34.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.992807+0000 mon.c (mon.2) 630 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[21528]: audit 2024-04-19T22:54:33.994572+0000 mon.a (mon.0) 2492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:32.991566+0000 mon.c (mon.2) 629 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: cluster 2024-04-19T22:54:33.432001+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.433613+0000 mon.a (mon.0) 2485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.684684+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.687156+0000 mon.a (mon.0) 2487 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: cluster 2024-04-19T22:54:33.981369+0000 mon.a (mon.0) 2488 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.983844+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.984093+0000 mon.a (mon.0) 2490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: cluster 2024-04-19T22:54:33.989698+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.992807+0000 mon.c (mon.2) 630 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:34.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:34 smithi113 bash[28910]: audit 2024-04-19T22:54:33.994572+0000 mon.a (mon.0) 2492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:34.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:32.991566+0000 mon.c (mon.2) 629 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: cluster 2024-04-19T22:54:33.432001+0000 mon.a (mon.0) 2484 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.433613+0000 mon.a (mon.0) 2485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.684684+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.687156+0000 mon.a (mon.0) 2487 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: cluster 2024-04-19T22:54:33.981369+0000 mon.a (mon.0) 2488 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.983844+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi113-63841-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.984093+0000 mon.a (mon.0) 2490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: cluster 2024-04-19T22:54:33.989698+0000 mon.a (mon.0) 2491 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.992807+0000 mon.c (mon.2) 630 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:34 smithi178 bash[23441]: audit 2024-04-19T22:54:33.994572+0000 mon.a (mon.0) 2492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:54:35.304 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:35.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[28910]: cluster 2024-04-19T22:54:33.935939+0000 mgr.y (mgr.24389) 375 : cluster 0 pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[28910]: audit 2024-04-19T22:54:34.986620+0000 mon.a (mon.0) 2493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[28910]: cluster 2024-04-19T22:54:34.993873+0000 mon.a (mon.0) 2494 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[28910]: audit 2024-04-19T22:54:35.001654+0000 mon.c (mon.2) 631 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[28910]: audit 2024-04-19T22:54:35.003948+0000 mon.a (mon.0) 2495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[21528]: cluster 2024-04-19T22:54:33.935939+0000 mgr.y (mgr.24389) 375 : cluster 0 pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[21528]: audit 2024-04-19T22:54:34.986620+0000 mon.a (mon.0) 2493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[21528]: cluster 2024-04-19T22:54:34.993873+0000 mon.a (mon.0) 2494 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[21528]: audit 2024-04-19T22:54:35.001654+0000 mon.c (mon.2) 631 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:35.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:35 smithi113 bash[21528]: audit 2024-04-19T22:54:35.003948+0000 mon.a (mon.0) 2495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:35.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[23441]: cluster 2024-04-19T22:54:33.935939+0000 mgr.y (mgr.24389) 375 : cluster 0 pgmap v541: 228 pgs: 228 active+clean; 8.4 MiB data, 608 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:35.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[23441]: audit 2024-04-19T22:54:34.986620+0000 mon.a (mon.0) 2493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:54:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[23441]: cluster 2024-04-19T22:54:34.993873+0000 mon.a (mon.0) 2494 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-04-19T22:54:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[23441]: audit 2024-04-19T22:54:35.001654+0000 mon.c (mon.2) 631 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:35 smithi178 bash[23441]: audit 2024-04-19T22:54:35.003948+0000 mon.a (mon.0) 2495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T22:54:36.795 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: audit 2024-04-19T22:54:35.055866+0000 mgr.y (mgr.24389) 376 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: audit 2024-04-19T22:54:35.989271+0000 mon.a (mon.0) 2496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: cluster 2024-04-19T22:54:35.997133+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: audit 2024-04-19T22:54:35.998076+0000 mon.c (mon.2) 632 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: audit 2024-04-19T22:54:36.003849+0000 mon.a (mon.0) 2498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[28910]: audit 2024-04-19T22:54:36.005394+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: audit 2024-04-19T22:54:35.055866+0000 mgr.y (mgr.24389) 376 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: audit 2024-04-19T22:54:35.989271+0000 mon.a (mon.0) 2496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: cluster 2024-04-19T22:54:35.997133+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-04-19T22:54:36.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: audit 2024-04-19T22:54:35.998076+0000 mon.c (mon.2) 632 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: audit 2024-04-19T22:54:36.003849+0000 mon.a (mon.0) 2498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:36 smithi113 bash[21528]: audit 2024-04-19T22:54:36.005394+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: audit 2024-04-19T22:54:35.055866+0000 mgr.y (mgr.24389) 376 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: audit 2024-04-19T22:54:35.989271+0000 mon.a (mon.0) 2496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T22:54:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: cluster 2024-04-19T22:54:35.997133+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-04-19T22:54:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: audit 2024-04-19T22:54:35.998076+0000 mon.c (mon.2) 632 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: audit 2024-04-19T22:54:36.003849+0000 mon.a (mon.0) 2498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T22:54:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:36 smithi178 bash[23441]: audit 2024-04-19T22:54:36.005394+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:37.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: cluster 2024-04-19T22:54:35.936807+0000 mgr.y (mgr.24389) 377 : cluster 0 pgmap v544: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: cluster 2024-04-19T22:54:36.440564+0000 mon.a (mon.0) 2500 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: audit 2024-04-19T22:54:36.991923+0000 mon.a (mon.0) 2501 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: audit 2024-04-19T22:54:36.992191+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: cluster 2024-04-19T22:54:36.998510+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: audit 2024-04-19T22:54:37.000132+0000 mon.a (mon.0) 2504 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: audit 2024-04-19T22:54:37.092792+0000 mon.c (mon.2) 633 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[21528]: audit 2024-04-19T22:54:37.093480+0000 mon.a (mon.0) 2505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: cluster 2024-04-19T22:54:35.936807+0000 mgr.y (mgr.24389) 377 : cluster 0 pgmap v544: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: cluster 2024-04-19T22:54:36.440564+0000 mon.a (mon.0) 2500 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: audit 2024-04-19T22:54:36.991923+0000 mon.a (mon.0) 2501 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: audit 2024-04-19T22:54:36.992191+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: cluster 2024-04-19T22:54:36.998510+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: audit 2024-04-19T22:54:37.000132+0000 mon.a (mon.0) 2504 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: audit 2024-04-19T22:54:37.092792+0000 mon.c (mon.2) 633 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:37 smithi113 bash[28910]: audit 2024-04-19T22:54:37.093480+0000 mon.a (mon.0) 2505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: cluster 2024-04-19T22:54:35.936807+0000 mgr.y (mgr.24389) 377 : cluster 0 pgmap v544: 236 pgs: 8 creating+peering, 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: cluster 2024-04-19T22:54:36.440564+0000 mon.a (mon.0) 2500 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: audit 2024-04-19T22:54:36.991923+0000 mon.a (mon.0) 2501 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T22:54:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: audit 2024-04-19T22:54:36.992191+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: cluster 2024-04-19T22:54:36.998510+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-04-19T22:54:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: audit 2024-04-19T22:54:37.000132+0000 mon.a (mon.0) 2504 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]: dispatch 2024-04-19T22:54:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: audit 2024-04-19T22:54:37.092792+0000 mon.c (mon.2) 633 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:37 smithi178 bash[23441]: audit 2024-04-19T22:54:37.093480+0000 mon.a (mon.0) 2505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: cluster 2024-04-19T22:54:37.937579+0000 mgr.y (mgr.24389) 378 : cluster 0 pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:37.995235+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:37.995451+0000 mon.a (mon.0) 2507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: cluster 2024-04-19T22:54:38.003224+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.006017+0000 mon.c (mon.2) 634 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.007484+0000 mon.a (mon.0) 2509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.036301+0000 mon.c (mon.2) 635 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.036734+0000 mon.a (mon.0) 2510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.037620+0000 mon.c (mon.2) 636 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.037992+0000 mon.a (mon.0) 2511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.039213+0000 mon.c (mon.2) 637 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[28910]: audit 2024-04-19T22:54:38.039647+0000 mon.a (mon.0) 2512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: cluster 2024-04-19T22:54:37.937579+0000 mgr.y (mgr.24389) 378 : cluster 0 pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:37.995235+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:37.995451+0000 mon.a (mon.0) 2507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: cluster 2024-04-19T22:54:38.003224+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.006017+0000 mon.c (mon.2) 634 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.007484+0000 mon.a (mon.0) 2509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.036301+0000 mon.c (mon.2) 635 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.036734+0000 mon.a (mon.0) 2510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.037620+0000 mon.c (mon.2) 636 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.037992+0000 mon.a (mon.0) 2511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.039213+0000 mon.c (mon.2) 637 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:39.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:39 smithi113 bash[21528]: audit 2024-04-19T22:54:38.039647+0000 mon.a (mon.0) 2512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:39.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: cluster 2024-04-19T22:54:37.937579+0000 mgr.y (mgr.24389) 378 : cluster 0 pgmap v547: 228 pgs: 228 active+clean; 8.4 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:37.995235+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.113:0/2937841632' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi113-63841-62"}]': finished 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:37.995451+0000 mon.a (mon.0) 2507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: cluster 2024-04-19T22:54:38.003224+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.006017+0000 mon.c (mon.2) 634 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.007484+0000 mon.a (mon.0) 2509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.036301+0000 mon.c (mon.2) 635 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.036734+0000 mon.a (mon.0) 2510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.037620+0000 mon.c (mon.2) 636 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.037992+0000 mon.a (mon.0) 2511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.039213+0000 mon.c (mon.2) 637 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:39.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:39 smithi178 bash[23441]: audit 2024-04-19T22:54:38.039647+0000 mon.a (mon.0) 2512 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:40.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:38.997976+0000 mon.a (mon.0) 2513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:38.998251+0000 mon.a (mon.0) 2514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: cluster 2024-04-19T22:54:39.006324+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.008438+0000 mon.c (mon.2) 638 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.017812+0000 mon.a (mon.0) 2516 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.095656+0000 mon.c (mon.2) 639 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.096480+0000 mon.a (mon.0) 2517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.097862+0000 mon.c (mon.2) 640 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[28910]: audit 2024-04-19T22:54:39.098587+0000 mon.a (mon.0) 2518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:38.997976+0000 mon.a (mon.0) 2513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:40.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:38.998251+0000 mon.a (mon.0) 2514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: cluster 2024-04-19T22:54:39.006324+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.008438+0000 mon.c (mon.2) 638 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.017812+0000 mon.a (mon.0) 2516 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.095656+0000 mon.c (mon.2) 639 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.096480+0000 mon.a (mon.0) 2517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.097862+0000 mon.c (mon.2) 640 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:40.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:40 smithi113 bash[21528]: audit 2024-04-19T22:54:39.098587+0000 mon.a (mon.0) 2518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:38.997976+0000 mon.a (mon.0) 2513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]': finished 2024-04-19T22:54:40.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:38.998251+0000 mon.a (mon.0) 2514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi113-63841-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: cluster 2024-04-19T22:54:39.006324+0000 mon.a (mon.0) 2515 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.008438+0000 mon.c (mon.2) 638 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.017812+0000 mon.a (mon.0) 2516 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.095656+0000 mon.c (mon.2) 639 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.096480+0000 mon.a (mon.0) 2517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.097862+0000 mon.c (mon.2) 640 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:40 smithi178 bash[23441]: audit 2024-04-19T22:54:39.098587+0000 mon.a (mon.0) 2518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-47"}]: dispatch 2024-04-19T22:54:41.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:41 smithi113 bash[28910]: cluster 2024-04-19T22:54:39.939686+0000 mgr.y (mgr.24389) 379 : cluster 0 pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:54:41.295 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:41 smithi113 bash[28910]: cluster 2024-04-19T22:54:40.477258+0000 mon.a (mon.0) 2519 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-04-19T22:54:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:41 smithi113 bash[21528]: cluster 2024-04-19T22:54:39.939686+0000 mgr.y (mgr.24389) 379 : cluster 0 pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:54:41.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:41 smithi113 bash[21528]: cluster 2024-04-19T22:54:40.477258+0000 mon.a (mon.0) 2519 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-04-19T22:54:41.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:41 smithi178 bash[23441]: cluster 2024-04-19T22:54:39.939686+0000 mgr.y (mgr.24389) 379 : cluster 0 pgmap v550: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:54:41.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:41 smithi178 bash[23441]: cluster 2024-04-19T22:54:40.477258+0000 mon.a (mon.0) 2519 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[21528]: audit 2024-04-19T22:54:41.035349+0000 mon.a (mon.0) 2520 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[21528]: cluster 2024-04-19T22:54:41.040612+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[21528]: audit 2024-04-19T22:54:41.042395+0000 mon.c (mon.2) 641 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[21528]: audit 2024-04-19T22:54:41.044210+0000 mon.a (mon.0) 2522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[28910]: audit 2024-04-19T22:54:41.035349+0000 mon.a (mon.0) 2520 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[28910]: cluster 2024-04-19T22:54:41.040612+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[28910]: audit 2024-04-19T22:54:41.042395+0000 mon.c (mon.2) 641 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:42.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:42 smithi113 bash[28910]: audit 2024-04-19T22:54:41.044210+0000 mon.a (mon.0) 2522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:42.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:42 smithi178 bash[23441]: audit 2024-04-19T22:54:41.035349+0000 mon.a (mon.0) 2520 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi113-63841-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:42.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:42 smithi178 bash[23441]: cluster 2024-04-19T22:54:41.040612+0000 mon.a (mon.0) 2521 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-04-19T22:54:42.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:42 smithi178 bash[23441]: audit 2024-04-19T22:54:41.042395+0000 mon.c (mon.2) 641 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:42.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:42 smithi178 bash[23441]: audit 2024-04-19T22:54:41.044210+0000 mon.a (mon.0) 2522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:54:43.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: cluster 2024-04-19T22:54:41.940522+0000 mgr.y (mgr.24389) 380 : cluster 0 pgmap v553: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: cluster 2024-04-19T22:54:42.036711+0000 mon.a (mon.0) 2523 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: audit 2024-04-19T22:54:42.038552+0000 mon.a (mon.0) 2524 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: cluster 2024-04-19T22:54:42.047237+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: audit 2024-04-19T22:54:42.088935+0000 mon.c (mon.2) 642 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[28910]: audit 2024-04-19T22:54:42.090039+0000 mon.a (mon.0) 2526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: cluster 2024-04-19T22:54:41.940522+0000 mgr.y (mgr.24389) 380 : cluster 0 pgmap v553: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: cluster 2024-04-19T22:54:42.036711+0000 mon.a (mon.0) 2523 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: audit 2024-04-19T22:54:42.038552+0000 mon.a (mon.0) 2524 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:43.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: cluster 2024-04-19T22:54:42.047237+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-04-19T22:54:43.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: audit 2024-04-19T22:54:42.088935+0000 mon.c (mon.2) 642 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:43.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:43 smithi113 bash[21528]: audit 2024-04-19T22:54:42.090039+0000 mon.a (mon.0) 2526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:43.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: cluster 2024-04-19T22:54:41.940522+0000 mgr.y (mgr.24389) 380 : cluster 0 pgmap v553: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T22:54:43.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: cluster 2024-04-19T22:54:42.036711+0000 mon.a (mon.0) 2523 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:43.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: audit 2024-04-19T22:54:42.038552+0000 mon.a (mon.0) 2524 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:54:43.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: cluster 2024-04-19T22:54:42.047237+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-04-19T22:54:43.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: audit 2024-04-19T22:54:42.088935+0000 mon.c (mon.2) 642 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:43.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:43 smithi178 bash[23441]: audit 2024-04-19T22:54:42.090039+0000 mon.a (mon.0) 2526 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:54:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: audit 2024-04-19T22:54:43.077076+0000 mon.a (mon.0) 2527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: cluster 2024-04-19T22:54:43.085232+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-04-19T22:54:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: audit 2024-04-19T22:54:43.089565+0000 mon.c (mon.2) 643 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: audit 2024-04-19T22:54:43.091192+0000 mon.a (mon.0) 2529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: audit 2024-04-19T22:54:43.098000+0000 mon.c (mon.2) 644 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:44.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[21528]: audit 2024-04-19T22:54:43.098665+0000 mon.a (mon.0) 2530 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:44.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: audit 2024-04-19T22:54:43.077076+0000 mon.a (mon.0) 2527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:44.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: cluster 2024-04-19T22:54:43.085232+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-04-19T22:54:44.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: audit 2024-04-19T22:54:43.089565+0000 mon.c (mon.2) 643 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: audit 2024-04-19T22:54:43.091192+0000 mon.a (mon.0) 2529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: audit 2024-04-19T22:54:43.098000+0000 mon.c (mon.2) 644 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:44.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:44 smithi113 bash[28910]: audit 2024-04-19T22:54:43.098665+0000 mon.a (mon.0) 2530 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:44.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: audit 2024-04-19T22:54:43.077076+0000 mon.a (mon.0) 2527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:54:44.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: cluster 2024-04-19T22:54:43.085232+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-04-19T22:54:44.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: audit 2024-04-19T22:54:43.089565+0000 mon.c (mon.2) 643 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: audit 2024-04-19T22:54:43.091192+0000 mon.a (mon.0) 2529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:44.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: audit 2024-04-19T22:54:43.098000+0000 mon.c (mon.2) 644 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:44.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:44 smithi178 bash[23441]: audit 2024-04-19T22:54:43.098665+0000 mon.a (mon.0) 2530 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:45.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: cluster 2024-04-19T22:54:43.941298+0000 mgr.y (mgr.24389) 381 : cluster 0 pgmap v556: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:45.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.086996+0000 mon.a (mon.0) 2531 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:45.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.087344+0000 mon.a (mon.0) 2532 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:45.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: cluster 2024-04-19T22:54:44.098206+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-04-19T22:54:45.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.099664+0000 mon.c (mon.2) 645 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.101086+0000 mon.c (mon.2) 646 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.101251+0000 mon.a (mon.0) 2534 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[21528]: audit 2024-04-19T22:54:44.102759+0000 mon.a (mon.0) 2535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: cluster 2024-04-19T22:54:43.941298+0000 mgr.y (mgr.24389) 381 : cluster 0 pgmap v556: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.086996+0000 mon.a (mon.0) 2531 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.087344+0000 mon.a (mon.0) 2532 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: cluster 2024-04-19T22:54:44.098206+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.099664+0000 mon.c (mon.2) 645 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.101086+0000 mon.c (mon.2) 646 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:45.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.101251+0000 mon.a (mon.0) 2534 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:45 smithi113 bash[28910]: audit 2024-04-19T22:54:44.102759+0000 mon.a (mon.0) 2535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:45.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: cluster 2024-04-19T22:54:43.941298+0000 mgr.y (mgr.24389) 381 : cluster 0 pgmap v556: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.086996+0000 mon.a (mon.0) 2531 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.087344+0000 mon.a (mon.0) 2532 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: cluster 2024-04-19T22:54:44.098206+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.099664+0000 mon.c (mon.2) 645 : audit 1 from='client.? 172.21.15.113:0/2671744951' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.101086+0000 mon.c (mon.2) 646 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.101251+0000 mon.a (mon.0) 2534 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]: dispatch 2024-04-19T22:54:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:45 smithi178 bash[23441]: audit 2024-04-19T22:54:44.102759+0000 mon.a (mon.0) 2535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]: dispatch 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.059807+0000 mgr.y (mgr.24389) 382 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: cluster 2024-04-19T22:54:45.087811+0000 mon.a (mon.0) 2536 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.090294+0000 mon.a (mon.0) 2537 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.090533+0000 mon.a (mon.0) 2538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]': finished 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: cluster 2024-04-19T22:54:45.100690+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.137609+0000 mon.c (mon.2) 647 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.138028+0000 mon.a (mon.0) 2540 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.139175+0000 mon.c (mon.2) 648 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.140441+0000 mon.a (mon.0) 2541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.141624+0000 mon.c (mon.2) 649 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[21528]: audit 2024-04-19T22:54:45.142041+0000 mon.a (mon.0) 2542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.059807+0000 mgr.y (mgr.24389) 382 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: cluster 2024-04-19T22:54:45.087811+0000 mon.a (mon.0) 2536 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.090294+0000 mon.a (mon.0) 2537 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.090533+0000 mon.a (mon.0) 2538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]': finished 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: cluster 2024-04-19T22:54:45.100690+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.137609+0000 mon.c (mon.2) 647 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.138028+0000 mon.a (mon.0) 2540 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.139175+0000 mon.c (mon.2) 648 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.140441+0000 mon.a (mon.0) 2541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.141624+0000 mon.c (mon.2) 649 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:46.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:46 smithi113 bash[28910]: audit 2024-04-19T22:54:45.142041+0000 mon.a (mon.0) 2542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.059807+0000 mgr.y (mgr.24389) 382 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: cluster 2024-04-19T22:54:45.087811+0000 mon.a (mon.0) 2536 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.090294+0000 mon.a (mon.0) 2537 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi113-63841-63"}]': finished 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.090533+0000 mon.a (mon.0) 2538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-49", "mode": "readproxy"}]': finished 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: cluster 2024-04-19T22:54:45.100690+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.137609+0000 mon.c (mon.2) 647 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.138028+0000 mon.a (mon.0) 2540 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.139175+0000 mon.c (mon.2) 648 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.140441+0000 mon.a (mon.0) 2541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:46.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.141624+0000 mon.c (mon.2) 649 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:46 smithi178 bash[23441]: audit 2024-04-19T22:54:45.142041+0000 mon.a (mon.0) 2542 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21528]: cluster 2024-04-19T22:54:45.942119+0000 mgr.y (mgr.24389) 383 : cluster 0 pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:47.477 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21528]: audit 2024-04-19T22:54:46.119522+0000 mon.a (mon.0) 2543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21528]: audit 2024-04-19T22:54:46.130091+0000 mon.c (mon.2) 650 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21528]: cluster 2024-04-19T22:54:46.130970+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21528]: audit 2024-04-19T22:54:46.132823+0000 mon.a (mon.0) 2545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[28910]: cluster 2024-04-19T22:54:45.942119+0000 mgr.y (mgr.24389) 383 : cluster 0 pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[28910]: audit 2024-04-19T22:54:46.119522+0000 mon.a (mon.0) 2543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[28910]: audit 2024-04-19T22:54:46.130091+0000 mon.c (mon.2) 650 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[28910]: cluster 2024-04-19T22:54:46.130970+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-04-19T22:54:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[28910]: audit 2024-04-19T22:54:46.132823+0000 mon.a (mon.0) 2545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:47 smithi178 bash[23441]: cluster 2024-04-19T22:54:45.942119+0000 mgr.y (mgr.24389) 383 : cluster 0 pgmap v559: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:47.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:47 smithi178 bash[23441]: audit 2024-04-19T22:54:46.119522+0000 mon.a (mon.0) 2543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi113-63841-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:47.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:47 smithi178 bash[23441]: audit 2024-04-19T22:54:46.130091+0000 mon.c (mon.2) 650 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:47 smithi178 bash[23441]: cluster 2024-04-19T22:54:46.130970+0000 mon.a (mon.0) 2544 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-04-19T22:54:47.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:47 smithi178 bash[23441]: audit 2024-04-19T22:54:46.132823+0000 mon.a (mon.0) 2545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:47.795 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:48.545 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:48 smithi113 bash[21528]: cluster 2024-04-19T22:54:47.579684+0000 mon.a (mon.0) 2546 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-04-19T22:54:48.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:48 smithi113 bash[28910]: cluster 2024-04-19T22:54:47.579684+0000 mon.a (mon.0) 2546 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-04-19T22:54:48.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:48 smithi178 bash[23441]: cluster 2024-04-19T22:54:47.579684+0000 mon.a (mon.0) 2546 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-04-19T22:54:49.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[28910]: cluster 2024-04-19T22:54:47.942945+0000 mgr.y (mgr.24389) 384 : cluster 0 pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[28910]: audit 2024-04-19T22:54:48.141621+0000 mon.a (mon.0) 2547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[28910]: cluster 2024-04-19T22:54:48.146559+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[28910]: audit 2024-04-19T22:54:48.720443+0000 mon.a (mon.0) 2549 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[21528]: cluster 2024-04-19T22:54:47.942945+0000 mgr.y (mgr.24389) 384 : cluster 0 pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[21528]: audit 2024-04-19T22:54:48.141621+0000 mon.a (mon.0) 2547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[21528]: cluster 2024-04-19T22:54:48.146559+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-04-19T22:54:49.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:49 smithi113 bash[21528]: audit 2024-04-19T22:54:48.720443+0000 mon.a (mon.0) 2549 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:49 smithi178 bash[23441]: cluster 2024-04-19T22:54:47.942945+0000 mgr.y (mgr.24389) 384 : cluster 0 pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:49 smithi178 bash[23441]: audit 2024-04-19T22:54:48.141621+0000 mon.a (mon.0) 2547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi113-63841-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:49 smithi178 bash[23441]: cluster 2024-04-19T22:54:48.146559+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-04-19T22:54:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:49 smithi178 bash[23441]: audit 2024-04-19T22:54:48.720443+0000 mon.a (mon.0) 2549 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:54:50.545 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:50 smithi113 bash[28910]: cluster 2024-04-19T22:54:49.152287+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-04-19T22:54:50.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:50 smithi113 bash[21528]: cluster 2024-04-19T22:54:49.152287+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-04-19T22:54:50.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:50 smithi178 bash[23441]: cluster 2024-04-19T22:54:49.152287+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-04-19T22:54:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: cluster 2024-04-19T22:54:49.945089+0000 mgr.y (mgr.24389) 385 : cluster 0 pgmap v565: 236 pgs: 236 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: cluster 2024-04-19T22:54:50.164131+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: cluster 2024-04-19T22:54:50.180467+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-04-19T22:54:51.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: audit 2024-04-19T22:54:50.188308+0000 mon.c (mon.2) 651 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: audit 2024-04-19T22:54:50.189182+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[21528]: audit 2024-04-19T22:54:51.009095+0000 mon.a (mon.0) 2554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:54:51.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: cluster 2024-04-19T22:54:49.945089+0000 mgr.y (mgr.24389) 385 : cluster 0 pgmap v565: 236 pgs: 236 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:51.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: cluster 2024-04-19T22:54:50.164131+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:51.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: cluster 2024-04-19T22:54:50.180467+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-04-19T22:54:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: audit 2024-04-19T22:54:50.188308+0000 mon.c (mon.2) 651 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: audit 2024-04-19T22:54:50.189182+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:51 smithi113 bash[28910]: audit 2024-04-19T22:54:51.009095+0000 mon.a (mon.0) 2554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: cluster 2024-04-19T22:54:49.945089+0000 mgr.y (mgr.24389) 385 : cluster 0 pgmap v565: 236 pgs: 236 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: cluster 2024-04-19T22:54:50.164131+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: cluster 2024-04-19T22:54:50.180467+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: audit 2024-04-19T22:54:50.188308+0000 mon.c (mon.2) 651 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: audit 2024-04-19T22:54:50.189182+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:51 smithi178 bash[23441]: audit 2024-04-19T22:54:51.009095+0000 mon.a (mon.0) 2554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:54:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.188799+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: cluster 2024-04-19T22:54:51.198255+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-04-19T22:54:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.199423+0000 mon.c (mon.2) 652 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.205433+0000 mon.a (mon.0) 2557 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.793617+0000 mon.a (mon.0) 2558 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:54:52.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.795392+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:54:52.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[28910]: audit 2024-04-19T22:54:51.804063+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:52.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.188799+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:52.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: cluster 2024-04-19T22:54:51.198255+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-04-19T22:54:52.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.199423+0000 mon.c (mon.2) 652 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.205433+0000 mon.a (mon.0) 2557 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.793617+0000 mon.a (mon.0) 2558 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:54:52.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.795392+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:54:52.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:52 smithi113 bash[21528]: audit 2024-04-19T22:54:51.804063+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:52.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.188799+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:52.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: cluster 2024-04-19T22:54:51.198255+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-04-19T22:54:52.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.199423+0000 mon.c (mon.2) 652 : audit 1 from='client.? 172.21.15.113:0/2648681650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.205433+0000 mon.a (mon.0) 2557 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]: dispatch 2024-04-19T22:54:52.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.793617+0000 mon.a (mon.0) 2558 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:54:52.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.795392+0000 mon.a (mon.0) 2559 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:54:52.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:52 smithi178 bash[23441]: audit 2024-04-19T22:54:51.804063+0000 mon.a (mon.0) 2560 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: cluster 2024-04-19T22:54:51.945930+0000 mgr.y (mgr.24389) 386 : cluster 0 pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: audit 2024-04-19T22:54:52.194046+0000 mon.a (mon.0) 2561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: cluster 2024-04-19T22:54:52.203388+0000 mon.a (mon.0) 2562 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: audit 2024-04-19T22:54:52.259354+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: audit 2024-04-19T22:54:52.260413+0000 mon.a (mon.0) 2564 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[21528]: audit 2024-04-19T22:54:52.260864+0000 mon.a (mon.0) 2565 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: cluster 2024-04-19T22:54:51.945930+0000 mgr.y (mgr.24389) 386 : cluster 0 pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:54:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: audit 2024-04-19T22:54:52.194046+0000 mon.a (mon.0) 2561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: cluster 2024-04-19T22:54:52.203388+0000 mon.a (mon.0) 2562 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-04-19T22:54:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: audit 2024-04-19T22:54:52.259354+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: audit 2024-04-19T22:54:52.260413+0000 mon.a (mon.0) 2564 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:53 smithi113 bash[28910]: audit 2024-04-19T22:54:52.260864+0000 mon.a (mon.0) 2565 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: cluster 2024-04-19T22:54:51.945930+0000 mgr.y (mgr.24389) 386 : cluster 0 pgmap v568: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:54:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: audit 2024-04-19T22:54:52.194046+0000 mon.a (mon.0) 2561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi113-63841-64"}]': finished 2024-04-19T22:54:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: cluster 2024-04-19T22:54:52.203388+0000 mon.a (mon.0) 2562 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-04-19T22:54:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: audit 2024-04-19T22:54:52.259354+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: audit 2024-04-19T22:54:52.260413+0000 mon.a (mon.0) 2564 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:53 smithi178 bash[23441]: audit 2024-04-19T22:54:52.260864+0000 mon.a (mon.0) 2565 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[28910]: audit 2024-04-19T22:54:53.210808+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[28910]: cluster 2024-04-19T22:54:53.221231+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[28910]: audit 2024-04-19T22:54:53.222807+0000 mon.a (mon.0) 2568 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[21528]: audit 2024-04-19T22:54:53.210808+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[21528]: cluster 2024-04-19T22:54:53.221231+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-04-19T22:54:55.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:54 smithi113 bash[21528]: audit 2024-04-19T22:54:53.222807+0000 mon.a (mon.0) 2568 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:55.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:54 smithi178 bash[23441]: audit 2024-04-19T22:54:53.210808+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi113-63841-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:54:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:54 smithi178 bash[23441]: cluster 2024-04-19T22:54:53.221231+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-04-19T22:54:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:54 smithi178 bash[23441]: audit 2024-04-19T22:54:53.222807+0000 mon.a (mon.0) 2568 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:55.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[28910]: cluster 2024-04-19T22:54:53.946775+0000 mgr.y (mgr.24389) 387 : cluster 0 pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[28910]: cluster 2024-04-19T22:54:54.668411+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[28910]: audit 2024-04-19T22:54:55.068117+0000 mgr.y (mgr.24389) 388 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[28910]: audit 2024-04-19T22:54:55.217118+0000 mon.a (mon.0) 2570 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[28910]: cluster 2024-04-19T22:54:55.228532+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[21528]: cluster 2024-04-19T22:54:53.946775+0000 mgr.y (mgr.24389) 387 : cluster 0 pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[21528]: cluster 2024-04-19T22:54:54.668411+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-04-19T22:54:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[21528]: audit 2024-04-19T22:54:55.068117+0000 mgr.y (mgr.24389) 388 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[21528]: audit 2024-04-19T22:54:55.217118+0000 mon.a (mon.0) 2570 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:56.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:55 smithi113 bash[21528]: cluster 2024-04-19T22:54:55.228532+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-04-19T22:54:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[23441]: cluster 2024-04-19T22:54:53.946775+0000 mgr.y (mgr.24389) 387 : cluster 0 pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 582 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:54:56.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[23441]: cluster 2024-04-19T22:54:54.668411+0000 mon.a (mon.0) 2569 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-04-19T22:54:56.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[23441]: audit 2024-04-19T22:54:55.068117+0000 mgr.y (mgr.24389) 388 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:54:56.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[23441]: audit 2024-04-19T22:54:55.217118+0000 mon.a (mon.0) 2570 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi113-63841-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:56.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:55 smithi178 bash[23441]: cluster 2024-04-19T22:54:55.228532+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: audit 2024-04-19T22:54:55.896103+0000 mon.c (mon.2) 653 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: audit 2024-04-19T22:54:55.896786+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: cluster 2024-04-19T22:54:55.927086+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: cluster 2024-04-19T22:54:55.947562+0000 mgr.y (mgr.24389) 389 : cluster 0 pgmap v574: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: audit 2024-04-19T22:54:56.219916+0000 mon.a (mon.0) 2574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: cluster 2024-04-19T22:54:56.227260+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-04-19T22:54:57.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: audit 2024-04-19T22:54:56.230066+0000 mon.c (mon.2) 654 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[21528]: audit 2024-04-19T22:54:56.239682+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: audit 2024-04-19T22:54:55.896103+0000 mon.c (mon.2) 653 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: audit 2024-04-19T22:54:55.896786+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: cluster 2024-04-19T22:54:55.927086+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: cluster 2024-04-19T22:54:55.947562+0000 mgr.y (mgr.24389) 389 : cluster 0 pgmap v574: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: audit 2024-04-19T22:54:56.219916+0000 mon.a (mon.0) 2574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: cluster 2024-04-19T22:54:56.227260+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: audit 2024-04-19T22:54:56.230066+0000 mon.c (mon.2) 654 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:56 smithi113 bash[28910]: audit 2024-04-19T22:54:56.239682+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: audit 2024-04-19T22:54:55.896103+0000 mon.c (mon.2) 653 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: audit 2024-04-19T22:54:55.896786+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: cluster 2024-04-19T22:54:55.927086+0000 mon.a (mon.0) 2573 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:54:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: cluster 2024-04-19T22:54:55.947562+0000 mgr.y (mgr.24389) 389 : cluster 0 pgmap v574: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: audit 2024-04-19T22:54:56.219916+0000 mon.a (mon.0) 2574 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:54:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: cluster 2024-04-19T22:54:56.227260+0000 mon.a (mon.0) 2575 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-04-19T22:54:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: audit 2024-04-19T22:54:56.230066+0000 mon.c (mon.2) 654 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:56 smithi178 bash[23441]: audit 2024-04-19T22:54:56.239682+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:54:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: cluster 2024-04-19T22:54:57.220468+0000 mon.a (mon.0) 2577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.222882+0000 mon.a (mon.0) 2578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: cluster 2024-04-19T22:54:57.230739+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.238591+0000 mon.a (mon.0) 2580 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.295860+0000 mon.c (mon.2) 655 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.296726+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.298009+0000 mon.c (mon.2) 656 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[21528]: audit 2024-04-19T22:54:57.298670+0000 mon.a (mon.0) 2582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: cluster 2024-04-19T22:54:57.220468+0000 mon.a (mon.0) 2577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:57.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.222882+0000 mon.a (mon.0) 2578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:57.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: cluster 2024-04-19T22:54:57.230739+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-04-19T22:54:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.238591+0000 mon.a (mon.0) 2580 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.295860+0000 mon.c (mon.2) 655 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.296726+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.298009+0000 mon.c (mon.2) 656 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:57 smithi113 bash[28910]: audit 2024-04-19T22:54:57.298670+0000 mon.a (mon.0) 2582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: cluster 2024-04-19T22:54:57.220468+0000 mon.a (mon.0) 2577 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.222882+0000 mon.a (mon.0) 2578 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]': finished 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: cluster 2024-04-19T22:54:57.230739+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.238591+0000 mon.a (mon.0) 2580 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.295860+0000 mon.c (mon.2) 655 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.296726+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.298009+0000 mon.c (mon.2) 656 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:57 smithi178 bash[23441]: audit 2024-04-19T22:54:57.298670+0000 mon.a (mon.0) 2582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-49"}]: dispatch 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout:::163:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:5d165639:::164:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f43765fc:::165:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b4c720e9:::166:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e694b040:::167:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:afa38db2:::168:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:77ba9f53:::169:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:87495034:::170:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7c96bf0e:::171:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:dbe346cc:::172:head 2024-04-19T22:54:58.234 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:e943ec24:::173:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f97a9c0c:::174:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:6f26e74d:::175:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4f95e106:::176:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:0e6f2f8f:::177:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:05db05f1:::178:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:38a78d66:::179:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:d095610b:::180:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:a1a9d709:::181:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:1e5d39db:::182:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:f7df4fb9:::183:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:03a7f161:::184:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ba70721e:::185:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:28e5662d:::186:head 2024-04-19T22:54:58.235 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:973d52de:::187:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:4303eb1c:::188:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:b990b48e:::189:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:29b8165b:::190:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:3547f197:::191:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:7e260936:::192:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:1abec7b1:::193:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:10fdda93:::194:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:15817eea:::195:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:770bab57:::196:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:ed9e13e7:::197:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:71471a8f:::198:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: checking for 277:10fb1d02:::199:head 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8051 ms) 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-19T22:54:58.236 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: first is 1713567252 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,1713567260,1713567261,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,1713567260,1713567261,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567252,1713567254,1713567255,1713567257,1713567258,1713567260,1713567261,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567255,1713567257,1713567258,1713567260,1713567261,1713567263,1713567264,0 2024-04-19T22:54:58.237 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: first now 1713567255, trimmed 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21627 ms) 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: foo0 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14064 ms) 2024-04-19T22:54:58.238 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[21528]: cluster 2024-04-19T22:54:57.948321+0000 mgr.y (mgr.24389) 390 : cluster 0 pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[21528]: audit 2024-04-19T22:54:58.226969+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[21528]: cluster 2024-04-19T22:54:58.235910+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[21528]: audit 2024-04-19T22:54:58.238793+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[28910]: cluster 2024-04-19T22:54:57.948321+0000 mgr.y (mgr.24389) 390 : cluster 0 pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:59.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[28910]: audit 2024-04-19T22:54:58.226969+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:59.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[28910]: cluster 2024-04-19T22:54:58.235910+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-04-19T22:54:59.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:54:59 smithi113 bash[28910]: audit 2024-04-19T22:54:58.238793+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:54:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:59 smithi178 bash[23441]: cluster 2024-04-19T22:54:57.948321+0000 mgr.y (mgr.24389) 390 : cluster 0 pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:54:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:59 smithi178 bash[23441]: audit 2024-04-19T22:54:58.226969+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:54:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:59 smithi178 bash[23441]: cluster 2024-04-19T22:54:58.235910+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-04-19T22:54:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:54:59 smithi178 bash[23441]: audit 2024-04-19T22:54:58.238793+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]: dispatch 2024-04-19T22:55:00.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.240940+0000 mon.a (mon.0) 2586 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:55:00.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: cluster 2024-04-19T22:54:59.248788+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-04-19T22:55:00.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.252836+0000 mon.c (mon.2) 657 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.254031+0000 mon.a (mon.0) 2588 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.282260+0000 mon.c (mon.2) 658 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.282695+0000 mon.a (mon.0) 2589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.283327+0000 mon.c (mon.2) 659 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.283657+0000 mon.a (mon.0) 2590 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.284144+0000 mon.c (mon.2) 660 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[21528]: audit 2024-04-19T22:54:59.284411+0000 mon.a (mon.0) 2591 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.240940+0000 mon.a (mon.0) 2586 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: cluster 2024-04-19T22:54:59.248788+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.252836+0000 mon.c (mon.2) 657 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.254031+0000 mon.a (mon.0) 2588 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.282260+0000 mon.c (mon.2) 658 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.282695+0000 mon.a (mon.0) 2589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.283327+0000 mon.c (mon.2) 659 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.283657+0000 mon.a (mon.0) 2590 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.284144+0000 mon.c (mon.2) 660 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:00 smithi113 bash[28910]: audit 2024-04-19T22:54:59.284411+0000 mon.a (mon.0) 2591 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:00.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.240940+0000 mon.a (mon.0) 2586 : audit 1 from='client.? 172.21.15.113:0/1159053624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi113-63841-65"}]': finished 2024-04-19T22:55:00.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: cluster 2024-04-19T22:54:59.248788+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.252836+0000 mon.c (mon.2) 657 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.254031+0000 mon.a (mon.0) 2588 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.282260+0000 mon.c (mon.2) 658 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.282695+0000 mon.a (mon.0) 2589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.283327+0000 mon.c (mon.2) 659 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.283657+0000 mon.a (mon.0) 2590 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.284144+0000 mon.c (mon.2) 660 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:00 smithi178 bash[23441]: audit 2024-04-19T22:54:59.284411+0000 mon.a (mon.0) 2591 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:55:02.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: cluster 2024-04-19T22:54:59.950331+0000 mgr.y (mgr.24389) 391 : cluster 0 pgmap v580: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.249877+0000 mon.a (mon.0) 2592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.250049+0000 mon.a (mon.0) 2593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: cluster 2024-04-19T22:55:00.261661+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.263746+0000 mon.c (mon.2) 661 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.268212+0000 mon.a (mon.0) 2595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.317450+0000 mon.c (mon.2) 662 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: audit 2024-04-19T22:55:00.318038+0000 mon.a (mon.0) 2596 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[28910]: cluster 2024-04-19T22:55:00.928524+0000 mon.a (mon.0) 2597 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: cluster 2024-04-19T22:54:59.950331+0000 mgr.y (mgr.24389) 391 : cluster 0 pgmap v580: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:02.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.249877+0000 mon.a (mon.0) 2592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.250049+0000 mon.a (mon.0) 2593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: cluster 2024-04-19T22:55:00.261661+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.263746+0000 mon.c (mon.2) 661 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.268212+0000 mon.a (mon.0) 2595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.317450+0000 mon.c (mon.2) 662 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: audit 2024-04-19T22:55:00.318038+0000 mon.a (mon.0) 2596 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:01 smithi113 bash[21528]: cluster 2024-04-19T22:55:00.928524+0000 mon.a (mon.0) 2597 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:02.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: cluster 2024-04-19T22:54:59.950331+0000 mgr.y (mgr.24389) 391 : cluster 0 pgmap v580: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:02.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.249877+0000 mon.a (mon.0) 2592 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.250049+0000 mon.a (mon.0) 2593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi113-63841-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: cluster 2024-04-19T22:55:00.261661+0000 mon.a (mon.0) 2594 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.263746+0000 mon.c (mon.2) 661 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.268212+0000 mon.a (mon.0) 2595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.317450+0000 mon.c (mon.2) 662 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: audit 2024-04-19T22:55:00.318038+0000 mon.a (mon.0) 2596 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:55:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:01 smithi178 bash[23441]: cluster 2024-04-19T22:55:00.928524+0000 mon.a (mon.0) 2597 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:03.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:01.253176+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:55:03.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:01.265772+0000 mon.c (mon.2) 663 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: cluster 2024-04-19T22:55:01.707311+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:01.708007+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: cluster 2024-04-19T22:55:01.951169+0000 mgr.y (mgr.24389) 392 : cluster 0 pgmap v583: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:02.256355+0000 mon.a (mon.0) 2601 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:02.256559+0000 mon.a (mon.0) 2602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: cluster 2024-04-19T22:55:02.264602+0000 mon.a (mon.0) 2603 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:02.265227+0000 mon.c (mon.2) 664 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[28910]: audit 2024-04-19T22:55:02.268803+0000 mon.a (mon.0) 2604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:01.253176+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:55:03.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:01.265772+0000 mon.c (mon.2) 663 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: cluster 2024-04-19T22:55:01.707311+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:01.708007+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: cluster 2024-04-19T22:55:01.951169+0000 mgr.y (mgr.24389) 392 : cluster 0 pgmap v583: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:02.256355+0000 mon.a (mon.0) 2601 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:02.256559+0000 mon.a (mon.0) 2602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: cluster 2024-04-19T22:55:02.264602+0000 mon.a (mon.0) 2603 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:02.265227+0000 mon.c (mon.2) 664 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:03.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:02 smithi113 bash[21528]: audit 2024-04-19T22:55:02.268803+0000 mon.a (mon.0) 2604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:03.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:01.253176+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:01.265772+0000 mon.c (mon.2) 663 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: cluster 2024-04-19T22:55:01.707311+0000 mon.a (mon.0) 2599 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:01.708007+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: cluster 2024-04-19T22:55:01.951169+0000 mgr.y (mgr.24389) 392 : cluster 0 pgmap v583: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:02.256355+0000 mon.a (mon.0) 2601 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi113-63841-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:02.256559+0000 mon.a (mon.0) 2602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: cluster 2024-04-19T22:55:02.264602+0000 mon.a (mon.0) 2603 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-04-19T22:55:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:02.265227+0000 mon.c (mon.2) 664 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:02 smithi178 bash[23441]: audit 2024-04-19T22:55:02.268803+0000 mon.a (mon.0) 2604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]: dispatch 2024-04-19T22:55:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[21528]: cluster 2024-04-19T22:55:03.256778+0000 mon.a (mon.0) 2605 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:55:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[21528]: audit 2024-04-19T22:55:03.260854+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]': finished 2024-04-19T22:55:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[21528]: cluster 2024-04-19T22:55:03.273163+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-04-19T22:55:04.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[21528]: audit 2024-04-19T22:55:03.364385+0000 mon.c (mon.2) 665 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[21528]: audit 2024-04-19T22:55:03.365241+0000 mon.a (mon.0) 2608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[28910]: cluster 2024-04-19T22:55:03.256778+0000 mon.a (mon.0) 2605 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[28910]: audit 2024-04-19T22:55:03.260854+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]': finished 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[28910]: cluster 2024-04-19T22:55:03.273163+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[28910]: audit 2024-04-19T22:55:03.364385+0000 mon.c (mon.2) 665 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:03 smithi113 bash[28910]: audit 2024-04-19T22:55:03.365241+0000 mon.a (mon.0) 2608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:03 smithi178 bash[23441]: cluster 2024-04-19T22:55:03.256778+0000 mon.a (mon.0) 2605 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:55:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:03 smithi178 bash[23441]: audit 2024-04-19T22:55:03.260854+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-51", "mode": "writeback"}]': finished 2024-04-19T22:55:04.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:03 smithi178 bash[23441]: cluster 2024-04-19T22:55:03.273163+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-04-19T22:55:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:03 smithi178 bash[23441]: audit 2024-04-19T22:55:03.364385+0000 mon.c (mon.2) 665 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:03 smithi178 bash[23441]: audit 2024-04-19T22:55:03.365241+0000 mon.a (mon.0) 2608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:55:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:03.754072+0000 mon.a (mon.0) 2609 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: cluster 2024-04-19T22:55:03.951989+0000 mgr.y (mgr.24389) 393 : cluster 0 pgmap v586: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:04.263453+0000 mon.a (mon.0) 2610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:55:05.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: cluster 2024-04-19T22:55:04.272601+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:04.275373+0000 mon.c (mon.2) 666 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:04.277498+0000 mon.c (mon.2) 667 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:04.279032+0000 mon.a (mon.0) 2612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[21528]: audit 2024-04-19T22:55:04.283220+0000 mon.a (mon.0) 2613 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:03.754072+0000 mon.a (mon.0) 2609 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: cluster 2024-04-19T22:55:03.951989+0000 mgr.y (mgr.24389) 393 : cluster 0 pgmap v586: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:04.263453+0000 mon.a (mon.0) 2610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: cluster 2024-04-19T22:55:04.272601+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:04.275373+0000 mon.c (mon.2) 666 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:04.277498+0000 mon.c (mon.2) 667 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:04.279032+0000 mon.a (mon.0) 2612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:04 smithi113 bash[28910]: audit 2024-04-19T22:55:04.283220+0000 mon.a (mon.0) 2613 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:03.754072+0000 mon.a (mon.0) 2609 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:05.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: cluster 2024-04-19T22:55:03.951989+0000 mgr.y (mgr.24389) 393 : cluster 0 pgmap v586: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:05.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:04.263453+0000 mon.a (mon.0) 2610 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:55:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: cluster 2024-04-19T22:55:04.272601+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-04-19T22:55:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:04.275373+0000 mon.c (mon.2) 666 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:04.277498+0000 mon.c (mon.2) 667 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:04.279032+0000 mon.a (mon.0) 2612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:55:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:04 smithi178 bash[23441]: audit 2024-04-19T22:55:04.283220+0000 mon.a (mon.0) 2613 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:05.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:06.305 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3052 ms) 2024-04-19T22:55:06.305 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-19T22:55:06.305 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7061 ms) 2024-04-19T22:55:06.305 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-19T22:55:06.305 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7018 ms) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7098 ms) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7115 ms) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7035 ms) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7043 ms) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139201 ms total) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (337010 ms total) 2024-04-19T22:55:06.306 INFO:tasks.workunit.client.0.smithi113.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.078917+0000 mgr.y (mgr.24389) 394 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.266011+0000 mon.a (mon.0) 2614 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.266196+0000 mon.a (mon.0) 2615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.275295+0000 mon.c (mon.2) 668 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.275641+0000 mon.c (mon.2) 669 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: cluster 2024-04-19T22:55:05.277419+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-04-19T22:55:06.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.278645+0000 mon.a (mon.0) 2617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[21528]: audit 2024-04-19T22:55:05.279795+0000 mon.a (mon.0) 2618 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.078917+0000 mgr.y (mgr.24389) 394 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.266011+0000 mon.a (mon.0) 2614 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.266196+0000 mon.a (mon.0) 2615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.275295+0000 mon.c (mon.2) 668 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.275641+0000 mon.c (mon.2) 669 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: cluster 2024-04-19T22:55:05.277419+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.278645+0000 mon.a (mon.0) 2617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:06 smithi113 bash[28910]: audit 2024-04-19T22:55:05.279795+0000 mon.a (mon.0) 2618 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.078917+0000 mgr.y (mgr.24389) 394 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.266011+0000 mon.a (mon.0) 2614 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.266196+0000 mon.a (mon.0) 2615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.275295+0000 mon.c (mon.2) 668 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.275641+0000 mon.c (mon.2) 669 : audit 1 from='client.? 172.21.15.113:0/2582789728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: cluster 2024-04-19T22:55:05.277419+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.278645+0000 mon.a (mon.0) 2617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:55:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:06 smithi178 bash[23441]: audit 2024-04-19T22:55:05.279795+0000 mon.a (mon.0) 2618 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]: dispatch 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: cluster 2024-04-19T22:55:05.952850+0000 mgr.y (mgr.24389) 395 : cluster 0 pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: cluster 2024-04-19T22:55:06.265990+0000 mon.a (mon.0) 2619 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: cluster 2024-04-19T22:55:06.267835+0000 mon.a (mon.0) 2620 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: audit 2024-04-19T22:55:06.278563+0000 mon.a (mon.0) 2621 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:55:07.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: audit 2024-04-19T22:55:06.278813+0000 mon.a (mon.0) 2622 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: cluster 2024-04-19T22:55:06.289845+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: audit 2024-04-19T22:55:06.294346+0000 mon.c (mon.2) 670 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[28910]: audit 2024-04-19T22:55:06.295719+0000 mon.a (mon.0) 2624 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: cluster 2024-04-19T22:55:05.952850+0000 mgr.y (mgr.24389) 395 : cluster 0 pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: cluster 2024-04-19T22:55:06.265990+0000 mon.a (mon.0) 2619 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: cluster 2024-04-19T22:55:06.267835+0000 mon.a (mon.0) 2620 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: audit 2024-04-19T22:55:06.278563+0000 mon.a (mon.0) 2621 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: audit 2024-04-19T22:55:06.278813+0000 mon.a (mon.0) 2622 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: cluster 2024-04-19T22:55:06.289845+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: audit 2024-04-19T22:55:06.294346+0000 mon.c (mon.2) 670 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:07.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:07 smithi113 bash[21528]: audit 2024-04-19T22:55:06.295719+0000 mon.a (mon.0) 2624 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:07.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: cluster 2024-04-19T22:55:05.952850+0000 mgr.y (mgr.24389) 395 : cluster 0 pgmap v589: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:07.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: cluster 2024-04-19T22:55:06.265990+0000 mon.a (mon.0) 2619 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:07.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: cluster 2024-04-19T22:55:06.267835+0000 mon.a (mon.0) 2620 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:55:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: audit 2024-04-19T22:55:06.278563+0000 mon.a (mon.0) 2621 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:55:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: audit 2024-04-19T22:55:06.278813+0000 mon.a (mon.0) 2622 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi113-63841-66"}]': finished 2024-04-19T22:55:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: cluster 2024-04-19T22:55:06.289845+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-04-19T22:55:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: audit 2024-04-19T22:55:06.294346+0000 mon.c (mon.2) 670 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:07 smithi178 bash[23441]: audit 2024-04-19T22:55:06.295719+0000 mon.a (mon.0) 2624 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T22:55:08.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:08 smithi178 bash[23441]: audit 2024-04-19T22:55:07.291318+0000 mon.a (mon.0) 2625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:55:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:08 smithi178 bash[23441]: cluster 2024-04-19T22:55:07.298109+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-04-19T22:55:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:08 smithi178 bash[23441]: audit 2024-04-19T22:55:07.303260+0000 mon.c (mon.2) 671 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:08 smithi178 bash[23441]: audit 2024-04-19T22:55:07.304083+0000 mon.a (mon.0) 2627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[21528]: audit 2024-04-19T22:55:07.291318+0000 mon.a (mon.0) 2625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[21528]: cluster 2024-04-19T22:55:07.298109+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[21528]: audit 2024-04-19T22:55:07.303260+0000 mon.c (mon.2) 671 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[21528]: audit 2024-04-19T22:55:07.304083+0000 mon.a (mon.0) 2627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[28910]: audit 2024-04-19T22:55:07.291318+0000 mon.a (mon.0) 2625 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T22:55:08.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[28910]: cluster 2024-04-19T22:55:07.298109+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-04-19T22:55:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[28910]: audit 2024-04-19T22:55:07.303260+0000 mon.c (mon.2) 671 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:08 smithi113 bash[28910]: audit 2024-04-19T22:55:07.304083+0000 mon.a (mon.0) 2627 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T22:55:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:09 smithi178 bash[23441]: cluster 2024-04-19T22:55:07.953688+0000 mgr.y (mgr.24389) 396 : cluster 0 pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:09 smithi178 bash[23441]: audit 2024-04-19T22:55:08.300853+0000 mon.a (mon.0) 2628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]': finished 2024-04-19T22:55:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:09 smithi178 bash[23441]: cluster 2024-04-19T22:55:08.311033+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-04-19T22:55:09.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[21528]: cluster 2024-04-19T22:55:07.953688+0000 mgr.y (mgr.24389) 396 : cluster 0 pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:09.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[21528]: audit 2024-04-19T22:55:08.300853+0000 mon.a (mon.0) 2628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]': finished 2024-04-19T22:55:09.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[21528]: cluster 2024-04-19T22:55:08.311033+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-04-19T22:55:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[28910]: cluster 2024-04-19T22:55:07.953688+0000 mgr.y (mgr.24389) 396 : cluster 0 pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-04-19T22:55:09.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[28910]: audit 2024-04-19T22:55:08.300853+0000 mon.a (mon.0) 2628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-51","var": "target_max_objects","val": "1"}]': finished 2024-04-19T22:55:09.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:09 smithi113 bash[28910]: cluster 2024-04-19T22:55:08.311033+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-04-19T22:55:10.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:10 smithi113 bash[28910]: cluster 2024-04-19T22:55:10.302764+0000 mon.a (mon.0) 2630 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T22:55:10.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:10 smithi113 bash[21528]: cluster 2024-04-19T22:55:10.302764+0000 mon.a (mon.0) 2630 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T22:55:10.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:10 smithi178 bash[23441]: cluster 2024-04-19T22:55:10.302764+0000 mon.a (mon.0) 2630 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T22:55:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:11 smithi113 bash[28910]: cluster 2024-04-19T22:55:09.955836+0000 mgr.y (mgr.24389) 397 : cluster 0 pgmap v594: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:11.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:11 smithi113 bash[21528]: cluster 2024-04-19T22:55:09.955836+0000 mgr.y (mgr.24389) 397 : cluster 0 pgmap v594: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:11.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:11 smithi178 bash[23441]: cluster 2024-04-19T22:55:09.955836+0000 mgr.y (mgr.24389) 397 : cluster 0 pgmap v594: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:13.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:13 smithi113 bash[28910]: cluster 2024-04-19T22:55:11.956728+0000 mgr.y (mgr.24389) 398 : cluster 0 pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:13.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:13 smithi113 bash[21528]: cluster 2024-04-19T22:55:11.956728+0000 mgr.y (mgr.24389) 398 : cluster 0 pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:13.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:13 smithi178 bash[23441]: cluster 2024-04-19T22:55:11.956728+0000 mgr.y (mgr.24389) 398 : cluster 0 pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:15.363 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:15.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:15 smithi113 bash[28910]: cluster 2024-04-19T22:55:13.957634+0000 mgr.y (mgr.24389) 399 : cluster 0 pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:55:15.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:15 smithi113 bash[21528]: cluster 2024-04-19T22:55:13.957634+0000 mgr.y (mgr.24389) 399 : cluster 0 pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:55:15.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:15 smithi178 bash[23441]: cluster 2024-04-19T22:55:13.957634+0000 mgr.y (mgr.24389) 399 : cluster 0 pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T22:55:16.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:16 smithi113 bash[28910]: audit 2024-04-19T22:55:15.089811+0000 mgr.y (mgr.24389) 400 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:16.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:16 smithi113 bash[21528]: audit 2024-04-19T22:55:15.089811+0000 mgr.y (mgr.24389) 400 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:16.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:16 smithi178 bash[23441]: audit 2024-04-19T22:55:15.089811+0000 mgr.y (mgr.24389) 400 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:17.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:17 smithi113 bash[21528]: cluster 2024-04-19T22:55:15.959844+0000 mgr.y (mgr.24389) 401 : cluster 0 pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:17 smithi113 bash[28910]: cluster 2024-04-19T22:55:15.959844+0000 mgr.y (mgr.24389) 401 : cluster 0 pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:17.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:17.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:17 smithi178 bash[23441]: cluster 2024-04-19T22:55:15.959844+0000 mgr.y (mgr.24389) 401 : cluster 0 pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:18.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:18 smithi113 bash[28910]: audit 2024-04-19T22:55:18.344402+0000 mon.c (mon.2) 672 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:18.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:18 smithi113 bash[28910]: audit 2024-04-19T22:55:18.345095+0000 mon.a (mon.0) 2631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:18.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:18 smithi113 bash[21528]: audit 2024-04-19T22:55:18.344402+0000 mon.c (mon.2) 672 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:18.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:18 smithi113 bash[21528]: audit 2024-04-19T22:55:18.345095+0000 mon.a (mon.0) 2631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:18.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:18 smithi178 bash[23441]: audit 2024-04-19T22:55:18.344402+0000 mon.c (mon.2) 672 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:18.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:18 smithi178 bash[23441]: audit 2024-04-19T22:55:18.345095+0000 mon.a (mon.0) 2631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:19.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: cluster 2024-04-19T22:55:17.960647+0000 mgr.y (mgr.24389) 402 : cluster 0 pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:19.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: audit 2024-04-19T22:55:18.390817+0000 mon.a (mon.0) 2632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:55:19.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: cluster 2024-04-19T22:55:18.398596+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-04-19T22:55:19.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: audit 2024-04-19T22:55:18.400726+0000 mon.c (mon.2) 673 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: audit 2024-04-19T22:55:18.401734+0000 mon.a (mon.0) 2634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: audit 2024-04-19T22:55:18.795522+0000 mon.a (mon.0) 2635 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:19.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[21528]: audit 2024-04-19T22:55:18.797932+0000 mon.a (mon.0) 2636 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:19.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: cluster 2024-04-19T22:55:17.960647+0000 mgr.y (mgr.24389) 402 : cluster 0 pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:19.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: audit 2024-04-19T22:55:18.390817+0000 mon.a (mon.0) 2632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:55:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: cluster 2024-04-19T22:55:18.398596+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-04-19T22:55:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: audit 2024-04-19T22:55:18.400726+0000 mon.c (mon.2) 673 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: audit 2024-04-19T22:55:18.401734+0000 mon.a (mon.0) 2634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: audit 2024-04-19T22:55:18.795522+0000 mon.a (mon.0) 2635 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:19 smithi113 bash[28910]: audit 2024-04-19T22:55:18.797932+0000 mon.a (mon.0) 2636 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: cluster 2024-04-19T22:55:17.960647+0000 mgr.y (mgr.24389) 402 : cluster 0 pgmap v598: 228 pgs: 228 active+clean; 8.4 MiB data, 593 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: audit 2024-04-19T22:55:18.390817+0000 mon.a (mon.0) 2632 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: cluster 2024-04-19T22:55:18.398596+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: audit 2024-04-19T22:55:18.400726+0000 mon.c (mon.2) 673 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: audit 2024-04-19T22:55:18.401734+0000 mon.a (mon.0) 2634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: audit 2024-04-19T22:55:18.795522+0000 mon.a (mon.0) 2635 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:19 smithi178 bash[23441]: audit 2024-04-19T22:55:18.797932+0000 mon.a (mon.0) 2636 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: audit 2024-04-19T22:55:19.393333+0000 mon.a (mon.0) 2637 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: cluster 2024-04-19T22:55:19.400662+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-04-19T22:55:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: audit 2024-04-19T22:55:19.481512+0000 mon.c (mon.2) 674 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: audit 2024-04-19T22:55:19.482259+0000 mon.a (mon.0) 2639 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: audit 2024-04-19T22:55:19.483479+0000 mon.c (mon.2) 675 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[21528]: audit 2024-04-19T22:55:19.484153+0000 mon.a (mon.0) 2640 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: audit 2024-04-19T22:55:19.393333+0000 mon.a (mon.0) 2637 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: cluster 2024-04-19T22:55:19.400662+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: audit 2024-04-19T22:55:19.481512+0000 mon.c (mon.2) 674 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: audit 2024-04-19T22:55:19.482259+0000 mon.a (mon.0) 2639 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: audit 2024-04-19T22:55:19.483479+0000 mon.c (mon.2) 675 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:20.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:20 smithi113 bash[28910]: audit 2024-04-19T22:55:19.484153+0000 mon.a (mon.0) 2640 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:20.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: audit 2024-04-19T22:55:19.393333+0000 mon.a (mon.0) 2637 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]': finished 2024-04-19T22:55:20.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: cluster 2024-04-19T22:55:19.400662+0000 mon.a (mon.0) 2638 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-04-19T22:55:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: audit 2024-04-19T22:55:19.481512+0000 mon.c (mon.2) 674 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: audit 2024-04-19T22:55:19.482259+0000 mon.a (mon.0) 2639 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: audit 2024-04-19T22:55:19.483479+0000 mon.c (mon.2) 675 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:20 smithi178 bash[23441]: audit 2024-04-19T22:55:19.484153+0000 mon.a (mon.0) 2640 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-51"}]: dispatch 2024-04-19T22:55:21.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[28910]: cluster 2024-04-19T22:55:19.962781+0000 mgr.y (mgr.24389) 403 : cluster 0 pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-04-19T22:55:21.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[28910]: cluster 2024-04-19T22:55:20.405620+0000 mon.a (mon.0) 2641 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T22:55:21.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[28910]: cluster 2024-04-19T22:55:20.429793+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-04-19T22:55:21.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[21528]: cluster 2024-04-19T22:55:19.962781+0000 mgr.y (mgr.24389) 403 : cluster 0 pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-04-19T22:55:21.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[21528]: cluster 2024-04-19T22:55:20.405620+0000 mon.a (mon.0) 2641 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T22:55:21.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:21 smithi113 bash[21528]: cluster 2024-04-19T22:55:20.429793+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-04-19T22:55:21.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:21 smithi178 bash[23441]: cluster 2024-04-19T22:55:19.962781+0000 mgr.y (mgr.24389) 403 : cluster 0 pgmap v601: 228 pgs: 228 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-04-19T22:55:21.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:21 smithi178 bash[23441]: cluster 2024-04-19T22:55:20.405620+0000 mon.a (mon.0) 2641 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T22:55:21.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:21 smithi178 bash[23441]: cluster 2024-04-19T22:55:20.429793+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-04-19T22:55:22.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[21528]: cluster 2024-04-19T22:55:21.431888+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-04-19T22:55:22.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[21528]: audit 2024-04-19T22:55:21.436487+0000 mon.c (mon.2) 676 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[21528]: audit 2024-04-19T22:55:21.459458+0000 mon.a (mon.0) 2644 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[21528]: audit 2024-04-19T22:55:22.425119+0000 mon.a (mon.0) 2645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[21528]: cluster 2024-04-19T22:55:22.433051+0000 mon.a (mon.0) 2646 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[28910]: cluster 2024-04-19T22:55:21.431888+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[28910]: audit 2024-04-19T22:55:21.436487+0000 mon.c (mon.2) 676 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[28910]: audit 2024-04-19T22:55:21.459458+0000 mon.a (mon.0) 2644 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[28910]: audit 2024-04-19T22:55:22.425119+0000 mon.a (mon.0) 2645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:22 smithi113 bash[28910]: cluster 2024-04-19T22:55:22.433051+0000 mon.a (mon.0) 2646 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-04-19T22:55:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:22 smithi178 bash[23441]: cluster 2024-04-19T22:55:21.431888+0000 mon.a (mon.0) 2643 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-04-19T22:55:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:22 smithi178 bash[23441]: audit 2024-04-19T22:55:21.436487+0000 mon.c (mon.2) 676 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:22 smithi178 bash[23441]: audit 2024-04-19T22:55:21.459458+0000 mon.a (mon.0) 2644 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:22 smithi178 bash[23441]: audit 2024-04-19T22:55:22.425119+0000 mon.a (mon.0) 2645 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:22 smithi178 bash[23441]: cluster 2024-04-19T22:55:22.433051+0000 mon.a (mon.0) 2646 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-04-19T22:55:24.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: cluster 2024-04-19T22:55:21.963564+0000 mgr.y (mgr.24389) 404 : cluster 0 pgmap v604: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 0 B/s wr, 177 op/s 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: cluster 2024-04-19T22:55:22.444133+0000 mon.a (mon.0) 2647 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: audit 2024-04-19T22:55:22.513005+0000 mon.c (mon.2) 677 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: audit 2024-04-19T22:55:22.513661+0000 mon.a (mon.0) 2648 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: audit 2024-04-19T22:55:22.514646+0000 mon.c (mon.2) 678 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: audit 2024-04-19T22:55:22.515144+0000 mon.a (mon.0) 2649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[21528]: cluster 2024-04-19T22:55:23.462261+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: cluster 2024-04-19T22:55:21.963564+0000 mgr.y (mgr.24389) 404 : cluster 0 pgmap v604: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 0 B/s wr, 177 op/s 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: cluster 2024-04-19T22:55:22.444133+0000 mon.a (mon.0) 2647 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:24.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: audit 2024-04-19T22:55:22.513005+0000 mon.c (mon.2) 677 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: audit 2024-04-19T22:55:22.513661+0000 mon.a (mon.0) 2648 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: audit 2024-04-19T22:55:22.514646+0000 mon.c (mon.2) 678 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: audit 2024-04-19T22:55:22.515144+0000 mon.a (mon.0) 2649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:23 smithi113 bash[28910]: cluster 2024-04-19T22:55:23.462261+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-04-19T22:55:24.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: cluster 2024-04-19T22:55:21.963564+0000 mgr.y (mgr.24389) 404 : cluster 0 pgmap v604: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 0 B/s wr, 177 op/s 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: cluster 2024-04-19T22:55:22.444133+0000 mon.a (mon.0) 2647 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: audit 2024-04-19T22:55:22.513005+0000 mon.c (mon.2) 677 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: audit 2024-04-19T22:55:22.513661+0000 mon.a (mon.0) 2648 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: audit 2024-04-19T22:55:22.514646+0000 mon.c (mon.2) 678 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: audit 2024-04-19T22:55:22.515144+0000 mon.a (mon.0) 2649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-53"}]: dispatch 2024-04-19T22:55:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:23 smithi178 bash[23441]: cluster 2024-04-19T22:55:23.462261+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-04-19T22:55:25.494 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:25.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[28910]: cluster 2024-04-19T22:55:23.964306+0000 mgr.y (mgr.24389) 405 : cluster 0 pgmap v607: 196 pgs: 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:25.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[28910]: cluster 2024-04-19T22:55:24.465994+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-04-19T22:55:25.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[28910]: audit 2024-04-19T22:55:24.473598+0000 mon.c (mon.2) 679 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:25.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[28910]: audit 2024-04-19T22:55:24.480046+0000 mon.a (mon.0) 2652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:25.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[21528]: cluster 2024-04-19T22:55:23.964306+0000 mgr.y (mgr.24389) 405 : cluster 0 pgmap v607: 196 pgs: 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:25.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[21528]: cluster 2024-04-19T22:55:24.465994+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-04-19T22:55:25.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[21528]: audit 2024-04-19T22:55:24.473598+0000 mon.c (mon.2) 679 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:25.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:25 smithi113 bash[21528]: audit 2024-04-19T22:55:24.480046+0000 mon.a (mon.0) 2652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:25 smithi178 bash[23441]: cluster 2024-04-19T22:55:23.964306+0000 mgr.y (mgr.24389) 405 : cluster 0 pgmap v607: 196 pgs: 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:25 smithi178 bash[23441]: cluster 2024-04-19T22:55:24.465994+0000 mon.a (mon.0) 2651 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-04-19T22:55:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:25 smithi178 bash[23441]: audit 2024-04-19T22:55:24.473598+0000 mon.c (mon.2) 679 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:25 smithi178 bash[23441]: audit 2024-04-19T22:55:24.480046+0000 mon.a (mon.0) 2652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:26.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.101288+0000 mgr.y (mgr.24389) 406 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.461554+0000 mon.a (mon.0) 2653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: cluster 2024-04-19T22:55:25.469111+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.475862+0000 mon.c (mon.2) 680 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.572677+0000 mon.c (mon.2) 681 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.573360+0000 mon.a (mon.0) 2655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.574341+0000 mon.c (mon.2) 682 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[21528]: audit 2024-04-19T22:55:25.574949+0000 mon.a (mon.0) 2656 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.101288+0000 mgr.y (mgr.24389) 406 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.461554+0000 mon.a (mon.0) 2653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:26.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: cluster 2024-04-19T22:55:25.469111+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-04-19T22:55:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.475862+0000 mon.c (mon.2) 680 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.572677+0000 mon.c (mon.2) 681 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.573360+0000 mon.a (mon.0) 2655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.574341+0000 mon.c (mon.2) 682 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:26 smithi113 bash[28910]: audit 2024-04-19T22:55:25.574949+0000 mon.a (mon.0) 2656 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:26.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.101288+0000 mgr.y (mgr.24389) 406 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.461554+0000 mon.a (mon.0) 2653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: cluster 2024-04-19T22:55:25.469111+0000 mon.a (mon.0) 2654 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.475862+0000 mon.c (mon.2) 680 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.572677+0000 mon.c (mon.2) 681 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.573360+0000 mon.a (mon.0) 2655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.574341+0000 mon.c (mon.2) 682 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:26 smithi178 bash[23441]: audit 2024-04-19T22:55:25.574949+0000 mon.a (mon.0) 2656 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-55"}]: dispatch 2024-04-19T22:55:27.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:27 smithi113 bash[21528]: cluster 2024-04-19T22:55:25.965134+0000 mgr.y (mgr.24389) 407 : cluster 0 pgmap v610: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:27.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:27 smithi113 bash[21528]: cluster 2024-04-19T22:55:26.512938+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-04-19T22:55:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:27 smithi113 bash[28910]: cluster 2024-04-19T22:55:25.965134+0000 mgr.y (mgr.24389) 407 : cluster 0 pgmap v610: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:27.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:27 smithi113 bash[28910]: cluster 2024-04-19T22:55:26.512938+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-04-19T22:55:27.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:27 smithi178 bash[23441]: cluster 2024-04-19T22:55:25.965134+0000 mgr.y (mgr.24389) 407 : cluster 0 pgmap v610: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:27.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:27 smithi178 bash[23441]: cluster 2024-04-19T22:55:26.512938+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-04-19T22:55:28.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[21528]: cluster 2024-04-19T22:55:27.519735+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-04-19T22:55:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[21528]: audit 2024-04-19T22:55:27.530380+0000 mon.c (mon.2) 683 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[21528]: audit 2024-04-19T22:55:27.531522+0000 mon.a (mon.0) 2659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[28910]: cluster 2024-04-19T22:55:27.519735+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-04-19T22:55:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[28910]: audit 2024-04-19T22:55:27.530380+0000 mon.c (mon.2) 683 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:28 smithi113 bash[28910]: audit 2024-04-19T22:55:27.531522+0000 mon.a (mon.0) 2659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:28.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:28 smithi178 bash[23441]: cluster 2024-04-19T22:55:27.519735+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-04-19T22:55:28.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:28 smithi178 bash[23441]: audit 2024-04-19T22:55:27.530380+0000 mon.c (mon.2) 683 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:28.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:28 smithi178 bash[23441]: audit 2024-04-19T22:55:27.531522+0000 mon.a (mon.0) 2659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:29.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: cluster 2024-04-19T22:55:27.965966+0000 mgr.y (mgr.24389) 408 : cluster 0 pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: cluster 2024-04-19T22:55:28.511800+0000 mon.a (mon.0) 2660 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: audit 2024-04-19T22:55:28.524056+0000 mon.a (mon.0) 2661 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: cluster 2024-04-19T22:55:28.541049+0000 mon.a (mon.0) 2662 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: audit 2024-04-19T22:55:28.623977+0000 mon.c (mon.2) 684 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: audit 2024-04-19T22:55:28.624536+0000 mon.a (mon.0) 2663 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: audit 2024-04-19T22:55:28.625311+0000 mon.c (mon.2) 685 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[21528]: audit 2024-04-19T22:55:28.625768+0000 mon.a (mon.0) 2664 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: cluster 2024-04-19T22:55:27.965966+0000 mgr.y (mgr.24389) 408 : cluster 0 pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:29.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: cluster 2024-04-19T22:55:28.511800+0000 mon.a (mon.0) 2660 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: audit 2024-04-19T22:55:28.524056+0000 mon.a (mon.0) 2661 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: cluster 2024-04-19T22:55:28.541049+0000 mon.a (mon.0) 2662 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: audit 2024-04-19T22:55:28.623977+0000 mon.c (mon.2) 684 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: audit 2024-04-19T22:55:28.624536+0000 mon.a (mon.0) 2663 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: audit 2024-04-19T22:55:28.625311+0000 mon.c (mon.2) 685 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:29 smithi113 bash[28910]: audit 2024-04-19T22:55:28.625768+0000 mon.a (mon.0) 2664 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:29.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: cluster 2024-04-19T22:55:27.965966+0000 mgr.y (mgr.24389) 408 : cluster 0 pgmap v613: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: cluster 2024-04-19T22:55:28.511800+0000 mon.a (mon.0) 2660 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: audit 2024-04-19T22:55:28.524056+0000 mon.a (mon.0) 2661 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: cluster 2024-04-19T22:55:28.541049+0000 mon.a (mon.0) 2662 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: audit 2024-04-19T22:55:28.623977+0000 mon.c (mon.2) 684 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: audit 2024-04-19T22:55:28.624536+0000 mon.a (mon.0) 2663 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: audit 2024-04-19T22:55:28.625311+0000 mon.c (mon.2) 685 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:29 smithi178 bash[23441]: audit 2024-04-19T22:55:28.625768+0000 mon.a (mon.0) 2664 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-57"}]: dispatch 2024-04-19T22:55:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:30 smithi178 bash[23441]: cluster 2024-04-19T22:55:29.546185+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-04-19T22:55:31.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:30 smithi113 bash[21528]: cluster 2024-04-19T22:55:29.546185+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-04-19T22:55:31.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:30 smithi113 bash[28910]: cluster 2024-04-19T22:55:29.546185+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-04-19T22:55:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[21528]: cluster 2024-04-19T22:55:29.967954+0000 mgr.y (mgr.24389) 409 : cluster 0 pgmap v616: 196 pgs: 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[21528]: cluster 2024-04-19T22:55:30.559981+0000 mon.a (mon.0) 2666 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-04-19T22:55:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[21528]: audit 2024-04-19T22:55:30.568947+0000 mon.c (mon.2) 686 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:32.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[21528]: audit 2024-04-19T22:55:30.571041+0000 mon.a (mon.0) 2667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[28910]: cluster 2024-04-19T22:55:29.967954+0000 mgr.y (mgr.24389) 409 : cluster 0 pgmap v616: 196 pgs: 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[28910]: cluster 2024-04-19T22:55:30.559981+0000 mon.a (mon.0) 2666 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-04-19T22:55:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[28910]: audit 2024-04-19T22:55:30.568947+0000 mon.c (mon.2) 686 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:31 smithi113 bash[28910]: audit 2024-04-19T22:55:30.571041+0000 mon.a (mon.0) 2667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:31 smithi178 bash[23441]: cluster 2024-04-19T22:55:29.967954+0000 mgr.y (mgr.24389) 409 : cluster 0 pgmap v616: 196 pgs: 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:32.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:31 smithi178 bash[23441]: cluster 2024-04-19T22:55:30.559981+0000 mon.a (mon.0) 2666 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-04-19T22:55:32.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:31 smithi178 bash[23441]: audit 2024-04-19T22:55:30.568947+0000 mon.c (mon.2) 686 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:32.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:31 smithi178 bash[23441]: audit 2024-04-19T22:55:30.571041+0000 mon.a (mon.0) 2667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.554100+0000 mon.a (mon.0) 2668 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: cluster 2024-04-19T22:55:31.562896+0000 mon.a (mon.0) 2669 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-04-19T22:55:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.567826+0000 mon.c (mon.2) 687 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:33.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.661608+0000 mon.c (mon.2) 688 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.662191+0000 mon.a (mon.0) 2670 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.663163+0000 mon.c (mon.2) 689 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[21528]: audit 2024-04-19T22:55:31.663682+0000 mon.a (mon.0) 2671 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.554100+0000 mon.a (mon.0) 2668 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: cluster 2024-04-19T22:55:31.562896+0000 mon.a (mon.0) 2669 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.567826+0000 mon.c (mon.2) 687 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.661608+0000 mon.c (mon.2) 688 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.662191+0000 mon.a (mon.0) 2670 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.663163+0000 mon.c (mon.2) 689 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:32 smithi113 bash[28910]: audit 2024-04-19T22:55:31.663682+0000 mon.a (mon.0) 2671 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.554100+0000 mon.a (mon.0) 2668 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: cluster 2024-04-19T22:55:31.562896+0000 mon.a (mon.0) 2669 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-04-19T22:55:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.567826+0000 mon.c (mon.2) 687 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.661608+0000 mon.c (mon.2) 688 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.662191+0000 mon.a (mon.0) 2670 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.663163+0000 mon.c (mon.2) 689 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:32 smithi178 bash[23441]: audit 2024-04-19T22:55:31.663682+0000 mon.a (mon.0) 2671 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-59"}]: dispatch 2024-04-19T22:55:34.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:33 smithi113 bash[21528]: cluster 2024-04-19T22:55:31.968894+0000 mgr.y (mgr.24389) 410 : cluster 0 pgmap v619: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:34.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:33 smithi113 bash[21528]: cluster 2024-04-19T22:55:32.589101+0000 mon.a (mon.0) 2672 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-04-19T22:55:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:33 smithi113 bash[28910]: cluster 2024-04-19T22:55:31.968894+0000 mgr.y (mgr.24389) 410 : cluster 0 pgmap v619: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:33 smithi113 bash[28910]: cluster 2024-04-19T22:55:32.589101+0000 mon.a (mon.0) 2672 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-04-19T22:55:34.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:33 smithi178 bash[23441]: cluster 2024-04-19T22:55:31.968894+0000 mgr.y (mgr.24389) 410 : cluster 0 pgmap v619: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:34.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:33 smithi178 bash[23441]: cluster 2024-04-19T22:55:32.589101+0000 mon.a (mon.0) 2672 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-04-19T22:55:35.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: cluster 2024-04-19T22:55:33.595988+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:33.599712+0000 mon.c (mon.2) 690 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:33.623116+0000 mon.a (mon.0) 2674 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:33.841457+0000 mon.a (mon.0) 2675 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:33.844211+0000 mon.a (mon.0) 2676 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:34.586972+0000 mon.a (mon.0) 2677 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: cluster 2024-04-19T22:55:34.596438+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[21528]: audit 2024-04-19T22:55:34.599882+0000 mon.c (mon.2) 691 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: cluster 2024-04-19T22:55:33.595988+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:33.599712+0000 mon.c (mon.2) 690 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:33.623116+0000 mon.a (mon.0) 2674 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:33.841457+0000 mon.a (mon.0) 2675 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:33.844211+0000 mon.a (mon.0) 2676 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:34.586972+0000 mon.a (mon.0) 2677 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: cluster 2024-04-19T22:55:34.596438+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-04-19T22:55:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:34 smithi113 bash[28910]: audit 2024-04-19T22:55:34.599882+0000 mon.c (mon.2) 691 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:35.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: cluster 2024-04-19T22:55:33.595988+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:33.599712+0000 mon.c (mon.2) 690 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:33.623116+0000 mon.a (mon.0) 2674 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:33.841457+0000 mon.a (mon.0) 2675 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:33.844211+0000 mon.a (mon.0) 2676 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:34.586972+0000 mon.a (mon.0) 2677 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: cluster 2024-04-19T22:55:34.596438+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-04-19T22:55:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:34 smithi178 bash[23441]: audit 2024-04-19T22:55:34.599882+0000 mon.c (mon.2) 691 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:35.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:36.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[28910]: cluster 2024-04-19T22:55:33.969726+0000 mgr.y (mgr.24389) 411 : cluster 0 pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:36.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[28910]: audit 2024-04-19T22:55:34.613836+0000 mon.c (mon.2) 692 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[28910]: audit 2024-04-19T22:55:34.634668+0000 mon.a (mon.0) 2679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[28910]: cluster 2024-04-19T22:55:34.836903+0000 mon.a (mon.0) 2680 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[21528]: cluster 2024-04-19T22:55:33.969726+0000 mgr.y (mgr.24389) 411 : cluster 0 pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[21528]: audit 2024-04-19T22:55:34.613836+0000 mon.c (mon.2) 692 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[21528]: audit 2024-04-19T22:55:34.634668+0000 mon.a (mon.0) 2679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:35 smithi113 bash[21528]: cluster 2024-04-19T22:55:34.836903+0000 mon.a (mon.0) 2680 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:35 smithi178 bash[23441]: cluster 2024-04-19T22:55:33.969726+0000 mgr.y (mgr.24389) 411 : cluster 0 pgmap v622: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:35 smithi178 bash[23441]: audit 2024-04-19T22:55:34.613836+0000 mon.c (mon.2) 692 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:35 smithi178 bash[23441]: audit 2024-04-19T22:55:34.634668+0000 mon.a (mon.0) 2679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:36.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:35 smithi178 bash[23441]: cluster 2024-04-19T22:55:34.836903+0000 mon.a (mon.0) 2680 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:37.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.108643+0000 mgr.y (mgr.24389) 412 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.625797+0000 mon.a (mon.0) 2681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: cluster 2024-04-19T22:55:35.632677+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.722882+0000 mon.c (mon.2) 693 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.723863+0000 mon.a (mon.0) 2683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.725224+0000 mon.c (mon.2) 694 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[28910]: audit 2024-04-19T22:55:35.725951+0000 mon.a (mon.0) 2684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.108643+0000 mgr.y (mgr.24389) 412 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.625797+0000 mon.a (mon.0) 2681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: cluster 2024-04-19T22:55:35.632677+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.722882+0000 mon.c (mon.2) 693 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.723863+0000 mon.a (mon.0) 2683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.725224+0000 mon.c (mon.2) 694 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:36 smithi113 bash[21528]: audit 2024-04-19T22:55:35.725951+0000 mon.a (mon.0) 2684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.108643+0000 mgr.y (mgr.24389) 412 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.625797+0000 mon.a (mon.0) 2681 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: cluster 2024-04-19T22:55:35.632677+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.722882+0000 mon.c (mon.2) 693 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.723863+0000 mon.a (mon.0) 2683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.725224+0000 mon.c (mon.2) 694 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:36 smithi178 bash[23441]: audit 2024-04-19T22:55:35.725951+0000 mon.a (mon.0) 2684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-61"}]: dispatch 2024-04-19T22:55:37.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:37 smithi113 bash[28910]: cluster 2024-04-19T22:55:35.970695+0000 mgr.y (mgr.24389) 413 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:37 smithi113 bash[28910]: cluster 2024-04-19T22:55:36.636058+0000 mon.a (mon.0) 2685 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-04-19T22:55:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:37 smithi113 bash[21528]: cluster 2024-04-19T22:55:35.970695+0000 mgr.y (mgr.24389) 413 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:37 smithi113 bash[21528]: cluster 2024-04-19T22:55:36.636058+0000 mon.a (mon.0) 2685 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-04-19T22:55:38.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:37 smithi178 bash[23441]: cluster 2024-04-19T22:55:35.970695+0000 mgr.y (mgr.24389) 413 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:38.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:37 smithi178 bash[23441]: cluster 2024-04-19T22:55:36.636058+0000 mon.a (mon.0) 2685 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-04-19T22:55:39.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[21528]: cluster 2024-04-19T22:55:37.662020+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[21528]: audit 2024-04-19T22:55:37.672626+0000 mon.c (mon.2) 695 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[21528]: audit 2024-04-19T22:55:37.673760+0000 mon.a (mon.0) 2687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[21528]: cluster 2024-04-19T22:55:37.971540+0000 mgr.y (mgr.24389) 414 : cluster 0 pgmap v628: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[28910]: cluster 2024-04-19T22:55:37.662020+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[28910]: audit 2024-04-19T22:55:37.672626+0000 mon.c (mon.2) 695 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[28910]: audit 2024-04-19T22:55:37.673760+0000 mon.a (mon.0) 2687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:38 smithi113 bash[28910]: cluster 2024-04-19T22:55:37.971540+0000 mgr.y (mgr.24389) 414 : cluster 0 pgmap v628: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:38 smithi178 bash[23441]: cluster 2024-04-19T22:55:37.662020+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-04-19T22:55:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:38 smithi178 bash[23441]: audit 2024-04-19T22:55:37.672626+0000 mon.c (mon.2) 695 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:38 smithi178 bash[23441]: audit 2024-04-19T22:55:37.673760+0000 mon.a (mon.0) 2687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:55:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:38 smithi178 bash[23441]: cluster 2024-04-19T22:55:37.971540+0000 mgr.y (mgr.24389) 414 : cluster 0 pgmap v628: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:55:40.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[28910]: audit 2024-04-19T22:55:38.664675+0000 mon.a (mon.0) 2688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:40.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[28910]: cluster 2024-04-19T22:55:38.676228+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[28910]: audit 2024-04-19T22:55:38.680356+0000 mon.c (mon.2) 696 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[28910]: audit 2024-04-19T22:55:38.696190+0000 mon.c (mon.2) 697 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[28910]: audit 2024-04-19T22:55:38.697286+0000 mon.a (mon.0) 2690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[21528]: audit 2024-04-19T22:55:38.664675+0000 mon.a (mon.0) 2688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[21528]: cluster 2024-04-19T22:55:38.676228+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[21528]: audit 2024-04-19T22:55:38.680356+0000 mon.c (mon.2) 696 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[21528]: audit 2024-04-19T22:55:38.696190+0000 mon.c (mon.2) 697 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:40.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:39 smithi113 bash[21528]: audit 2024-04-19T22:55:38.697286+0000 mon.a (mon.0) 2690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:39 smithi178 bash[23441]: audit 2024-04-19T22:55:38.664675+0000 mon.a (mon.0) 2688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:55:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:39 smithi178 bash[23441]: cluster 2024-04-19T22:55:38.676228+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-04-19T22:55:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:39 smithi178 bash[23441]: audit 2024-04-19T22:55:38.680356+0000 mon.c (mon.2) 696 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:55:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:39 smithi178 bash[23441]: audit 2024-04-19T22:55:38.696190+0000 mon.c (mon.2) 697 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:39 smithi178 bash[23441]: audit 2024-04-19T22:55:38.697286+0000 mon.a (mon.0) 2690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:55:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[28910]: audit 2024-04-19T22:55:39.675056+0000 mon.a (mon.0) 2691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[28910]: cluster 2024-04-19T22:55:39.682904+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-04-19T22:55:41.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[28910]: cluster 2024-04-19T22:55:39.973574+0000 mgr.y (mgr.24389) 415 : cluster 0 pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:41.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[21528]: audit 2024-04-19T22:55:39.675056+0000 mon.a (mon.0) 2691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:41.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[21528]: cluster 2024-04-19T22:55:39.682904+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-04-19T22:55:41.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:40 smithi113 bash[21528]: cluster 2024-04-19T22:55:39.973574+0000 mgr.y (mgr.24389) 415 : cluster 0 pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:40 smithi178 bash[23441]: audit 2024-04-19T22:55:39.675056+0000 mon.a (mon.0) 2691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:55:41.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:40 smithi178 bash[23441]: cluster 2024-04-19T22:55:39.682904+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-04-19T22:55:41.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:40 smithi178 bash[23441]: cluster 2024-04-19T22:55:39.973574+0000 mgr.y (mgr.24389) 415 : cluster 0 pgmap v631: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:41 smithi113 bash[21528]: cluster 2024-04-19T22:55:40.675046+0000 mon.a (mon.0) 2693 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:42.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:41 smithi113 bash[21528]: cluster 2024-04-19T22:55:40.694485+0000 mon.a (mon.0) 2694 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-04-19T22:55:42.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:41 smithi113 bash[28910]: cluster 2024-04-19T22:55:40.675046+0000 mon.a (mon.0) 2693 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:42.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:41 smithi113 bash[28910]: cluster 2024-04-19T22:55:40.694485+0000 mon.a (mon.0) 2694 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-04-19T22:55:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:41 smithi178 bash[23441]: cluster 2024-04-19T22:55:40.675046+0000 mon.a (mon.0) 2693 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:55:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:41 smithi178 bash[23441]: cluster 2024-04-19T22:55:40.694485+0000 mon.a (mon.0) 2694 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-04-19T22:55:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:42 smithi113 bash[21528]: cluster 2024-04-19T22:55:41.696433+0000 mon.a (mon.0) 2695 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-04-19T22:55:43.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:42 smithi113 bash[21528]: cluster 2024-04-19T22:55:41.974347+0000 mgr.y (mgr.24389) 416 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:42 smithi113 bash[28910]: cluster 2024-04-19T22:55:41.696433+0000 mon.a (mon.0) 2695 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-04-19T22:55:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:42 smithi113 bash[28910]: cluster 2024-04-19T22:55:41.974347+0000 mgr.y (mgr.24389) 416 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:42 smithi178 bash[23441]: cluster 2024-04-19T22:55:41.696433+0000 mon.a (mon.0) 2695 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-04-19T22:55:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:42 smithi178 bash[23441]: cluster 2024-04-19T22:55:41.974347+0000 mgr.y (mgr.24389) 416 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-04-19T22:55:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:43 smithi113 bash[28910]: cluster 2024-04-19T22:55:42.719422+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-04-19T22:55:44.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:43 smithi113 bash[21528]: cluster 2024-04-19T22:55:42.719422+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-04-19T22:55:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:43 smithi178 bash[23441]: cluster 2024-04-19T22:55:42.719422+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-04-19T22:55:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:44 smithi113 bash[21528]: cluster 2024-04-19T22:55:43.727698+0000 mon.a (mon.0) 2697 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-04-19T22:55:45.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:44 smithi113 bash[21528]: cluster 2024-04-19T22:55:43.975163+0000 mgr.y (mgr.24389) 417 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:44 smithi113 bash[28910]: cluster 2024-04-19T22:55:43.727698+0000 mon.a (mon.0) 2697 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-04-19T22:55:45.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:44 smithi113 bash[28910]: cluster 2024-04-19T22:55:43.975163+0000 mgr.y (mgr.24389) 417 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:44 smithi178 bash[23441]: cluster 2024-04-19T22:55:43.727698+0000 mon.a (mon.0) 2697 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-04-19T22:55:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:44 smithi178 bash[23441]: cluster 2024-04-19T22:55:43.975163+0000 mgr.y (mgr.24389) 417 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:55:45.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:46.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:45 smithi113 bash[21528]: audit 2024-04-19T22:55:45.116360+0000 mgr.y (mgr.24389) 418 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:45 smithi113 bash[28910]: audit 2024-04-19T22:55:45.116360+0000 mgr.y (mgr.24389) 418 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:45 smithi178 bash[23441]: audit 2024-04-19T22:55:45.116360+0000 mgr.y (mgr.24389) 418 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:47.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:46 smithi113 bash[21528]: cluster 2024-04-19T22:55:45.977465+0000 mgr.y (mgr.24389) 419 : cluster 0 pgmap v638: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:55:47.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:46 smithi113 bash[28910]: cluster 2024-04-19T22:55:45.977465+0000 mgr.y (mgr.24389) 419 : cluster 0 pgmap v638: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:55:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:46 smithi178 bash[23441]: cluster 2024-04-19T22:55:45.977465+0000 mgr.y (mgr.24389) 419 : cluster 0 pgmap v638: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:55:47.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:49.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:49 smithi113 bash[28910]: cluster 2024-04-19T22:55:47.978472+0000 mgr.y (mgr.24389) 420 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 977 B/s wr, 3 op/s 2024-04-19T22:55:49.298 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:49 smithi113 bash[28910]: audit 2024-04-19T22:55:48.878749+0000 mon.a (mon.0) 2698 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:49.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:49 smithi113 bash[21528]: cluster 2024-04-19T22:55:47.978472+0000 mgr.y (mgr.24389) 420 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 977 B/s wr, 3 op/s 2024-04-19T22:55:49.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:49 smithi113 bash[21528]: audit 2024-04-19T22:55:48.878749+0000 mon.a (mon.0) 2698 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:49.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:49 smithi178 bash[23441]: cluster 2024-04-19T22:55:47.978472+0000 mgr.y (mgr.24389) 420 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 977 B/s wr, 3 op/s 2024-04-19T22:55:49.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:49 smithi178 bash[23441]: audit 2024-04-19T22:55:48.878749+0000 mon.a (mon.0) 2698 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:55:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:51 smithi113 bash[28910]: cluster 2024-04-19T22:55:49.980548+0000 mgr.y (mgr.24389) 421 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:55:51.296 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:51 smithi113 bash[28910]: cluster 2024-04-19T22:55:50.956316+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-04-19T22:55:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:51 smithi113 bash[21528]: cluster 2024-04-19T22:55:49.980548+0000 mgr.y (mgr.24389) 421 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:55:51.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:51 smithi113 bash[21528]: cluster 2024-04-19T22:55:50.956316+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-04-19T22:55:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:51 smithi178 bash[23441]: cluster 2024-04-19T22:55:49.980548+0000 mgr.y (mgr.24389) 421 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-19T22:55:51.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:51 smithi178 bash[23441]: cluster 2024-04-19T22:55:50.956316+0000 mon.a (mon.0) 2699 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-04-19T22:55:52.304 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:52 smithi178 bash[23441]: audit 2024-04-19T22:55:51.884988+0000 mon.a (mon.0) 2700 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:55:52.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:52 smithi113 bash[21528]: audit 2024-04-19T22:55:51.884988+0000 mon.a (mon.0) 2700 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:55:52.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:52 smithi113 bash[28910]: audit 2024-04-19T22:55:51.884988+0000 mon.a (mon.0) 2700 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:55:53.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:53 smithi178 bash[23441]: cluster 2024-04-19T22:55:51.981299+0000 mgr.y (mgr.24389) 422 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 743 B/s wr, 3 op/s 2024-04-19T22:55:53.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:53 smithi178 bash[23441]: audit 2024-04-19T22:55:52.618465+0000 mon.a (mon.0) 2701 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:55:53.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:53 smithi178 bash[23441]: audit 2024-04-19T22:55:52.620142+0000 mon.a (mon.0) 2702 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:55:53.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:53 smithi178 bash[23441]: audit 2024-04-19T22:55:52.631167+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:53.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[28910]: cluster 2024-04-19T22:55:51.981299+0000 mgr.y (mgr.24389) 422 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 743 B/s wr, 3 op/s 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[28910]: audit 2024-04-19T22:55:52.618465+0000 mon.a (mon.0) 2701 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[28910]: audit 2024-04-19T22:55:52.620142+0000 mon.a (mon.0) 2702 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[28910]: audit 2024-04-19T22:55:52.631167+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[21528]: cluster 2024-04-19T22:55:51.981299+0000 mgr.y (mgr.24389) 422 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 743 B/s wr, 3 op/s 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[21528]: audit 2024-04-19T22:55:52.618465+0000 mon.a (mon.0) 2701 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[21528]: audit 2024-04-19T22:55:52.620142+0000 mon.a (mon.0) 2702 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:55:53.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:53 smithi113 bash[21528]: audit 2024-04-19T22:55:52.631167+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:55:55.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:55 smithi113 bash[21528]: cluster 2024-04-19T22:55:53.982097+0000 mgr.y (mgr.24389) 423 : cluster 0 pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-19T22:55:55.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:55 smithi113 bash[21528]: cluster 2024-04-19T22:55:54.070472+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-04-19T22:55:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:55 smithi113 bash[28910]: cluster 2024-04-19T22:55:53.982097+0000 mgr.y (mgr.24389) 423 : cluster 0 pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-19T22:55:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:55 smithi113 bash[28910]: cluster 2024-04-19T22:55:54.070472+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-04-19T22:55:55.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:55:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:55:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:55 smithi178 bash[23441]: cluster 2024-04-19T22:55:53.982097+0000 mgr.y (mgr.24389) 423 : cluster 0 pgmap v643: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 613 B/s wr, 2 op/s 2024-04-19T22:55:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:55 smithi178 bash[23441]: cluster 2024-04-19T22:55:54.070472+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-04-19T22:55:56.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:56 smithi113 bash[21528]: audit 2024-04-19T22:55:55.126905+0000 mgr.y (mgr.24389) 424 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:56.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:56 smithi113 bash[28910]: audit 2024-04-19T22:55:55.126905+0000 mgr.y (mgr.24389) 424 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:56 smithi178 bash[23441]: audit 2024-04-19T22:55:55.126905+0000 mgr.y (mgr.24389) 424 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:55:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:57 smithi113 bash[28910]: cluster 2024-04-19T22:55:55.984263+0000 mgr.y (mgr.24389) 425 : cluster 0 pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:57 smithi113 bash[21528]: cluster 2024-04-19T22:55:55.984263+0000 mgr.y (mgr.24389) 425 : cluster 0 pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:57 smithi178 bash[23441]: cluster 2024-04-19T22:55:55.984263+0000 mgr.y (mgr.24389) 425 : cluster 0 pgmap v645: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:57.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:55:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:55:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:55:59.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:55:59 smithi113 bash[28910]: cluster 2024-04-19T22:55:57.985101+0000 mgr.y (mgr.24389) 426 : cluster 0 pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:59.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:55:59 smithi113 bash[21528]: cluster 2024-04-19T22:55:57.985101+0000 mgr.y (mgr.24389) 426 : cluster 0 pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:55:59.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:55:59 smithi178 bash[23441]: cluster 2024-04-19T22:55:57.985101+0000 mgr.y (mgr.24389) 426 : cluster 0 pgmap v646: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:01.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:01 smithi113 bash[21528]: cluster 2024-04-19T22:55:59.987243+0000 mgr.y (mgr.24389) 427 : cluster 0 pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:01.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:01 smithi113 bash[21528]: cluster 2024-04-19T22:56:00.960793+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-04-19T22:56:01.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:01 smithi113 bash[28910]: cluster 2024-04-19T22:55:59.987243+0000 mgr.y (mgr.24389) 427 : cluster 0 pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:01.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:01 smithi113 bash[28910]: cluster 2024-04-19T22:56:00.960793+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-04-19T22:56:01.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:01 smithi178 bash[23441]: cluster 2024-04-19T22:55:59.987243+0000 mgr.y (mgr.24389) 427 : cluster 0 pgmap v647: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:01.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:01 smithi178 bash[23441]: cluster 2024-04-19T22:56:00.960793+0000 mon.a (mon.0) 2705 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-04-19T22:56:03.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:03 smithi113 bash[28910]: cluster 2024-04-19T22:56:01.988097+0000 mgr.y (mgr.24389) 428 : cluster 0 pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:03.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:03 smithi113 bash[21528]: cluster 2024-04-19T22:56:01.988097+0000 mgr.y (mgr.24389) 428 : cluster 0 pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:03.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:03 smithi178 bash[23441]: cluster 2024-04-19T22:56:01.988097+0000 mgr.y (mgr.24389) 428 : cluster 0 pgmap v649: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:04.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:04 smithi113 bash[28910]: audit 2024-04-19T22:56:03.912256+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:04.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:04 smithi113 bash[21528]: audit 2024-04-19T22:56:03.912256+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:04 smithi178 bash[23441]: audit 2024-04-19T22:56:03.912256+0000 mon.a (mon.0) 2706 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:05.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:05 smithi113 bash[28910]: cluster 2024-04-19T22:56:03.988917+0000 mgr.y (mgr.24389) 429 : cluster 0 pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:05.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:05 smithi113 bash[28910]: cluster 2024-04-19T22:56:04.111576+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-04-19T22:56:05.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:05 smithi113 bash[21528]: cluster 2024-04-19T22:56:03.988917+0000 mgr.y (mgr.24389) 429 : cluster 0 pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:05.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:05 smithi113 bash[21528]: cluster 2024-04-19T22:56:04.111576+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-04-19T22:56:05.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:05.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:05 smithi178 bash[23441]: cluster 2024-04-19T22:56:03.988917+0000 mgr.y (mgr.24389) 429 : cluster 0 pgmap v650: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:56:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:05 smithi178 bash[23441]: cluster 2024-04-19T22:56:04.111576+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-04-19T22:56:06.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:06 smithi113 bash[28910]: audit 2024-04-19T22:56:05.134843+0000 mgr.y (mgr.24389) 430 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:06.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:06 smithi113 bash[21528]: audit 2024-04-19T22:56:05.134843+0000 mgr.y (mgr.24389) 430 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:06 smithi178 bash[23441]: audit 2024-04-19T22:56:05.134843+0000 mgr.y (mgr.24389) 430 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:07 smithi113 bash[28910]: cluster 2024-04-19T22:56:05.991133+0000 mgr.y (mgr.24389) 431 : cluster 0 pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:07.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:07 smithi113 bash[21528]: cluster 2024-04-19T22:56:05.991133+0000 mgr.y (mgr.24389) 431 : cluster 0 pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:07.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:07 smithi178 bash[23441]: cluster 2024-04-19T22:56:05.991133+0000 mgr.y (mgr.24389) 431 : cluster 0 pgmap v652: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:07.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:09.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:09 smithi113 bash[28910]: cluster 2024-04-19T22:56:07.991940+0000 mgr.y (mgr.24389) 432 : cluster 0 pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:56:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:09 smithi113 bash[21528]: cluster 2024-04-19T22:56:07.991940+0000 mgr.y (mgr.24389) 432 : cluster 0 pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:56:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:09 smithi178 bash[23441]: cluster 2024-04-19T22:56:07.991940+0000 mgr.y (mgr.24389) 432 : cluster 0 pgmap v653: 228 pgs: 228 active+clean; 8.4 MiB data, 567 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-04-19T22:56:11.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:11 smithi113 bash[21528]: cluster 2024-04-19T22:56:09.994031+0000 mgr.y (mgr.24389) 433 : cluster 0 pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:56:11.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:11 smithi113 bash[21528]: cluster 2024-04-19T22:56:10.963458+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-04-19T22:56:11.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:11 smithi113 bash[28910]: cluster 2024-04-19T22:56:09.994031+0000 mgr.y (mgr.24389) 433 : cluster 0 pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:56:11.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:11 smithi113 bash[28910]: cluster 2024-04-19T22:56:10.963458+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-04-19T22:56:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:11 smithi178 bash[23441]: cluster 2024-04-19T22:56:09.994031+0000 mgr.y (mgr.24389) 433 : cluster 0 pgmap v654: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:56:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:11 smithi178 bash[23441]: cluster 2024-04-19T22:56:10.963458+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-04-19T22:56:13.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:13 smithi113 bash[21528]: cluster 2024-04-19T22:56:11.994851+0000 mgr.y (mgr.24389) 434 : cluster 0 pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:13.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:13 smithi113 bash[28910]: cluster 2024-04-19T22:56:11.994851+0000 mgr.y (mgr.24389) 434 : cluster 0 pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:13.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:13 smithi178 bash[23441]: cluster 2024-04-19T22:56:11.994851+0000 mgr.y (mgr.24389) 434 : cluster 0 pgmap v656: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-04-19T22:56:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[21528]: cluster 2024-04-19T22:56:13.995680+0000 mgr.y (mgr.24389) 435 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T22:56:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[21528]: audit 2024-04-19T22:56:14.153408+0000 mon.c (mon.2) 698 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[21528]: audit 2024-04-19T22:56:14.154165+0000 mon.a (mon.0) 2709 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[21528]: audit 2024-04-19T22:56:14.155446+0000 mon.c (mon.2) 699 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:15.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[21528]: audit 2024-04-19T22:56:14.156068+0000 mon.a (mon.0) 2710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[28910]: cluster 2024-04-19T22:56:13.995680+0000 mgr.y (mgr.24389) 435 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T22:56:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[28910]: audit 2024-04-19T22:56:14.153408+0000 mon.c (mon.2) 698 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[28910]: audit 2024-04-19T22:56:14.154165+0000 mon.a (mon.0) 2709 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[28910]: audit 2024-04-19T22:56:14.155446+0000 mon.c (mon.2) 699 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:15 smithi113 bash[28910]: audit 2024-04-19T22:56:14.156068+0000 mon.a (mon.0) 2710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:15.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[23441]: cluster 2024-04-19T22:56:13.995680+0000 mgr.y (mgr.24389) 435 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T22:56:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[23441]: audit 2024-04-19T22:56:14.153408+0000 mon.c (mon.2) 698 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[23441]: audit 2024-04-19T22:56:14.154165+0000 mon.a (mon.0) 2709 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[23441]: audit 2024-04-19T22:56:14.155446+0000 mon.c (mon.2) 699 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:15 smithi178 bash[23441]: audit 2024-04-19T22:56:14.156068+0000 mon.a (mon.0) 2710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-63"}]: dispatch 2024-04-19T22:56:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:16 smithi113 bash[21528]: audit 2024-04-19T22:56:15.144363+0000 mgr.y (mgr.24389) 436 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:16.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:16 smithi113 bash[21528]: cluster 2024-04-19T22:56:15.148411+0000 mon.a (mon.0) 2711 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-04-19T22:56:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:16 smithi113 bash[28910]: audit 2024-04-19T22:56:15.144363+0000 mgr.y (mgr.24389) 436 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:16.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:16 smithi113 bash[28910]: cluster 2024-04-19T22:56:15.148411+0000 mon.a (mon.0) 2711 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-04-19T22:56:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:16 smithi178 bash[23441]: audit 2024-04-19T22:56:15.144363+0000 mgr.y (mgr.24389) 436 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:16 smithi178 bash[23441]: cluster 2024-04-19T22:56:15.148411+0000 mon.a (mon.0) 2711 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[28910]: cluster 2024-04-19T22:56:15.996468+0000 mgr.y (mgr.24389) 437 : cluster 0 pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[28910]: cluster 2024-04-19T22:56:16.164919+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[28910]: audit 2024-04-19T22:56:16.167529+0000 mon.c (mon.2) 700 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[28910]: audit 2024-04-19T22:56:16.174287+0000 mon.a (mon.0) 2713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[21528]: cluster 2024-04-19T22:56:15.996468+0000 mgr.y (mgr.24389) 437 : cluster 0 pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[21528]: cluster 2024-04-19T22:56:16.164919+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-04-19T22:56:17.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[21528]: audit 2024-04-19T22:56:16.167529+0000 mon.c (mon.2) 700 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[21528]: audit 2024-04-19T22:56:16.174287+0000 mon.a (mon.0) 2713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:17 smithi178 bash[23441]: cluster 2024-04-19T22:56:15.996468+0000 mgr.y (mgr.24389) 437 : cluster 0 pgmap v659: 196 pgs: 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:17 smithi178 bash[23441]: cluster 2024-04-19T22:56:16.164919+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-04-19T22:56:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:17 smithi178 bash[23441]: audit 2024-04-19T22:56:16.167529+0000 mon.c (mon.2) 700 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:17 smithi178 bash[23441]: audit 2024-04-19T22:56:16.174287+0000 mon.a (mon.0) 2713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:17.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[21528]: audit 2024-04-19T22:56:17.158078+0000 mon.a (mon.0) 2714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[21528]: cluster 2024-04-19T22:56:17.167533+0000 mon.a (mon.0) 2715 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[21528]: audit 2024-04-19T22:56:17.171925+0000 mon.c (mon.2) 701 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[21528]: audit 2024-04-19T22:56:17.201056+0000 mon.c (mon.2) 702 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[21528]: audit 2024-04-19T22:56:17.202237+0000 mon.a (mon.0) 2716 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[28910]: audit 2024-04-19T22:56:17.158078+0000 mon.a (mon.0) 2714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:18.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[28910]: cluster 2024-04-19T22:56:17.167533+0000 mon.a (mon.0) 2715 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-04-19T22:56:18.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[28910]: audit 2024-04-19T22:56:17.171925+0000 mon.c (mon.2) 701 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:18.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[28910]: audit 2024-04-19T22:56:17.201056+0000 mon.c (mon.2) 702 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:18.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:18 smithi113 bash[28910]: audit 2024-04-19T22:56:17.202237+0000 mon.a (mon.0) 2716 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:18 smithi178 bash[23441]: audit 2024-04-19T22:56:17.158078+0000 mon.a (mon.0) 2714 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:18 smithi178 bash[23441]: cluster 2024-04-19T22:56:17.167533+0000 mon.a (mon.0) 2715 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-04-19T22:56:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:18 smithi178 bash[23441]: audit 2024-04-19T22:56:17.171925+0000 mon.c (mon.2) 701 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:18 smithi178 bash[23441]: audit 2024-04-19T22:56:17.201056+0000 mon.c (mon.2) 702 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:18.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:18 smithi178 bash[23441]: audit 2024-04-19T22:56:17.202237+0000 mon.a (mon.0) 2716 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[28910]: cluster 2024-04-19T22:56:17.997304+0000 mgr.y (mgr.24389) 438 : cluster 0 pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[28910]: audit 2024-04-19T22:56:18.183706+0000 mon.a (mon.0) 2717 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[28910]: cluster 2024-04-19T22:56:18.195752+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[28910]: audit 2024-04-19T22:56:18.945107+0000 mon.a (mon.0) 2719 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[21528]: cluster 2024-04-19T22:56:17.997304+0000 mgr.y (mgr.24389) 438 : cluster 0 pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[21528]: audit 2024-04-19T22:56:18.183706+0000 mon.a (mon.0) 2717 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:19.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[21528]: cluster 2024-04-19T22:56:18.195752+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-04-19T22:56:19.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:19 smithi113 bash[21528]: audit 2024-04-19T22:56:18.945107+0000 mon.a (mon.0) 2719 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:19.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:19 smithi178 bash[23441]: cluster 2024-04-19T22:56:17.997304+0000 mgr.y (mgr.24389) 438 : cluster 0 pgmap v662: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 572 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:19.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:19 smithi178 bash[23441]: audit 2024-04-19T22:56:18.183706+0000 mon.a (mon.0) 2717 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:19.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:19 smithi178 bash[23441]: cluster 2024-04-19T22:56:18.195752+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-04-19T22:56:19.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:19 smithi178 bash[23441]: audit 2024-04-19T22:56:18.945107+0000 mon.a (mon.0) 2719 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:20.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:20 smithi113 bash[21528]: cluster 2024-04-19T22:56:19.201310+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-04-19T22:56:20.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:20 smithi113 bash[28910]: cluster 2024-04-19T22:56:19.201310+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-04-19T22:56:20.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:20 smithi178 bash[23441]: cluster 2024-04-19T22:56:19.201310+0000 mon.a (mon.0) 2720 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-04-19T22:56:21.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:21 smithi113 bash[21528]: cluster 2024-04-19T22:56:19.999453+0000 mgr.y (mgr.24389) 439 : cluster 0 pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:21.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:21 smithi113 bash[21528]: cluster 2024-04-19T22:56:20.211404+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-04-19T22:56:21.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:21 smithi113 bash[28910]: cluster 2024-04-19T22:56:19.999453+0000 mgr.y (mgr.24389) 439 : cluster 0 pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:21.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:21 smithi113 bash[28910]: cluster 2024-04-19T22:56:20.211404+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-04-19T22:56:21.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:21 smithi178 bash[23441]: cluster 2024-04-19T22:56:19.999453+0000 mgr.y (mgr.24389) 439 : cluster 0 pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:21.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:21 smithi178 bash[23441]: cluster 2024-04-19T22:56:20.211404+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-04-19T22:56:22.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:22 smithi113 bash[21528]: cluster 2024-04-19T22:56:21.219469+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-04-19T22:56:22.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:22 smithi113 bash[28910]: cluster 2024-04-19T22:56:21.219469+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-04-19T22:56:22.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:22 smithi178 bash[23441]: cluster 2024-04-19T22:56:21.219469+0000 mon.a (mon.0) 2722 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-04-19T22:56:23.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:23 smithi113 bash[21528]: cluster 2024-04-19T22:56:22.000302+0000 mgr.y (mgr.24389) 440 : cluster 0 pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:23.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:23 smithi113 bash[28910]: cluster 2024-04-19T22:56:22.000302+0000 mgr.y (mgr.24389) 440 : cluster 0 pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:23.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:23 smithi178 bash[23441]: cluster 2024-04-19T22:56:22.000302+0000 mgr.y (mgr.24389) 440 : cluster 0 pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-04-19T22:56:25.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:25 smithi113 bash[21528]: cluster 2024-04-19T22:56:24.001203+0000 mgr.y (mgr.24389) 441 : cluster 0 pgmap v669: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:56:25.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:25 smithi113 bash[28910]: cluster 2024-04-19T22:56:24.001203+0000 mgr.y (mgr.24389) 441 : cluster 0 pgmap v669: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:56:25.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:25.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:25 smithi178 bash[23441]: cluster 2024-04-19T22:56:24.001203+0000 mgr.y (mgr.24389) 441 : cluster 0 pgmap v669: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-04-19T22:56:26.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:26 smithi113 bash[28910]: audit 2024-04-19T22:56:25.155812+0000 mgr.y (mgr.24389) 442 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:26.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:26 smithi113 bash[21528]: audit 2024-04-19T22:56:25.155812+0000 mgr.y (mgr.24389) 442 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:26.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:26 smithi178 bash[23441]: audit 2024-04-19T22:56:25.155812+0000 mgr.y (mgr.24389) 442 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:27.546 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:27 smithi113 bash[21528]: cluster 2024-04-19T22:56:26.003455+0000 mgr.y (mgr.24389) 443 : cluster 0 pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-19T22:56:27.547 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:27.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:27 smithi113 bash[28910]: cluster 2024-04-19T22:56:26.003455+0000 mgr.y (mgr.24389) 443 : cluster 0 pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-19T22:56:27.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:27 smithi178 bash[23441]: cluster 2024-04-19T22:56:26.003455+0000 mgr.y (mgr.24389) 443 : cluster 0 pgmap v670: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-04-19T22:56:29.546 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:29 smithi113 bash[28910]: cluster 2024-04-19T22:56:28.004287+0000 mgr.y (mgr.24389) 444 : cluster 0 pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:56:29.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:29 smithi113 bash[21528]: cluster 2024-04-19T22:56:28.004287+0000 mgr.y (mgr.24389) 444 : cluster 0 pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:56:29.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:29 smithi178 bash[23441]: cluster 2024-04-19T22:56:28.004287+0000 mgr.y (mgr.24389) 444 : cluster 0 pgmap v671: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:56:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:31 smithi113 bash[28910]: cluster 2024-04-19T22:56:30.006453+0000 mgr.y (mgr.24389) 445 : cluster 0 pgmap v672: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 208 B/s wr, 2 op/s 2024-04-19T22:56:31.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:31 smithi113 bash[28910]: cluster 2024-04-19T22:56:30.972962+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-04-19T22:56:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:31 smithi113 bash[21528]: cluster 2024-04-19T22:56:30.006453+0000 mgr.y (mgr.24389) 445 : cluster 0 pgmap v672: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 208 B/s wr, 2 op/s 2024-04-19T22:56:31.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:31 smithi113 bash[21528]: cluster 2024-04-19T22:56:30.972962+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-04-19T22:56:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:31 smithi178 bash[23441]: cluster 2024-04-19T22:56:30.006453+0000 mgr.y (mgr.24389) 445 : cluster 0 pgmap v672: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 208 B/s wr, 2 op/s 2024-04-19T22:56:31.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:31 smithi178 bash[23441]: cluster 2024-04-19T22:56:30.972962+0000 mon.a (mon.0) 2723 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[28910]: audit 2024-04-19T22:56:31.284662+0000 mon.c (mon.2) 703 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[28910]: audit 2024-04-19T22:56:31.285389+0000 mon.a (mon.0) 2724 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[28910]: audit 2024-04-19T22:56:31.286626+0000 mon.c (mon.2) 704 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[28910]: audit 2024-04-19T22:56:31.287312+0000 mon.a (mon.0) 2725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[21528]: audit 2024-04-19T22:56:31.284662+0000 mon.c (mon.2) 703 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[21528]: audit 2024-04-19T22:56:31.285389+0000 mon.a (mon.0) 2724 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[21528]: audit 2024-04-19T22:56:31.286626+0000 mon.c (mon.2) 704 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:32.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:32 smithi113 bash[21528]: audit 2024-04-19T22:56:31.287312+0000 mon.a (mon.0) 2725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:32 smithi178 bash[23441]: audit 2024-04-19T22:56:31.284662+0000 mon.c (mon.2) 703 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:32 smithi178 bash[23441]: audit 2024-04-19T22:56:31.285389+0000 mon.a (mon.0) 2724 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:32.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:32 smithi178 bash[23441]: audit 2024-04-19T22:56:31.286626+0000 mon.c (mon.2) 704 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:32.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:32 smithi178 bash[23441]: audit 2024-04-19T22:56:31.287312+0000 mon.a (mon.0) 2725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-65"}]: dispatch 2024-04-19T22:56:33.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:33 smithi113 bash[21528]: cluster 2024-04-19T22:56:32.007259+0000 mgr.y (mgr.24389) 446 : cluster 0 pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-19T22:56:33.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:33 smithi113 bash[21528]: cluster 2024-04-19T22:56:32.273574+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-04-19T22:56:33.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:33 smithi113 bash[28910]: cluster 2024-04-19T22:56:32.007259+0000 mgr.y (mgr.24389) 446 : cluster 0 pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-19T22:56:33.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:33 smithi113 bash[28910]: cluster 2024-04-19T22:56:32.273574+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-04-19T22:56:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:33 smithi178 bash[23441]: cluster 2024-04-19T22:56:32.007259+0000 mgr.y (mgr.24389) 446 : cluster 0 pgmap v674: 228 pgs: 228 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-19T22:56:33.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:33 smithi178 bash[23441]: cluster 2024-04-19T22:56:32.273574+0000 mon.a (mon.0) 2726 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[28910]: cluster 2024-04-19T22:56:33.284999+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[28910]: audit 2024-04-19T22:56:33.291852+0000 mon.c (mon.2) 705 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[28910]: audit 2024-04-19T22:56:33.300548+0000 mon.a (mon.0) 2728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[28910]: audit 2024-04-19T22:56:33.978660+0000 mon.a (mon.0) 2729 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[21528]: cluster 2024-04-19T22:56:33.284999+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[21528]: audit 2024-04-19T22:56:33.291852+0000 mon.c (mon.2) 705 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[21528]: audit 2024-04-19T22:56:33.300548+0000 mon.a (mon.0) 2728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:34 smithi113 bash[21528]: audit 2024-04-19T22:56:33.978660+0000 mon.a (mon.0) 2729 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:34.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:34 smithi178 bash[23441]: cluster 2024-04-19T22:56:33.284999+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-04-19T22:56:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:34 smithi178 bash[23441]: audit 2024-04-19T22:56:33.291852+0000 mon.c (mon.2) 705 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:34 smithi178 bash[23441]: audit 2024-04-19T22:56:33.300548+0000 mon.a (mon.0) 2728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:34.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:34 smithi178 bash[23441]: audit 2024-04-19T22:56:33.978660+0000 mon.a (mon.0) 2729 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[21528]: cluster 2024-04-19T22:56:34.008101+0000 mgr.y (mgr.24389) 447 : cluster 0 pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:35.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[21528]: cluster 2024-04-19T22:56:34.277317+0000 mon.a (mon.0) 2730 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:35.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[21528]: audit 2024-04-19T22:56:34.287831+0000 mon.a (mon.0) 2731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:35.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[21528]: cluster 2024-04-19T22:56:34.299322+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-04-19T22:56:35.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[21528]: audit 2024-04-19T22:56:34.306648+0000 mon.c (mon.2) 706 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:35.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[28910]: cluster 2024-04-19T22:56:34.008101+0000 mgr.y (mgr.24389) 447 : cluster 0 pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[28910]: cluster 2024-04-19T22:56:34.277317+0000 mon.a (mon.0) 2730 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[28910]: audit 2024-04-19T22:56:34.287831+0000 mon.a (mon.0) 2731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[28910]: cluster 2024-04-19T22:56:34.299322+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-04-19T22:56:35.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:35 smithi113 bash[28910]: audit 2024-04-19T22:56:34.306648+0000 mon.c (mon.2) 706 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:35.555 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[23441]: cluster 2024-04-19T22:56:34.008101+0000 mgr.y (mgr.24389) 447 : cluster 0 pgmap v677: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[23441]: cluster 2024-04-19T22:56:34.277317+0000 mon.a (mon.0) 2730 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[23441]: audit 2024-04-19T22:56:34.287831+0000 mon.a (mon.0) 2731 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:35.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[23441]: cluster 2024-04-19T22:56:34.299322+0000 mon.a (mon.0) 2732 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-04-19T22:56:35.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:35 smithi178 bash[23441]: audit 2024-04-19T22:56:34.306648+0000 mon.c (mon.2) 706 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: audit 2024-04-19T22:56:35.166723+0000 mgr.y (mgr.24389) 448 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: cluster 2024-04-19T22:56:35.308278+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: audit 2024-04-19T22:56:35.385088+0000 mon.c (mon.2) 707 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: audit 2024-04-19T22:56:35.385866+0000 mon.a (mon.0) 2734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: audit 2024-04-19T22:56:35.387165+0000 mon.c (mon.2) 708 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[21528]: audit 2024-04-19T22:56:35.387913+0000 mon.a (mon.0) 2735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: audit 2024-04-19T22:56:35.166723+0000 mgr.y (mgr.24389) 448 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: cluster 2024-04-19T22:56:35.308278+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-04-19T22:56:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: audit 2024-04-19T22:56:35.385088+0000 mon.c (mon.2) 707 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: audit 2024-04-19T22:56:35.385866+0000 mon.a (mon.0) 2734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: audit 2024-04-19T22:56:35.387165+0000 mon.c (mon.2) 708 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:36 smithi113 bash[28910]: audit 2024-04-19T22:56:35.387913+0000 mon.a (mon.0) 2735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: audit 2024-04-19T22:56:35.166723+0000 mgr.y (mgr.24389) 448 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: cluster 2024-04-19T22:56:35.308278+0000 mon.a (mon.0) 2733 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-04-19T22:56:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: audit 2024-04-19T22:56:35.385088+0000 mon.c (mon.2) 707 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: audit 2024-04-19T22:56:35.385866+0000 mon.a (mon.0) 2734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: audit 2024-04-19T22:56:35.387165+0000 mon.c (mon.2) 708 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:36 smithi178 bash[23441]: audit 2024-04-19T22:56:35.387913+0000 mon.a (mon.0) 2735 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-67"}]: dispatch 2024-04-19T22:56:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:37 smithi113 bash[21528]: cluster 2024-04-19T22:56:36.008934+0000 mgr.y (mgr.24389) 449 : cluster 0 pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:37.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:37 smithi113 bash[21528]: cluster 2024-04-19T22:56:36.323869+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-04-19T22:56:37.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:37 smithi113 bash[28910]: cluster 2024-04-19T22:56:36.008934+0000 mgr.y (mgr.24389) 449 : cluster 0 pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:37.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:37 smithi113 bash[28910]: cluster 2024-04-19T22:56:36.323869+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-04-19T22:56:37.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:37 smithi178 bash[23441]: cluster 2024-04-19T22:56:36.008934+0000 mgr.y (mgr.24389) 449 : cluster 0 pgmap v680: 228 pgs: 228 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:37 smithi178 bash[23441]: cluster 2024-04-19T22:56:36.323869+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-04-19T22:56:38.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[28910]: cluster 2024-04-19T22:56:37.326168+0000 mon.a (mon.0) 2737 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-04-19T22:56:38.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[28910]: audit 2024-04-19T22:56:37.329034+0000 mon.c (mon.2) 709 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[28910]: audit 2024-04-19T22:56:37.352256+0000 mon.a (mon.0) 2738 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[28910]: audit 2024-04-19T22:56:38.319322+0000 mon.a (mon.0) 2739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:38.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[28910]: cluster 2024-04-19T22:56:38.327065+0000 mon.a (mon.0) 2740 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-04-19T22:56:38.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[21528]: cluster 2024-04-19T22:56:37.326168+0000 mon.a (mon.0) 2737 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-04-19T22:56:38.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[21528]: audit 2024-04-19T22:56:37.329034+0000 mon.c (mon.2) 709 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[21528]: audit 2024-04-19T22:56:37.352256+0000 mon.a (mon.0) 2738 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[21528]: audit 2024-04-19T22:56:38.319322+0000 mon.a (mon.0) 2739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:38.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:38 smithi113 bash[21528]: cluster 2024-04-19T22:56:38.327065+0000 mon.a (mon.0) 2740 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-04-19T22:56:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:38 smithi178 bash[23441]: cluster 2024-04-19T22:56:37.326168+0000 mon.a (mon.0) 2737 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-04-19T22:56:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:38 smithi178 bash[23441]: audit 2024-04-19T22:56:37.329034+0000 mon.c (mon.2) 709 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:38 smithi178 bash[23441]: audit 2024-04-19T22:56:37.352256+0000 mon.a (mon.0) 2738 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:38 smithi178 bash[23441]: audit 2024-04-19T22:56:38.319322+0000 mon.a (mon.0) 2739 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:38 smithi178 bash[23441]: cluster 2024-04-19T22:56:38.327065+0000 mon.a (mon.0) 2740 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: cluster 2024-04-19T22:56:38.009877+0000 mgr.y (mgr.24389) 450 : cluster 0 pgmap v683: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: audit 2024-04-19T22:56:38.331850+0000 mon.c (mon.2) 710 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: audit 2024-04-19T22:56:38.414047+0000 mon.c (mon.2) 711 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: audit 2024-04-19T22:56:38.414583+0000 mon.a (mon.0) 2741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: audit 2024-04-19T22:56:38.415361+0000 mon.c (mon.2) 712 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: audit 2024-04-19T22:56:38.415766+0000 mon.a (mon.0) 2742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[28910]: cluster 2024-04-19T22:56:39.361389+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: cluster 2024-04-19T22:56:38.009877+0000 mgr.y (mgr.24389) 450 : cluster 0 pgmap v683: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: audit 2024-04-19T22:56:38.331850+0000 mon.c (mon.2) 710 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: audit 2024-04-19T22:56:38.414047+0000 mon.c (mon.2) 711 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: audit 2024-04-19T22:56:38.414583+0000 mon.a (mon.0) 2741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: audit 2024-04-19T22:56:38.415361+0000 mon.c (mon.2) 712 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: audit 2024-04-19T22:56:38.415766+0000 mon.a (mon.0) 2742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.298 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:39 smithi113 bash[21528]: cluster 2024-04-19T22:56:39.361389+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: cluster 2024-04-19T22:56:38.009877+0000 mgr.y (mgr.24389) 450 : cluster 0 pgmap v683: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: audit 2024-04-19T22:56:38.331850+0000 mon.c (mon.2) 710 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: audit 2024-04-19T22:56:38.414047+0000 mon.c (mon.2) 711 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: audit 2024-04-19T22:56:38.414583+0000 mon.a (mon.0) 2741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: audit 2024-04-19T22:56:38.415361+0000 mon.c (mon.2) 712 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: audit 2024-04-19T22:56:38.415766+0000 mon.a (mon.0) 2742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-69"}]: dispatch 2024-04-19T22:56:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:39 smithi178 bash[23441]: cluster 2024-04-19T22:56:39.361389+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[28910]: cluster 2024-04-19T22:56:40.011946+0000 mgr.y (mgr.24389) 451 : cluster 0 pgmap v686: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[28910]: cluster 2024-04-19T22:56:40.366259+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[28910]: audit 2024-04-19T22:56:40.370161+0000 mon.c (mon.2) 713 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[28910]: audit 2024-04-19T22:56:40.375646+0000 mon.a (mon.0) 2745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[28910]: cluster 2024-04-19T22:56:40.818021+0000 mon.a (mon.0) 2746 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:41.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[21528]: cluster 2024-04-19T22:56:40.011946+0000 mgr.y (mgr.24389) 451 : cluster 0 pgmap v686: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:56:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[21528]: cluster 2024-04-19T22:56:40.366259+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-04-19T22:56:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[21528]: audit 2024-04-19T22:56:40.370161+0000 mon.c (mon.2) 713 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[21528]: audit 2024-04-19T22:56:40.375646+0000 mon.a (mon.0) 2745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:41 smithi113 bash[21528]: cluster 2024-04-19T22:56:40.818021+0000 mon.a (mon.0) 2746 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:41 smithi178 bash[23441]: cluster 2024-04-19T22:56:40.011946+0000 mgr.y (mgr.24389) 451 : cluster 0 pgmap v686: 196 pgs: 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T22:56:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:41 smithi178 bash[23441]: cluster 2024-04-19T22:56:40.366259+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-04-19T22:56:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:41 smithi178 bash[23441]: audit 2024-04-19T22:56:40.370161+0000 mon.c (mon.2) 713 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:41 smithi178 bash[23441]: audit 2024-04-19T22:56:40.375646+0000 mon.a (mon.0) 2745 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:56:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:41 smithi178 bash[23441]: cluster 2024-04-19T22:56:40.818021+0000 mon.a (mon.0) 2746 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[21528]: audit 2024-04-19T22:56:41.369791+0000 mon.a (mon.0) 2747 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[21528]: cluster 2024-04-19T22:56:41.377612+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[21528]: audit 2024-04-19T22:56:41.381746+0000 mon.c (mon.2) 714 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[21528]: audit 2024-04-19T22:56:41.401079+0000 mon.c (mon.2) 715 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[21528]: audit 2024-04-19T22:56:41.402240+0000 mon.a (mon.0) 2749 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:42.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[28910]: audit 2024-04-19T22:56:41.369791+0000 mon.a (mon.0) 2747 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[28910]: cluster 2024-04-19T22:56:41.377612+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-04-19T22:56:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[28910]: audit 2024-04-19T22:56:41.381746+0000 mon.c (mon.2) 714 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[28910]: audit 2024-04-19T22:56:41.401079+0000 mon.c (mon.2) 715 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:42 smithi113 bash[28910]: audit 2024-04-19T22:56:41.402240+0000 mon.a (mon.0) 2749 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:42 smithi178 bash[23441]: audit 2024-04-19T22:56:41.369791+0000 mon.a (mon.0) 2747 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:56:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:42 smithi178 bash[23441]: cluster 2024-04-19T22:56:41.377612+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-04-19T22:56:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:42 smithi178 bash[23441]: audit 2024-04-19T22:56:41.381746+0000 mon.c (mon.2) 714 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:56:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:42 smithi178 bash[23441]: audit 2024-04-19T22:56:41.401079+0000 mon.c (mon.2) 715 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:42 smithi178 bash[23441]: audit 2024-04-19T22:56:41.402240+0000 mon.a (mon.0) 2749 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:56:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[28910]: cluster 2024-04-19T22:56:42.012777+0000 mgr.y (mgr.24389) 452 : cluster 0 pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:56:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[28910]: audit 2024-04-19T22:56:42.379707+0000 mon.a (mon.0) 2750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[28910]: cluster 2024-04-19T22:56:42.389985+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-04-19T22:56:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[21528]: cluster 2024-04-19T22:56:42.012777+0000 mgr.y (mgr.24389) 452 : cluster 0 pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:56:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[21528]: audit 2024-04-19T22:56:42.379707+0000 mon.a (mon.0) 2750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:43 smithi113 bash[21528]: cluster 2024-04-19T22:56:42.389985+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-04-19T22:56:43.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:43 smithi178 bash[23441]: cluster 2024-04-19T22:56:42.012777+0000 mgr.y (mgr.24389) 452 : cluster 0 pgmap v689: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:56:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:43 smithi178 bash[23441]: audit 2024-04-19T22:56:42.379707+0000 mon.a (mon.0) 2750 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:56:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:43 smithi178 bash[23441]: cluster 2024-04-19T22:56:42.389985+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-04-19T22:56:44.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:44 smithi113 bash[21528]: cluster 2024-04-19T22:56:43.403831+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-04-19T22:56:44.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:44 smithi113 bash[28910]: cluster 2024-04-19T22:56:43.403831+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-04-19T22:56:44.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:44 smithi178 bash[23441]: cluster 2024-04-19T22:56:43.403831+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-04-19T22:56:45.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:45.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:45 smithi178 bash[23441]: cluster 2024-04-19T22:56:44.013611+0000 mgr.y (mgr.24389) 453 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:45.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:45 smithi113 bash[28910]: cluster 2024-04-19T22:56:44.013611+0000 mgr.y (mgr.24389) 453 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:45.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:45 smithi113 bash[21528]: cluster 2024-04-19T22:56:44.013611+0000 mgr.y (mgr.24389) 453 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:56:46.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:46 smithi113 bash[28910]: audit 2024-04-19T22:56:45.176634+0000 mgr.y (mgr.24389) 454 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:46.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:46 smithi113 bash[21528]: audit 2024-04-19T22:56:45.176634+0000 mgr.y (mgr.24389) 454 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:46.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:46 smithi178 bash[23441]: audit 2024-04-19T22:56:45.176634+0000 mgr.y (mgr.24389) 454 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:47.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:47 smithi113 bash[21528]: cluster 2024-04-19T22:56:46.015784+0000 mgr.y (mgr.24389) 455 : cluster 0 pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-19T22:56:47.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:47.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:47 smithi113 bash[28910]: cluster 2024-04-19T22:56:46.015784+0000 mgr.y (mgr.24389) 455 : cluster 0 pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-19T22:56:47.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:47 smithi178 bash[23441]: cluster 2024-04-19T22:56:46.015784+0000 mgr.y (mgr.24389) 455 : cluster 0 pgmap v693: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-04-19T22:56:49.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:49 smithi113 bash[28910]: cluster 2024-04-19T22:56:48.016634+0000 mgr.y (mgr.24389) 456 : cluster 0 pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-19T22:56:49.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:49 smithi113 bash[28910]: audit 2024-04-19T22:56:49.010681+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:49.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:49 smithi113 bash[21528]: cluster 2024-04-19T22:56:48.016634+0000 mgr.y (mgr.24389) 456 : cluster 0 pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-19T22:56:49.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:49 smithi113 bash[21528]: audit 2024-04-19T22:56:49.010681+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:49.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:49 smithi178 bash[23441]: cluster 2024-04-19T22:56:48.016634+0000 mgr.y (mgr.24389) 456 : cluster 0 pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-04-19T22:56:49.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:49 smithi178 bash[23441]: audit 2024-04-19T22:56:49.010681+0000 mon.a (mon.0) 2753 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:56:51.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:51 smithi113 bash[28910]: cluster 2024-04-19T22:56:50.018883+0000 mgr.y (mgr.24389) 457 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-04-19T22:56:51.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:51 smithi113 bash[21528]: cluster 2024-04-19T22:56:50.018883+0000 mgr.y (mgr.24389) 457 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-04-19T22:56:51.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:51 smithi178 bash[23441]: cluster 2024-04-19T22:56:50.018883+0000 mgr.y (mgr.24389) 457 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: cluster 2024-04-19T22:56:52.019823+0000 mgr.y (mgr.24389) 458 : cluster 0 pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: audit 2024-04-19T22:56:52.722480+0000 mon.a (mon.0) 2754 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: audit 2024-04-19T22:56:53.251855+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: audit 2024-04-19T22:56:53.257456+0000 mon.a (mon.0) 2756 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: audit 2024-04-19T22:56:53.263650+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[28910]: audit 2024-04-19T22:56:53.269679+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: cluster 2024-04-19T22:56:52.019823+0000 mgr.y (mgr.24389) 458 : cluster 0 pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: audit 2024-04-19T22:56:52.722480+0000 mon.a (mon.0) 2754 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: audit 2024-04-19T22:56:53.251855+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: audit 2024-04-19T22:56:53.257456+0000 mon.a (mon.0) 2756 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: audit 2024-04-19T22:56:53.263650+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:53 smithi113 bash[21528]: audit 2024-04-19T22:56:53.269679+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: cluster 2024-04-19T22:56:52.019823+0000 mgr.y (mgr.24389) 458 : cluster 0 pgmap v696: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-04-19T22:56:53.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: audit 2024-04-19T22:56:52.722480+0000 mon.a (mon.0) 2754 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:56:53.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: audit 2024-04-19T22:56:53.251855+0000 mon.a (mon.0) 2755 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: audit 2024-04-19T22:56:53.257456+0000 mon.a (mon.0) 2756 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: audit 2024-04-19T22:56:53.263650+0000 mon.a (mon.0) 2757 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:53.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:53 smithi178 bash[23441]: audit 2024-04-19T22:56:53.269679+0000 mon.a (mon.0) 2758 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.953455+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.955433+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.957252+0000 mon.a (mon.0) 2761 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.959121+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.967803+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.989219+0000 mon.a (mon.0) 2764 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.990666+0000 mon.a (mon.0) 2765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.991910+0000 mon.a (mon.0) 2766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:53.993149+0000 mon.a (mon.0) 2767 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:54.004447+0000 mon.a (mon.0) 2768 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:54.010009+0000 mon.a (mon.0) 2769 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:54.011591+0000 mon.a (mon.0) 2770 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[21528]: audit 2024-04-19T22:56:54.023611+0000 mon.a (mon.0) 2771 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.953455+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.955433+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.957252+0000 mon.a (mon.0) 2761 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.959121+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.967803+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.989219+0000 mon.a (mon.0) 2764 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.990666+0000 mon.a (mon.0) 2765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.991910+0000 mon.a (mon.0) 2766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:53.993149+0000 mon.a (mon.0) 2767 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:54.004447+0000 mon.a (mon.0) 2768 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:54.010009+0000 mon.a (mon.0) 2769 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:54.011591+0000 mon.a (mon.0) 2770 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:56:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:54 smithi113 bash[28910]: audit 2024-04-19T22:56:54.023611+0000 mon.a (mon.0) 2771 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.953455+0000 mon.a (mon.0) 2759 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.955433+0000 mon.a (mon.0) 2760 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.957252+0000 mon.a (mon.0) 2761 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.959121+0000 mon.a (mon.0) 2762 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.967803+0000 mon.a (mon.0) 2763 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.989219+0000 mon.a (mon.0) 2764 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.990666+0000 mon.a (mon.0) 2765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.991910+0000 mon.a (mon.0) 2766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:53.993149+0000 mon.a (mon.0) 2767 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:54.004447+0000 mon.a (mon.0) 2768 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:54.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:54.010009+0000 mon.a (mon.0) 2769 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:56:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:54.011591+0000 mon.a (mon.0) 2770 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:56:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:54 smithi178 bash[23441]: audit 2024-04-19T22:56:54.023611+0000 mon.a (mon.0) 2771 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:56:55.444 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:56:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:56:55.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[28910]: cephadm 2024-04-19T22:56:53.960566+0000 mgr.y (mgr.24389) 459 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3292M 2024-04-19T22:56:55.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[28910]: cephadm 2024-04-19T22:56:53.994115+0000 mgr.y (mgr.24389) 460 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3292M 2024-04-19T22:56:55.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[28910]: cluster 2024-04-19T22:56:54.020604+0000 mgr.y (mgr.24389) 461 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-19T22:56:55.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[21528]: cephadm 2024-04-19T22:56:53.960566+0000 mgr.y (mgr.24389) 459 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3292M 2024-04-19T22:56:55.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[21528]: cephadm 2024-04-19T22:56:53.994115+0000 mgr.y (mgr.24389) 460 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3292M 2024-04-19T22:56:55.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:55 smithi113 bash[21528]: cluster 2024-04-19T22:56:54.020604+0000 mgr.y (mgr.24389) 461 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-19T22:56:55.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:55 smithi178 bash[23441]: cephadm 2024-04-19T22:56:53.960566+0000 mgr.y (mgr.24389) 459 : cephadm 1 Adjusting osd_memory_target on smithi113 to 3292M 2024-04-19T22:56:55.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:55 smithi178 bash[23441]: cephadm 2024-04-19T22:56:53.994115+0000 mgr.y (mgr.24389) 460 : cephadm 1 Adjusting osd_memory_target on smithi178 to 3292M 2024-04-19T22:56:55.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:55 smithi178 bash[23441]: cluster 2024-04-19T22:56:54.020604+0000 mgr.y (mgr.24389) 461 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-19T22:56:56.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:56 smithi113 bash[28910]: audit 2024-04-19T22:56:55.188110+0000 mgr.y (mgr.24389) 462 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:56.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:56 smithi113 bash[21528]: audit 2024-04-19T22:56:55.188110+0000 mgr.y (mgr.24389) 462 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:56.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:56 smithi178 bash[23441]: audit 2024-04-19T22:56:55.188110+0000 mgr.y (mgr.24389) 462 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:56:57.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:56:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:56:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:56:57.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:57 smithi113 bash[28910]: cluster 2024-04-19T22:56:56.022861+0000 mgr.y (mgr.24389) 463 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-19T22:56:57.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:57 smithi113 bash[21528]: cluster 2024-04-19T22:56:56.022861+0000 mgr.y (mgr.24389) 463 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-19T22:56:57.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:57 smithi178 bash[23441]: cluster 2024-04-19T22:56:56.022861+0000 mgr.y (mgr.24389) 463 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-04-19T22:56:59.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:56:59 smithi113 bash[21528]: cluster 2024-04-19T22:56:58.023759+0000 mgr.y (mgr.24389) 464 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:56:59.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:56:59 smithi113 bash[28910]: cluster 2024-04-19T22:56:58.023759+0000 mgr.y (mgr.24389) 464 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:56:59.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:56:59 smithi178 bash[23441]: cluster 2024-04-19T22:56:58.023759+0000 mgr.y (mgr.24389) 464 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:01.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:01 smithi113 bash[21528]: cluster 2024-04-19T22:57:00.025942+0000 mgr.y (mgr.24389) 465 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:01.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:01 smithi113 bash[28910]: cluster 2024-04-19T22:57:00.025942+0000 mgr.y (mgr.24389) 465 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:01.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:01 smithi178 bash[23441]: cluster 2024-04-19T22:57:00.025942+0000 mgr.y (mgr.24389) 465 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:03.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:03 smithi113 bash[21528]: cluster 2024-04-19T22:57:02.026782+0000 mgr.y (mgr.24389) 466 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:03.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:03 smithi113 bash[28910]: cluster 2024-04-19T22:57:02.026782+0000 mgr.y (mgr.24389) 466 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:03 smithi178 bash[23441]: cluster 2024-04-19T22:57:02.026782+0000 mgr.y (mgr.24389) 466 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:04.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[28910]: audit 2024-04-19T22:57:03.505709+0000 mon.c (mon.2) 716 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[28910]: audit 2024-04-19T22:57:03.506530+0000 mon.a (mon.0) 2772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[28910]: audit 2024-04-19T22:57:03.507756+0000 mon.c (mon.2) 717 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[28910]: audit 2024-04-19T22:57:03.508332+0000 mon.a (mon.0) 2773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[28910]: audit 2024-04-19T22:57:04.044867+0000 mon.a (mon.0) 2774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[21528]: audit 2024-04-19T22:57:03.505709+0000 mon.c (mon.2) 716 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[21528]: audit 2024-04-19T22:57:03.506530+0000 mon.a (mon.0) 2772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[21528]: audit 2024-04-19T22:57:03.507756+0000 mon.c (mon.2) 717 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[21528]: audit 2024-04-19T22:57:03.508332+0000 mon.a (mon.0) 2773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:04 smithi113 bash[21528]: audit 2024-04-19T22:57:04.044867+0000 mon.a (mon.0) 2774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:04.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:04 smithi178 bash[23441]: audit 2024-04-19T22:57:03.505709+0000 mon.c (mon.2) 716 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:04 smithi178 bash[23441]: audit 2024-04-19T22:57:03.506530+0000 mon.a (mon.0) 2772 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:04.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:04 smithi178 bash[23441]: audit 2024-04-19T22:57:03.507756+0000 mon.c (mon.2) 717 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:04 smithi178 bash[23441]: audit 2024-04-19T22:57:03.508332+0000 mon.a (mon.0) 2773 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-71"}]: dispatch 2024-04-19T22:57:04.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:04 smithi178 bash[23441]: audit 2024-04-19T22:57:04.044867+0000 mon.a (mon.0) 2774 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:05.482 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:05 smithi113 bash[21528]: cluster 2024-04-19T22:57:04.027562+0000 mgr.y (mgr.24389) 467 : cluster 0 pgmap v702: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:05 smithi113 bash[21528]: cluster 2024-04-19T22:57:04.489868+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-04-19T22:57:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:05 smithi113 bash[28910]: cluster 2024-04-19T22:57:04.027562+0000 mgr.y (mgr.24389) 467 : cluster 0 pgmap v702: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:05 smithi113 bash[28910]: cluster 2024-04-19T22:57:04.489868+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-04-19T22:57:05.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:05 smithi178 bash[23441]: cluster 2024-04-19T22:57:04.027562+0000 mgr.y (mgr.24389) 467 : cluster 0 pgmap v702: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:57:05.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:05 smithi178 bash[23441]: cluster 2024-04-19T22:57:04.489868+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-04-19T22:57:06.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[28910]: audit 2024-04-19T22:57:05.199458+0000 mgr.y (mgr.24389) 468 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:06.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[28910]: cluster 2024-04-19T22:57:05.500686+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-04-19T22:57:06.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[28910]: audit 2024-04-19T22:57:05.508777+0000 mon.c (mon.2) 718 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:06.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[28910]: audit 2024-04-19T22:57:05.513374+0000 mon.a (mon.0) 2777 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[21528]: audit 2024-04-19T22:57:05.199458+0000 mgr.y (mgr.24389) 468 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[21528]: cluster 2024-04-19T22:57:05.500686+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-04-19T22:57:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[21528]: audit 2024-04-19T22:57:05.508777+0000 mon.c (mon.2) 718 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:06 smithi113 bash[21528]: audit 2024-04-19T22:57:05.513374+0000 mon.a (mon.0) 2777 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:06 smithi178 bash[23441]: audit 2024-04-19T22:57:05.199458+0000 mgr.y (mgr.24389) 468 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:06 smithi178 bash[23441]: cluster 2024-04-19T22:57:05.500686+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-04-19T22:57:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:06 smithi178 bash[23441]: audit 2024-04-19T22:57:05.508777+0000 mon.c (mon.2) 718 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:06 smithi178 bash[23441]: audit 2024-04-19T22:57:05.513374+0000 mon.a (mon.0) 2777 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:07.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[28910]: cluster 2024-04-19T22:57:06.028384+0000 mgr.y (mgr.24389) 469 : cluster 0 pgmap v705: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[28910]: cluster 2024-04-19T22:57:06.494059+0000 mon.a (mon.0) 2778 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[28910]: audit 2024-04-19T22:57:06.504757+0000 mon.a (mon.0) 2779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[28910]: cluster 2024-04-19T22:57:06.512587+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[28910]: audit 2024-04-19T22:57:06.515793+0000 mon.c (mon.2) 719 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:07.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21528]: cluster 2024-04-19T22:57:06.028384+0000 mgr.y (mgr.24389) 469 : cluster 0 pgmap v705: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21528]: cluster 2024-04-19T22:57:06.494059+0000 mon.a (mon.0) 2778 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21528]: audit 2024-04-19T22:57:06.504757+0000 mon.a (mon.0) 2779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21528]: cluster 2024-04-19T22:57:06.512587+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-04-19T22:57:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:07 smithi113 bash[21528]: audit 2024-04-19T22:57:06.515793+0000 mon.c (mon.2) 719 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:07 smithi178 bash[23441]: cluster 2024-04-19T22:57:06.028384+0000 mgr.y (mgr.24389) 469 : cluster 0 pgmap v705: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:07 smithi178 bash[23441]: cluster 2024-04-19T22:57:06.494059+0000 mon.a (mon.0) 2778 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:07 smithi178 bash[23441]: audit 2024-04-19T22:57:06.504757+0000 mon.a (mon.0) 2779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:07 smithi178 bash[23441]: cluster 2024-04-19T22:57:06.512587+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-04-19T22:57:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:07 smithi178 bash[23441]: audit 2024-04-19T22:57:06.515793+0000 mon.c (mon.2) 719 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:08 smithi113 bash[21528]: cluster 2024-04-19T22:57:07.516123+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-04-19T22:57:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:08 smithi113 bash[28910]: cluster 2024-04-19T22:57:07.516123+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-04-19T22:57:08.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:08 smithi178 bash[23441]: cluster 2024-04-19T22:57:07.516123+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-04-19T22:57:09.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:09 smithi113 bash[28910]: cluster 2024-04-19T22:57:08.029195+0000 mgr.y (mgr.24389) 470 : cluster 0 pgmap v708: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:09.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:09 smithi113 bash[28910]: cluster 2024-04-19T22:57:08.529457+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-04-19T22:57:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:09 smithi113 bash[21528]: cluster 2024-04-19T22:57:08.029195+0000 mgr.y (mgr.24389) 470 : cluster 0 pgmap v708: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:09 smithi113 bash[21528]: cluster 2024-04-19T22:57:08.529457+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-04-19T22:57:09.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:09 smithi178 bash[23441]: cluster 2024-04-19T22:57:08.029195+0000 mgr.y (mgr.24389) 470 : cluster 0 pgmap v708: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:09 smithi178 bash[23441]: cluster 2024-04-19T22:57:08.529457+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-04-19T22:57:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:11 smithi113 bash[21528]: cluster 2024-04-19T22:57:10.031294+0000 mgr.y (mgr.24389) 471 : cluster 0 pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-19T22:57:11.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:11 smithi113 bash[28910]: cluster 2024-04-19T22:57:10.031294+0000 mgr.y (mgr.24389) 471 : cluster 0 pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-19T22:57:11.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:11 smithi178 bash[23441]: cluster 2024-04-19T22:57:10.031294+0000 mgr.y (mgr.24389) 471 : cluster 0 pgmap v710: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-19T22:57:13.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:13 smithi113 bash[28910]: cluster 2024-04-19T22:57:12.032228+0000 mgr.y (mgr.24389) 472 : cluster 0 pgmap v711: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-04-19T22:57:13.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:13 smithi113 bash[21528]: cluster 2024-04-19T22:57:12.032228+0000 mgr.y (mgr.24389) 472 : cluster 0 pgmap v711: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-04-19T22:57:13.804 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 22:57:13 smithi178 bash[50863]: logger=cleanup t=2024-04-19T22:57:13.615745351Z level=info msg="Completed cleanup jobs" duration=106.60085ms 2024-04-19T22:57:13.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:13 smithi178 bash[23441]: cluster 2024-04-19T22:57:12.032228+0000 mgr.y (mgr.24389) 472 : cluster 0 pgmap v711: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-04-19T22:57:15.531 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:15.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:15 smithi113 bash[28910]: cluster 2024-04-19T22:57:14.033090+0000 mgr.y (mgr.24389) 473 : cluster 0 pgmap v712: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 952 B/s wr, 3 op/s 2024-04-19T22:57:15.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:15 smithi113 bash[21528]: cluster 2024-04-19T22:57:14.033090+0000 mgr.y (mgr.24389) 473 : cluster 0 pgmap v712: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 952 B/s wr, 3 op/s 2024-04-19T22:57:15.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:15 smithi178 bash[23441]: cluster 2024-04-19T22:57:14.033090+0000 mgr.y (mgr.24389) 473 : cluster 0 pgmap v712: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 952 B/s wr, 3 op/s 2024-04-19T22:57:16.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:16 smithi113 bash[28910]: audit 2024-04-19T22:57:15.210791+0000 mgr.y (mgr.24389) 474 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:16.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:16 smithi113 bash[28910]: cluster 2024-04-19T22:57:15.973875+0000 mon.a (mon.0) 2783 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:16.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:16 smithi113 bash[21528]: audit 2024-04-19T22:57:15.210791+0000 mgr.y (mgr.24389) 474 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:16.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:16 smithi113 bash[21528]: cluster 2024-04-19T22:57:15.973875+0000 mon.a (mon.0) 2783 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:16.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:16 smithi178 bash[23441]: audit 2024-04-19T22:57:15.210791+0000 mgr.y (mgr.24389) 474 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:16.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:16 smithi178 bash[23441]: cluster 2024-04-19T22:57:15.973875+0000 mon.a (mon.0) 2783 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:17 smithi113 bash[21528]: cluster 2024-04-19T22:57:16.035334+0000 mgr.y (mgr.24389) 475 : cluster 0 pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 841 B/s wr, 3 op/s 2024-04-19T22:57:17.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:17 smithi113 bash[28910]: cluster 2024-04-19T22:57:16.035334+0000 mgr.y (mgr.24389) 475 : cluster 0 pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 841 B/s wr, 3 op/s 2024-04-19T22:57:17.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:17 smithi178 bash[23441]: cluster 2024-04-19T22:57:16.035334+0000 mgr.y (mgr.24389) 475 : cluster 0 pgmap v713: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 841 B/s wr, 3 op/s 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: cluster 2024-04-19T22:57:18.036118+0000 mgr.y (mgr.24389) 476 : cluster 0 pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: audit 2024-04-19T22:57:18.632213+0000 mon.c (mon.2) 720 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: audit 2024-04-19T22:57:18.632886+0000 mon.a (mon.0) 2784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: audit 2024-04-19T22:57:18.634082+0000 mon.c (mon.2) 721 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: audit 2024-04-19T22:57:18.634739+0000 mon.a (mon.0) 2785 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:19 smithi178 bash[23441]: audit 2024-04-19T22:57:19.077890+0000 mon.a (mon.0) 2786 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: cluster 2024-04-19T22:57:18.036118+0000 mgr.y (mgr.24389) 476 : cluster 0 pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-19T22:57:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: audit 2024-04-19T22:57:18.632213+0000 mon.c (mon.2) 720 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: audit 2024-04-19T22:57:18.632886+0000 mon.a (mon.0) 2784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: audit 2024-04-19T22:57:18.634082+0000 mon.c (mon.2) 721 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: audit 2024-04-19T22:57:18.634739+0000 mon.a (mon.0) 2785 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[21528]: audit 2024-04-19T22:57:19.077890+0000 mon.a (mon.0) 2786 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: cluster 2024-04-19T22:57:18.036118+0000 mgr.y (mgr.24389) 476 : cluster 0 pgmap v714: 228 pgs: 228 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: audit 2024-04-19T22:57:18.632213+0000 mon.c (mon.2) 720 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: audit 2024-04-19T22:57:18.632886+0000 mon.a (mon.0) 2784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: audit 2024-04-19T22:57:18.634082+0000 mon.c (mon.2) 721 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: audit 2024-04-19T22:57:18.634739+0000 mon.a (mon.0) 2785 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-73"}]: dispatch 2024-04-19T22:57:20.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:19 smithi113 bash[28910]: audit 2024-04-19T22:57:19.077890+0000 mon.a (mon.0) 2786 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:20 smithi113 bash[21528]: cluster 2024-04-19T22:57:19.565755+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-04-19T22:57:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:20 smithi113 bash[28910]: cluster 2024-04-19T22:57:19.565755+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-04-19T22:57:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:20 smithi178 bash[23441]: cluster 2024-04-19T22:57:19.565755+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-04-19T22:57:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[28910]: cluster 2024-04-19T22:57:20.037998+0000 mgr.y (mgr.24389) 477 : cluster 0 pgmap v716: 196 pgs: 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T22:57:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[28910]: cluster 2024-04-19T22:57:20.581116+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-04-19T22:57:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[28910]: audit 2024-04-19T22:57:20.591413+0000 mon.c (mon.2) 722 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[28910]: audit 2024-04-19T22:57:20.593287+0000 mon.a (mon.0) 2789 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:22.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[21528]: cluster 2024-04-19T22:57:20.037998+0000 mgr.y (mgr.24389) 477 : cluster 0 pgmap v716: 196 pgs: 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T22:57:22.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[21528]: cluster 2024-04-19T22:57:20.581116+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-04-19T22:57:22.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[21528]: audit 2024-04-19T22:57:20.591413+0000 mon.c (mon.2) 722 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:22.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:21 smithi113 bash[21528]: audit 2024-04-19T22:57:20.593287+0000 mon.a (mon.0) 2789 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:21 smithi178 bash[23441]: cluster 2024-04-19T22:57:20.037998+0000 mgr.y (mgr.24389) 477 : cluster 0 pgmap v716: 196 pgs: 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T22:57:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:21 smithi178 bash[23441]: cluster 2024-04-19T22:57:20.581116+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-04-19T22:57:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:21 smithi178 bash[23441]: audit 2024-04-19T22:57:20.591413+0000 mon.c (mon.2) 722 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:22.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:21 smithi178 bash[23441]: audit 2024-04-19T22:57:20.593287+0000 mon.a (mon.0) 2789 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[28910]: audit 2024-04-19T22:57:21.574860+0000 mon.a (mon.0) 2790 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:23.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[28910]: cluster 2024-04-19T22:57:21.583726+0000 mon.a (mon.0) 2791 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-04-19T22:57:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[28910]: audit 2024-04-19T22:57:21.590652+0000 mon.c (mon.2) 723 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:23.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[21528]: audit 2024-04-19T22:57:21.574860+0000 mon.a (mon.0) 2790 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:23.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[21528]: cluster 2024-04-19T22:57:21.583726+0000 mon.a (mon.0) 2791 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-04-19T22:57:23.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:22 smithi113 bash[21528]: audit 2024-04-19T22:57:21.590652+0000 mon.c (mon.2) 723 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:22 smithi178 bash[23441]: audit 2024-04-19T22:57:21.574860+0000 mon.a (mon.0) 2790 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:22 smithi178 bash[23441]: cluster 2024-04-19T22:57:21.583726+0000 mon.a (mon.0) 2791 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-04-19T22:57:23.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:22 smithi178 bash[23441]: audit 2024-04-19T22:57:21.590652+0000 mon.c (mon.2) 723 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:24.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:23 smithi113 bash[21528]: cluster 2024-04-19T22:57:22.038898+0000 mgr.y (mgr.24389) 478 : cluster 0 pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:24.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:23 smithi113 bash[21528]: cluster 2024-04-19T22:57:22.621592+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-04-19T22:57:24.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:23 smithi113 bash[28910]: cluster 2024-04-19T22:57:22.038898+0000 mgr.y (mgr.24389) 478 : cluster 0 pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:24.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:23 smithi113 bash[28910]: cluster 2024-04-19T22:57:22.621592+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-04-19T22:57:24.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:23 smithi178 bash[23441]: cluster 2024-04-19T22:57:22.038898+0000 mgr.y (mgr.24389) 478 : cluster 0 pgmap v719: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:24.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:23 smithi178 bash[23441]: cluster 2024-04-19T22:57:22.621592+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-04-19T22:57:25.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[28910]: cluster 2024-04-19T22:57:23.637642+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[28910]: audit 2024-04-19T22:57:23.753546+0000 mon.c (mon.2) 724 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[28910]: audit 2024-04-19T22:57:23.754286+0000 mon.a (mon.0) 2794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[28910]: audit 2024-04-19T22:57:23.755505+0000 mon.c (mon.2) 725 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[28910]: audit 2024-04-19T22:57:23.756112+0000 mon.a (mon.0) 2795 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[21528]: cluster 2024-04-19T22:57:23.637642+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[21528]: audit 2024-04-19T22:57:23.753546+0000 mon.c (mon.2) 724 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[21528]: audit 2024-04-19T22:57:23.754286+0000 mon.a (mon.0) 2794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[21528]: audit 2024-04-19T22:57:23.755505+0000 mon.c (mon.2) 725 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:24 smithi113 bash[21528]: audit 2024-04-19T22:57:23.756112+0000 mon.a (mon.0) 2795 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:24 smithi178 bash[23441]: cluster 2024-04-19T22:57:23.637642+0000 mon.a (mon.0) 2793 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-04-19T22:57:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:24 smithi178 bash[23441]: audit 2024-04-19T22:57:23.753546+0000 mon.c (mon.2) 724 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:24 smithi178 bash[23441]: audit 2024-04-19T22:57:23.754286+0000 mon.a (mon.0) 2794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:24 smithi178 bash[23441]: audit 2024-04-19T22:57:23.755505+0000 mon.c (mon.2) 725 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:24 smithi178 bash[23441]: audit 2024-04-19T22:57:23.756112+0000 mon.a (mon.0) 2795 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-75"}]: dispatch 2024-04-19T22:57:25.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:26.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:25 smithi113 bash[28910]: cluster 2024-04-19T22:57:24.039950+0000 mgr.y (mgr.24389) 479 : cluster 0 pgmap v722: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:26.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:25 smithi113 bash[28910]: cluster 2024-04-19T22:57:24.649178+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-04-19T22:57:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:25 smithi113 bash[21528]: cluster 2024-04-19T22:57:24.039950+0000 mgr.y (mgr.24389) 479 : cluster 0 pgmap v722: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:26.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:25 smithi113 bash[21528]: cluster 2024-04-19T22:57:24.649178+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-04-19T22:57:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:25 smithi178 bash[23441]: cluster 2024-04-19T22:57:24.039950+0000 mgr.y (mgr.24389) 479 : cluster 0 pgmap v722: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 574 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:57:26.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:25 smithi178 bash[23441]: cluster 2024-04-19T22:57:24.649178+0000 mon.a (mon.0) 2796 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-04-19T22:57:27.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[28910]: audit 2024-04-19T22:57:25.222204+0000 mgr.y (mgr.24389) 480 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:27.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[28910]: cluster 2024-04-19T22:57:25.653559+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[28910]: audit 2024-04-19T22:57:25.656095+0000 mon.c (mon.2) 726 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[28910]: audit 2024-04-19T22:57:25.676320+0000 mon.a (mon.0) 2798 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[28910]: audit 2024-04-19T22:57:26.646384+0000 mon.a (mon.0) 2799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[21528]: audit 2024-04-19T22:57:25.222204+0000 mgr.y (mgr.24389) 480 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[21528]: cluster 2024-04-19T22:57:25.653559+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[21528]: audit 2024-04-19T22:57:25.656095+0000 mon.c (mon.2) 726 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[21528]: audit 2024-04-19T22:57:25.676320+0000 mon.a (mon.0) 2798 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:26 smithi113 bash[21528]: audit 2024-04-19T22:57:26.646384+0000 mon.a (mon.0) 2799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:27.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:26 smithi178 bash[23441]: audit 2024-04-19T22:57:25.222204+0000 mgr.y (mgr.24389) 480 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:26 smithi178 bash[23441]: cluster 2024-04-19T22:57:25.653559+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-04-19T22:57:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:26 smithi178 bash[23441]: audit 2024-04-19T22:57:25.656095+0000 mon.c (mon.2) 726 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:26 smithi178 bash[23441]: audit 2024-04-19T22:57:25.676320+0000 mon.a (mon.0) 2798 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:26 smithi178 bash[23441]: audit 2024-04-19T22:57:26.646384+0000 mon.a (mon.0) 2799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:27.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[28910]: cluster 2024-04-19T22:57:26.040780+0000 mgr.y (mgr.24389) 481 : cluster 0 pgmap v725: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[28910]: cluster 2024-04-19T22:57:26.655702+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[28910]: audit 2024-04-19T22:57:26.660561+0000 mon.c (mon.2) 727 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[28910]: cluster 2024-04-19T22:57:26.663218+0000 mon.a (mon.0) 2801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[28910]: cluster 2024-04-19T22:57:27.687275+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21528]: cluster 2024-04-19T22:57:26.040780+0000 mgr.y (mgr.24389) 481 : cluster 0 pgmap v725: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21528]: cluster 2024-04-19T22:57:26.655702+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-04-19T22:57:27.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21528]: audit 2024-04-19T22:57:26.660561+0000 mon.c (mon.2) 727 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:27.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21528]: cluster 2024-04-19T22:57:26.663218+0000 mon.a (mon.0) 2801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:27.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:27 smithi113 bash[21528]: cluster 2024-04-19T22:57:27.687275+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-04-19T22:57:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:27 smithi178 bash[23441]: cluster 2024-04-19T22:57:26.040780+0000 mgr.y (mgr.24389) 481 : cluster 0 pgmap v725: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:27 smithi178 bash[23441]: cluster 2024-04-19T22:57:26.655702+0000 mon.a (mon.0) 2800 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-04-19T22:57:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:27 smithi178 bash[23441]: audit 2024-04-19T22:57:26.660561+0000 mon.c (mon.2) 727 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:27 smithi178 bash[23441]: cluster 2024-04-19T22:57:26.663218+0000 mon.a (mon.0) 2801 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:27 smithi178 bash[23441]: cluster 2024-04-19T22:57:27.687275+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-04-19T22:57:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[28910]: audit 2024-04-19T22:57:27.772690+0000 mon.c (mon.2) 728 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[28910]: audit 2024-04-19T22:57:27.773438+0000 mon.a (mon.0) 2803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[28910]: audit 2024-04-19T22:57:27.774745+0000 mon.c (mon.2) 729 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[28910]: audit 2024-04-19T22:57:27.775379+0000 mon.a (mon.0) 2804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[28910]: cluster 2024-04-19T22:57:28.041581+0000 mgr.y (mgr.24389) 482 : cluster 0 pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[21528]: audit 2024-04-19T22:57:27.772690+0000 mon.c (mon.2) 728 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[21528]: audit 2024-04-19T22:57:27.773438+0000 mon.a (mon.0) 2803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[21528]: audit 2024-04-19T22:57:27.774745+0000 mon.c (mon.2) 729 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[21528]: audit 2024-04-19T22:57:27.775379+0000 mon.a (mon.0) 2804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:28 smithi113 bash[21528]: cluster 2024-04-19T22:57:28.041581+0000 mgr.y (mgr.24389) 482 : cluster 0 pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:28 smithi178 bash[23441]: audit 2024-04-19T22:57:27.772690+0000 mon.c (mon.2) 728 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:28 smithi178 bash[23441]: audit 2024-04-19T22:57:27.773438+0000 mon.a (mon.0) 2803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:28 smithi178 bash[23441]: audit 2024-04-19T22:57:27.774745+0000 mon.c (mon.2) 729 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:28 smithi178 bash[23441]: audit 2024-04-19T22:57:27.775379+0000 mon.a (mon.0) 2804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-77"}]: dispatch 2024-04-19T22:57:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:28 smithi178 bash[23441]: cluster 2024-04-19T22:57:28.041581+0000 mgr.y (mgr.24389) 482 : cluster 0 pgmap v728: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 583 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T22:57:30.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:29 smithi113 bash[28910]: cluster 2024-04-19T22:57:28.731759+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-04-19T22:57:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:29 smithi113 bash[21528]: cluster 2024-04-19T22:57:28.731759+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-04-19T22:57:30.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:29 smithi178 bash[23441]: cluster 2024-04-19T22:57:28.731759+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-04-19T22:57:31.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: cluster 2024-04-19T22:57:29.735941+0000 mon.a (mon.0) 2806 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-04-19T22:57:31.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: audit 2024-04-19T22:57:29.751897+0000 mon.c (mon.2) 730 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: audit 2024-04-19T22:57:29.758092+0000 mon.a (mon.0) 2807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: cluster 2024-04-19T22:57:30.043620+0000 mgr.y (mgr.24389) 483 : cluster 0 pgmap v731: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: audit 2024-04-19T22:57:30.727464+0000 mon.a (mon.0) 2808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[28910]: cluster 2024-04-19T22:57:30.735829+0000 mon.a (mon.0) 2809 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: cluster 2024-04-19T22:57:29.735941+0000 mon.a (mon.0) 2806 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: audit 2024-04-19T22:57:29.751897+0000 mon.c (mon.2) 730 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: audit 2024-04-19T22:57:29.758092+0000 mon.a (mon.0) 2807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: cluster 2024-04-19T22:57:30.043620+0000 mgr.y (mgr.24389) 483 : cluster 0 pgmap v731: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: audit 2024-04-19T22:57:30.727464+0000 mon.a (mon.0) 2808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:30 smithi113 bash[21528]: cluster 2024-04-19T22:57:30.735829+0000 mon.a (mon.0) 2809 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-04-19T22:57:31.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: cluster 2024-04-19T22:57:29.735941+0000 mon.a (mon.0) 2806 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-04-19T22:57:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: audit 2024-04-19T22:57:29.751897+0000 mon.c (mon.2) 730 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: audit 2024-04-19T22:57:29.758092+0000 mon.a (mon.0) 2807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: cluster 2024-04-19T22:57:30.043620+0000 mgr.y (mgr.24389) 483 : cluster 0 pgmap v731: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: audit 2024-04-19T22:57:30.727464+0000 mon.a (mon.0) 2808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:30 smithi178 bash[23441]: cluster 2024-04-19T22:57:30.735829+0000 mon.a (mon.0) 2809 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-04-19T22:57:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:31 smithi113 bash[28910]: audit 2024-04-19T22:57:30.743959+0000 mon.c (mon.2) 731 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:31 smithi113 bash[28910]: cluster 2024-04-19T22:57:31.766031+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-04-19T22:57:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:31 smithi113 bash[21528]: audit 2024-04-19T22:57:30.743959+0000 mon.c (mon.2) 731 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:31 smithi113 bash[21528]: cluster 2024-04-19T22:57:31.766031+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-04-19T22:57:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:31 smithi178 bash[23441]: audit 2024-04-19T22:57:30.743959+0000 mon.c (mon.2) 731 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:32.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:31 smithi178 bash[23441]: cluster 2024-04-19T22:57:31.766031+0000 mon.a (mon.0) 2810 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-04-19T22:57:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:32 smithi113 bash[28910]: cluster 2024-04-19T22:57:32.044419+0000 mgr.y (mgr.24389) 484 : cluster 0 pgmap v734: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:33.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:32 smithi113 bash[21528]: cluster 2024-04-19T22:57:32.044419+0000 mgr.y (mgr.24389) 484 : cluster 0 pgmap v734: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:32 smithi178 bash[23441]: cluster 2024-04-19T22:57:32.044419+0000 mgr.y (mgr.24389) 484 : cluster 0 pgmap v734: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:57:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[28910]: cluster 2024-04-19T22:57:32.775071+0000 mon.a (mon.0) 2811 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[28910]: cluster 2024-04-19T22:57:32.792819+0000 mon.a (mon.0) 2812 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-04-19T22:57:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[28910]: audit 2024-04-19T22:57:32.830619+0000 mon.c (mon.2) 732 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[28910]: audit 2024-04-19T22:57:32.831040+0000 mgr.y (mgr.24389) 485 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[21528]: cluster 2024-04-19T22:57:32.775071+0000 mon.a (mon.0) 2811 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[21528]: cluster 2024-04-19T22:57:32.792819+0000 mon.a (mon.0) 2812 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-04-19T22:57:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[21528]: audit 2024-04-19T22:57:32.830619+0000 mon.c (mon.2) 732 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:33 smithi113 bash[21528]: audit 2024-04-19T22:57:32.831040+0000 mgr.y (mgr.24389) 485 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:34.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:33 smithi178 bash[23441]: cluster 2024-04-19T22:57:32.775071+0000 mon.a (mon.0) 2811 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:57:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:33 smithi178 bash[23441]: cluster 2024-04-19T22:57:32.792819+0000 mon.a (mon.0) 2812 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-04-19T22:57:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:33 smithi178 bash[23441]: audit 2024-04-19T22:57:32.830619+0000 mon.c (mon.2) 732 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:33 smithi178 bash[23441]: audit 2024-04-19T22:57:32.831040+0000 mgr.y (mgr.24389) 485 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1d"}]: dispatch 2024-04-19T22:57:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[28910]: cluster 2024-04-19T22:57:33.595104+0000 osd.2 (osd.2) 5 : cluster 0 305.1d deep-scrub starts 2024-04-19T22:57:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[28910]: cluster 2024-04-19T22:57:33.601619+0000 osd.2 (osd.2) 6 : cluster 0 305.1d deep-scrub ok 2024-04-19T22:57:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[28910]: cluster 2024-04-19T22:57:34.045236+0000 mgr.y (mgr.24389) 486 : cluster 0 pgmap v736: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 474 B/s wr, 2 op/s 2024-04-19T22:57:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[28910]: audit 2024-04-19T22:57:34.111067+0000 mon.a (mon.0) 2813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[21528]: cluster 2024-04-19T22:57:33.595104+0000 osd.2 (osd.2) 5 : cluster 0 305.1d deep-scrub starts 2024-04-19T22:57:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[21528]: cluster 2024-04-19T22:57:33.601619+0000 osd.2 (osd.2) 6 : cluster 0 305.1d deep-scrub ok 2024-04-19T22:57:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[21528]: cluster 2024-04-19T22:57:34.045236+0000 mgr.y (mgr.24389) 486 : cluster 0 pgmap v736: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 474 B/s wr, 2 op/s 2024-04-19T22:57:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:34 smithi113 bash[21528]: audit 2024-04-19T22:57:34.111067+0000 mon.a (mon.0) 2813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:35.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:34 smithi178 bash[23441]: cluster 2024-04-19T22:57:33.595104+0000 osd.2 (osd.2) 5 : cluster 0 305.1d deep-scrub starts 2024-04-19T22:57:35.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:34 smithi178 bash[23441]: cluster 2024-04-19T22:57:33.601619+0000 osd.2 (osd.2) 6 : cluster 0 305.1d deep-scrub ok 2024-04-19T22:57:35.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:34 smithi178 bash[23441]: cluster 2024-04-19T22:57:34.045236+0000 mgr.y (mgr.24389) 486 : cluster 0 pgmap v736: 228 pgs: 28 creating+peering, 4 unknown, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 474 B/s wr, 2 op/s 2024-04-19T22:57:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:34 smithi178 bash[23441]: audit 2024-04-19T22:57:34.111067+0000 mon.a (mon.0) 2813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:35.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:35 smithi113 bash[28910]: audit 2024-04-19T22:57:35.230291+0000 mgr.y (mgr.24389) 487 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:35 smithi113 bash[21528]: audit 2024-04-19T22:57:35.230291+0000 mgr.y (mgr.24389) 487 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:35 smithi178 bash[23441]: audit 2024-04-19T22:57:35.230291+0000 mgr.y (mgr.24389) 487 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:36 smithi178 bash[23441]: cluster 2024-04-19T22:57:36.047502+0000 mgr.y (mgr.24389) 488 : cluster 0 pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-04-19T22:57:37.297 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:36 smithi113 bash[28910]: cluster 2024-04-19T22:57:36.047502+0000 mgr.y (mgr.24389) 488 : cluster 0 pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-04-19T22:57:37.297 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:36 smithi113 bash[21528]: cluster 2024-04-19T22:57:36.047502+0000 mgr.y (mgr.24389) 488 : cluster 0 pgmap v737: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-04-19T22:57:37.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:39.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:39 smithi113 bash[28910]: cluster 2024-04-19T22:57:38.048303+0000 mgr.y (mgr.24389) 489 : cluster 0 pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 699 B/s rd, 699 B/s wr, 2 op/s 2024-04-19T22:57:39.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:39 smithi113 bash[21528]: cluster 2024-04-19T22:57:38.048303+0000 mgr.y (mgr.24389) 489 : cluster 0 pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 699 B/s rd, 699 B/s wr, 2 op/s 2024-04-19T22:57:39.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:39 smithi178 bash[23441]: cluster 2024-04-19T22:57:38.048303+0000 mgr.y (mgr.24389) 489 : cluster 0 pgmap v738: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 699 B/s rd, 699 B/s wr, 2 op/s 2024-04-19T22:57:41.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:41 smithi113 bash[28910]: cluster 2024-04-19T22:57:40.050467+0000 mgr.y (mgr.24389) 490 : cluster 0 pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 617 B/s wr, 2 op/s 2024-04-19T22:57:41.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:41 smithi113 bash[21528]: cluster 2024-04-19T22:57:40.050467+0000 mgr.y (mgr.24389) 490 : cluster 0 pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 617 B/s wr, 2 op/s 2024-04-19T22:57:41.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:41 smithi178 bash[23441]: cluster 2024-04-19T22:57:40.050467+0000 mgr.y (mgr.24389) 490 : cluster 0 pgmap v739: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 617 B/s wr, 2 op/s 2024-04-19T22:57:43.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:43 smithi113 bash[28910]: cluster 2024-04-19T22:57:42.051242+0000 mgr.y (mgr.24389) 491 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:57:43.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:43 smithi113 bash[21528]: cluster 2024-04-19T22:57:42.051242+0000 mgr.y (mgr.24389) 491 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:57:43.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:43 smithi178 bash[23441]: cluster 2024-04-19T22:57:42.051242+0000 mgr.y (mgr.24389) 491 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2024-04-19T22:57:45.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:45 smithi113 bash[28910]: cluster 2024-04-19T22:57:44.052087+0000 mgr.y (mgr.24389) 492 : cluster 0 pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 454 B/s wr, 1 op/s 2024-04-19T22:57:45.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:45 smithi113 bash[21528]: cluster 2024-04-19T22:57:44.052087+0000 mgr.y (mgr.24389) 492 : cluster 0 pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 454 B/s wr, 1 op/s 2024-04-19T22:57:45.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:45 smithi178 bash[23441]: cluster 2024-04-19T22:57:44.052087+0000 mgr.y (mgr.24389) 492 : cluster 0 pgmap v741: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 454 B/s wr, 1 op/s 2024-04-19T22:57:45.555 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:46.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:46 smithi113 bash[28910]: audit 2024-04-19T22:57:45.238231+0000 mgr.y (mgr.24389) 493 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:46.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:46 smithi113 bash[21528]: audit 2024-04-19T22:57:45.238231+0000 mgr.y (mgr.24389) 493 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:46.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:46 smithi178 bash[23441]: audit 2024-04-19T22:57:45.238231+0000 mgr.y (mgr.24389) 493 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:47.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:47 smithi113 bash[28910]: cluster 2024-04-19T22:57:46.054328+0000 mgr.y (mgr.24389) 494 : cluster 0 pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-19T22:57:47.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:47 smithi113 bash[21528]: cluster 2024-04-19T22:57:46.054328+0000 mgr.y (mgr.24389) 494 : cluster 0 pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-19T22:57:47.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:47 smithi178 bash[23441]: cluster 2024-04-19T22:57:46.054328+0000 mgr.y (mgr.24389) 494 : cluster 0 pgmap v742: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-19T22:57:47.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:49.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:49 smithi113 bash[21528]: cluster 2024-04-19T22:57:48.055169+0000 mgr.y (mgr.24389) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:49.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:49 smithi113 bash[28910]: cluster 2024-04-19T22:57:48.055169+0000 mgr.y (mgr.24389) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:49 smithi178 bash[23441]: cluster 2024-04-19T22:57:48.055169+0000 mgr.y (mgr.24389) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:50.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:50 smithi113 bash[21528]: audit 2024-04-19T22:57:49.144825+0000 mon.a (mon.0) 2814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:50.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:50 smithi113 bash[28910]: audit 2024-04-19T22:57:49.144825+0000 mon.a (mon.0) 2814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:50.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:50 smithi178 bash[23441]: audit 2024-04-19T22:57:49.144825+0000 mon.a (mon.0) 2814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:57:51.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:51 smithi113 bash[21528]: cluster 2024-04-19T22:57:50.057321+0000 mgr.y (mgr.24389) 496 : cluster 0 pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:57:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:51 smithi113 bash[28910]: cluster 2024-04-19T22:57:50.057321+0000 mgr.y (mgr.24389) 496 : cluster 0 pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:57:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:51 smithi178 bash[23441]: cluster 2024-04-19T22:57:50.057321+0000 mgr.y (mgr.24389) 496 : cluster 0 pgmap v744: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:57:53.145 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:57:52 smithi113 bash[37270]: debug 2024-04-19T22:57:52.860+0000 7ffb5b3ba700 -1 snap_mapper.add_oid found existing snaps mapped on 305:bf4558f9:test-rados-api-smithi113-63998-80::foo:2, removing 2024-04-19T22:57:53.146 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 22:57:52 smithi113 bash[42907]: debug 2024-04-19T22:57:52.860+0000 7f21083cb700 -1 snap_mapper.add_oid found existing snaps mapped on 305:bf4558f9:test-rados-api-smithi113-63998-80::foo:2, removing 2024-04-19T22:57:53.147 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 22:57:52 smithi113 bash[31937]: debug 2024-04-19T22:57:52.860+0000 7f8062cd7700 -1 snap_mapper.add_oid found existing snaps mapped on 305:bf4558f9:test-rados-api-smithi113-63998-80::foo:2, removing 2024-04-19T22:57:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[21528]: cluster 2024-04-19T22:57:52.058179+0000 mgr.y (mgr.24389) 497 : cluster 0 pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[21528]: audit 2024-04-19T22:57:52.867826+0000 mon.c (mon.2) 733 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[21528]: audit 2024-04-19T22:57:52.868532+0000 mon.a (mon.0) 2815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[21528]: audit 2024-04-19T22:57:52.869641+0000 mon.c (mon.2) 734 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[21528]: audit 2024-04-19T22:57:52.870318+0000 mon.a (mon.0) 2816 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:53.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[28910]: cluster 2024-04-19T22:57:52.058179+0000 mgr.y (mgr.24389) 497 : cluster 0 pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:53.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[28910]: audit 2024-04-19T22:57:52.867826+0000 mon.c (mon.2) 733 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[28910]: audit 2024-04-19T22:57:52.868532+0000 mon.a (mon.0) 2815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[28910]: audit 2024-04-19T22:57:52.869641+0000 mon.c (mon.2) 734 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:53 smithi113 bash[28910]: audit 2024-04-19T22:57:52.870318+0000 mon.a (mon.0) 2816 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:53 smithi178 bash[23441]: cluster 2024-04-19T22:57:52.058179+0000 mgr.y (mgr.24389) 497 : cluster 0 pgmap v745: 228 pgs: 228 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:57:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:53 smithi178 bash[23441]: audit 2024-04-19T22:57:52.867826+0000 mon.c (mon.2) 733 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:53 smithi178 bash[23441]: audit 2024-04-19T22:57:52.868532+0000 mon.a (mon.0) 2815 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:53 smithi178 bash[23441]: audit 2024-04-19T22:57:52.869641+0000 mon.c (mon.2) 734 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:53.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:53 smithi178 bash[23441]: audit 2024-04-19T22:57:52.870318+0000 mon.a (mon.0) 2816 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-79"}]: dispatch 2024-04-19T22:57:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:54 smithi113 bash[28910]: cluster 2024-04-19T22:57:53.166334+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-04-19T22:57:54.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:54 smithi113 bash[28910]: audit 2024-04-19T22:57:54.106283+0000 mon.a (mon.0) 2818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:57:54.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:54 smithi113 bash[21528]: cluster 2024-04-19T22:57:53.166334+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-04-19T22:57:54.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:54 smithi113 bash[21528]: audit 2024-04-19T22:57:54.106283+0000 mon.a (mon.0) 2818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:57:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:54 smithi178 bash[23441]: cluster 2024-04-19T22:57:53.166334+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-04-19T22:57:54.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:54 smithi178 bash[23441]: audit 2024-04-19T22:57:54.106283+0000 mon.a (mon.0) 2818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:57:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[28910]: cluster 2024-04-19T22:57:54.059005+0000 mgr.y (mgr.24389) 498 : cluster 0 pgmap v747: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[28910]: cluster 2024-04-19T22:57:54.187656+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[28910]: audit 2024-04-19T22:57:54.190090+0000 mon.c (mon.2) 735 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[28910]: audit 2024-04-19T22:57:54.195094+0000 mon.a (mon.0) 2820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[21528]: cluster 2024-04-19T22:57:54.059005+0000 mgr.y (mgr.24389) 498 : cluster 0 pgmap v747: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[21528]: cluster 2024-04-19T22:57:54.187656+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[21528]: audit 2024-04-19T22:57:54.190090+0000 mon.c (mon.2) 735 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:55 smithi113 bash[21528]: audit 2024-04-19T22:57:54.195094+0000 mon.a (mon.0) 2820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:55.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:57:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:57:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:55 smithi178 bash[23441]: cluster 2024-04-19T22:57:54.059005+0000 mgr.y (mgr.24389) 498 : cluster 0 pgmap v747: 196 pgs: 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:57:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:55 smithi178 bash[23441]: cluster 2024-04-19T22:57:54.187656+0000 mon.a (mon.0) 2819 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-04-19T22:57:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:55 smithi178 bash[23441]: audit 2024-04-19T22:57:54.190090+0000 mon.c (mon.2) 735 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:55 smithi178 bash[23441]: audit 2024-04-19T22:57:54.195094+0000 mon.a (mon.0) 2820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:55.172413+0000 mon.a (mon.0) 2821 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: cluster 2024-04-19T22:57:55.180726+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:55.185170+0000 mon.c (mon.2) 736 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:55.201381+0000 mon.c (mon.2) 737 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:55.222315+0000 mon.a (mon.0) 2823 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:55.245975+0000 mgr.y (mgr.24389) 499 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:56.175130+0000 mon.a (mon.0) 2824 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: cluster 2024-04-19T22:57:56.182810+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:56.185553+0000 mon.c (mon.2) 738 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[28910]: audit 2024-04-19T22:57:56.188325+0000 mon.a (mon.0) 2826 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:55.172413+0000 mon.a (mon.0) 2821 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: cluster 2024-04-19T22:57:55.180726+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:55.185170+0000 mon.c (mon.2) 736 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:55.201381+0000 mon.c (mon.2) 737 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:55.222315+0000 mon.a (mon.0) 2823 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:55.245975+0000 mgr.y (mgr.24389) 499 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:56.175130+0000 mon.a (mon.0) 2824 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: cluster 2024-04-19T22:57:56.182810+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:56.185553+0000 mon.c (mon.2) 738 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:56 smithi113 bash[21528]: audit 2024-04-19T22:57:56.188325+0000 mon.a (mon.0) 2826 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:55.172413+0000 mon.a (mon.0) 2821 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: cluster 2024-04-19T22:57:55.180726+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:55.185170+0000 mon.c (mon.2) 736 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:55.201381+0000 mon.c (mon.2) 737 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:55.222315+0000 mon.a (mon.0) 2823 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:55.245975+0000 mgr.y (mgr.24389) 499 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:56.175130+0000 mon.a (mon.0) 2824 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: cluster 2024-04-19T22:57:56.182810+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:56.185553+0000 mon.c (mon.2) 738 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:56 smithi178 bash[23441]: audit 2024-04-19T22:57:56.188325+0000 mon.a (mon.0) 2826 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:57:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[28910]: cluster 2024-04-19T22:57:56.059824+0000 mgr.y (mgr.24389) 500 : cluster 0 pgmap v750: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[28910]: audit 2024-04-19T22:57:57.176717+0000 mon.a (mon.0) 2827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[28910]: cluster 2024-04-19T22:57:57.180966+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[28910]: audit 2024-04-19T22:57:57.183332+0000 mon.c (mon.2) 739 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[28910]: audit 2024-04-19T22:57:57.183849+0000 mon.a (mon.0) 2829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21528]: cluster 2024-04-19T22:57:56.059824+0000 mgr.y (mgr.24389) 500 : cluster 0 pgmap v750: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21528]: audit 2024-04-19T22:57:57.176717+0000 mon.a (mon.0) 2827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21528]: cluster 2024-04-19T22:57:57.180966+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21528]: audit 2024-04-19T22:57:57.183332+0000 mon.c (mon.2) 739 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21528]: audit 2024-04-19T22:57:57.183849+0000 mon.a (mon.0) 2829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:57 smithi178 bash[23441]: cluster 2024-04-19T22:57:56.059824+0000 mgr.y (mgr.24389) 500 : cluster 0 pgmap v750: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-19T22:57:57.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:57 smithi178 bash[23441]: audit 2024-04-19T22:57:57.176717+0000 mon.a (mon.0) 2827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:57:57.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:57 smithi178 bash[23441]: cluster 2024-04-19T22:57:57.180966+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-04-19T22:57:57.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:57 smithi178 bash[23441]: audit 2024-04-19T22:57:57.183332+0000 mon.c (mon.2) 739 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:57 smithi178 bash[23441]: audit 2024-04-19T22:57:57.183849+0000 mon.a (mon.0) 2829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:57:57.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:57:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:57:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:57:59.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[21528]: cluster 2024-04-19T22:57:58.060818+0000 mgr.y (mgr.24389) 501 : cluster 0 pgmap v753: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:57:59.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[21528]: audit 2024-04-19T22:57:58.179294+0000 mon.a (mon.0) 2830 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:57:59.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[21528]: cluster 2024-04-19T22:57:58.188223+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[21528]: audit 2024-04-19T22:57:58.190345+0000 mon.c (mon.2) 740 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[21528]: audit 2024-04-19T22:57:58.193406+0000 mon.a (mon.0) 2832 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[28910]: cluster 2024-04-19T22:57:58.060818+0000 mgr.y (mgr.24389) 501 : cluster 0 pgmap v753: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[28910]: audit 2024-04-19T22:57:58.179294+0000 mon.a (mon.0) 2830 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[28910]: cluster 2024-04-19T22:57:58.188223+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[28910]: audit 2024-04-19T22:57:58.190345+0000 mon.c (mon.2) 740 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:57:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:57:59 smithi113 bash[28910]: audit 2024-04-19T22:57:58.193406+0000 mon.a (mon.0) 2832 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:57:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:59 smithi178 bash[23441]: cluster 2024-04-19T22:57:58.060818+0000 mgr.y (mgr.24389) 501 : cluster 0 pgmap v753: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 588 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T22:57:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:59 smithi178 bash[23441]: audit 2024-04-19T22:57:58.179294+0000 mon.a (mon.0) 2830 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:57:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:59 smithi178 bash[23441]: cluster 2024-04-19T22:57:58.188223+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-04-19T22:57:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:59 smithi178 bash[23441]: audit 2024-04-19T22:57:58.190345+0000 mon.c (mon.2) 740 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:57:59.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:57:59 smithi178 bash[23441]: audit 2024-04-19T22:57:58.193406+0000 mon.a (mon.0) 2832 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: audit 2024-04-19T22:57:59.181362+0000 mon.a (mon.0) 2833 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: cluster 2024-04-19T22:57:59.185937+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: audit 2024-04-19T22:57:59.218556+0000 mon.c (mon.2) 741 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: audit 2024-04-19T22:57:59.219019+0000 mon.a (mon.0) 2835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: audit 2024-04-19T22:57:59.752924+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[21528]: audit 2024-04-19T22:57:59.758468+0000 mon.a (mon.0) 2837 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: audit 2024-04-19T22:57:59.181362+0000 mon.a (mon.0) 2833 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: cluster 2024-04-19T22:57:59.185937+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-04-19T22:58:00.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: audit 2024-04-19T22:57:59.218556+0000 mon.c (mon.2) 741 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: audit 2024-04-19T22:57:59.219019+0000 mon.a (mon.0) 2835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: audit 2024-04-19T22:57:59.752924+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:00.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:00 smithi113 bash[28910]: audit 2024-04-19T22:57:59.758468+0000 mon.a (mon.0) 2837 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:00.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: audit 2024-04-19T22:57:59.181362+0000 mon.a (mon.0) 2833 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:00.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: cluster 2024-04-19T22:57:59.185937+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-04-19T22:58:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: audit 2024-04-19T22:57:59.218556+0000 mon.c (mon.2) 741 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: audit 2024-04-19T22:57:59.219019+0000 mon.a (mon.0) 2835 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-04-19T22:58:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: audit 2024-04-19T22:57:59.752924+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:00.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:00 smithi178 bash[23441]: audit 2024-04-19T22:57:59.758468+0000 mon.a (mon.0) 2837 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: cluster 2024-04-19T22:58:00.062090+0000 mgr.y (mgr.24389) 502 : cluster 0 pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:01.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.198510+0000 mon.a (mon.0) 2838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-19T22:58:01.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: cluster 2024-04-19T22:58:00.203752+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-04-19T22:58:01.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.232581+0000 mon.c (mon.2) 742 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.233105+0000 mon.a (mon.0) 2840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.251121+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.260549+0000 mon.a (mon.0) 2842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.851535+0000 mon.a (mon.0) 2843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.853174+0000 mon.a (mon.0) 2844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[28910]: audit 2024-04-19T22:58:00.862805+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: cluster 2024-04-19T22:58:00.062090+0000 mgr.y (mgr.24389) 502 : cluster 0 pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:01.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.198510+0000 mon.a (mon.0) 2838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: cluster 2024-04-19T22:58:00.203752+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.232581+0000 mon.c (mon.2) 742 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.233105+0000 mon.a (mon.0) 2840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.251121+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.260549+0000 mon.a (mon.0) 2842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.851535+0000 mon.a (mon.0) 2843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.853174+0000 mon.a (mon.0) 2844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:58:01.552 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:01 smithi113 bash[21528]: audit 2024-04-19T22:58:00.862805+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: cluster 2024-04-19T22:58:00.062090+0000 mgr.y (mgr.24389) 502 : cluster 0 pgmap v756: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.198510+0000 mon.a (mon.0) 2838 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: cluster 2024-04-19T22:58:00.203752+0000 mon.a (mon.0) 2839 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.232581+0000 mon.c (mon.2) 742 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.233105+0000 mon.a (mon.0) 2840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.251121+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.260549+0000 mon.a (mon.0) 2842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.851535+0000 mon.a (mon.0) 2843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.853174+0000 mon.a (mon.0) 2844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:58:01.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:01 smithi178 bash[23441]: audit 2024-04-19T22:58:00.862805+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:58:02.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[21528]: audit 2024-04-19T22:58:01.211941+0000 mon.a (mon.0) 2846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[21528]: cluster 2024-04-19T22:58:01.219187+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[21528]: audit 2024-04-19T22:58:01.255859+0000 mon.c (mon.2) 743 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[21528]: audit 2024-04-19T22:58:01.256987+0000 mon.a (mon.0) 2848 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[28910]: audit 2024-04-19T22:58:01.211941+0000 mon.a (mon.0) 2846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[28910]: cluster 2024-04-19T22:58:01.219187+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[28910]: audit 2024-04-19T22:58:01.255859+0000 mon.c (mon.2) 743 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:02 smithi113 bash[28910]: audit 2024-04-19T22:58:01.256987+0000 mon.a (mon.0) 2848 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:02 smithi178 bash[23441]: audit 2024-04-19T22:58:01.211941+0000 mon.a (mon.0) 2846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-04-19T22:58:02.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:02 smithi178 bash[23441]: cluster 2024-04-19T22:58:01.219187+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-04-19T22:58:02.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:02 smithi178 bash[23441]: audit 2024-04-19T22:58:01.255859+0000 mon.c (mon.2) 743 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:02.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:02 smithi178 bash[23441]: audit 2024-04-19T22:58:01.256987+0000 mon.a (mon.0) 2848 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: cluster 2024-04-19T22:58:02.062887+0000 mgr.y (mgr.24389) 503 : cluster 0 pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: audit 2024-04-19T22:58:02.220969+0000 mon.a (mon.0) 2849 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: cluster 2024-04-19T22:58:02.230860+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: audit 2024-04-19T22:58:02.307378+0000 mon.c (mon.2) 744 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: audit 2024-04-19T22:58:02.308160+0000 mon.a (mon.0) 2851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: audit 2024-04-19T22:58:02.309316+0000 mon.c (mon.2) 745 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[28910]: audit 2024-04-19T22:58:02.309933+0000 mon.a (mon.0) 2852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: cluster 2024-04-19T22:58:02.062887+0000 mgr.y (mgr.24389) 503 : cluster 0 pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:03.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: audit 2024-04-19T22:58:02.220969+0000 mon.a (mon.0) 2849 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:03.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: cluster 2024-04-19T22:58:02.230860+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-04-19T22:58:03.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: audit 2024-04-19T22:58:02.307378+0000 mon.c (mon.2) 744 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: audit 2024-04-19T22:58:02.308160+0000 mon.a (mon.0) 2851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: audit 2024-04-19T22:58:02.309316+0000 mon.c (mon.2) 745 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:03.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:03 smithi113 bash[21528]: audit 2024-04-19T22:58:02.309933+0000 mon.a (mon.0) 2852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: cluster 2024-04-19T22:58:02.062887+0000 mgr.y (mgr.24389) 503 : cluster 0 pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: audit 2024-04-19T22:58:02.220969+0000 mon.a (mon.0) 2849 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: cluster 2024-04-19T22:58:02.230860+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: audit 2024-04-19T22:58:02.307378+0000 mon.c (mon.2) 744 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: audit 2024-04-19T22:58:02.308160+0000 mon.a (mon.0) 2851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: audit 2024-04-19T22:58:02.309316+0000 mon.c (mon.2) 745 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:03.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:03 smithi178 bash[23441]: audit 2024-04-19T22:58:02.309933+0000 mon.a (mon.0) 2852 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-81"}]: dispatch 2024-04-19T22:58:04.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:04 smithi113 bash[28910]: cluster 2024-04-19T22:58:03.244237+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-04-19T22:58:04.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:04 smithi113 bash[28910]: audit 2024-04-19T22:58:04.178195+0000 mon.a (mon.0) 2854 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:04.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:04 smithi113 bash[21528]: cluster 2024-04-19T22:58:03.244237+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-04-19T22:58:04.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:04 smithi113 bash[21528]: audit 2024-04-19T22:58:04.178195+0000 mon.a (mon.0) 2854 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:04 smithi178 bash[23441]: cluster 2024-04-19T22:58:03.244237+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-04-19T22:58:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:04 smithi178 bash[23441]: audit 2024-04-19T22:58:04.178195+0000 mon.a (mon.0) 2854 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:05.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[21528]: cluster 2024-04-19T22:58:04.063648+0000 mgr.y (mgr.24389) 504 : cluster 0 pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[21528]: cluster 2024-04-19T22:58:04.257289+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[21528]: audit 2024-04-19T22:58:04.266060+0000 mon.c (mon.2) 746 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[21528]: audit 2024-04-19T22:58:04.269285+0000 mon.a (mon.0) 2856 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[28910]: cluster 2024-04-19T22:58:04.063648+0000 mgr.y (mgr.24389) 504 : cluster 0 pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[28910]: cluster 2024-04-19T22:58:04.257289+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[28910]: audit 2024-04-19T22:58:04.266060+0000 mon.c (mon.2) 746 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:05.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:05 smithi113 bash[28910]: audit 2024-04-19T22:58:04.269285+0000 mon.a (mon.0) 2856 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:05.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:05 smithi178 bash[23441]: cluster 2024-04-19T22:58:04.063648+0000 mgr.y (mgr.24389) 504 : cluster 0 pgmap v762: 196 pgs: 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:05 smithi178 bash[23441]: cluster 2024-04-19T22:58:04.257289+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-04-19T22:58:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:05 smithi178 bash[23441]: audit 2024-04-19T22:58:04.266060+0000 mon.c (mon.2) 746 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:05 smithi178 bash[23441]: audit 2024-04-19T22:58:04.269285+0000 mon.a (mon.0) 2856 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: audit 2024-04-19T22:58:05.249809+0000 mgr.y (mgr.24389) 505 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: audit 2024-04-19T22:58:05.259354+0000 mon.a (mon.0) 2857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: cluster 2024-04-19T22:58:05.266682+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-04-19T22:58:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: audit 2024-04-19T22:58:05.279430+0000 mon.c (mon.2) 747 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: audit 2024-04-19T22:58:05.296281+0000 mon.c (mon.2) 748 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[28910]: audit 2024-04-19T22:58:05.297294+0000 mon.a (mon.0) 2859 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: audit 2024-04-19T22:58:05.249809+0000 mgr.y (mgr.24389) 505 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: audit 2024-04-19T22:58:05.259354+0000 mon.a (mon.0) 2857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: cluster 2024-04-19T22:58:05.266682+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: audit 2024-04-19T22:58:05.279430+0000 mon.c (mon.2) 747 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: audit 2024-04-19T22:58:05.296281+0000 mon.c (mon.2) 748 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:06.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:06 smithi113 bash[21528]: audit 2024-04-19T22:58:05.297294+0000 mon.a (mon.0) 2859 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: audit 2024-04-19T22:58:05.249809+0000 mgr.y (mgr.24389) 505 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: audit 2024-04-19T22:58:05.259354+0000 mon.a (mon.0) 2857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: cluster 2024-04-19T22:58:05.266682+0000 mon.a (mon.0) 2858 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-04-19T22:58:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: audit 2024-04-19T22:58:05.279430+0000 mon.c (mon.2) 747 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: audit 2024-04-19T22:58:05.296281+0000 mon.c (mon.2) 748 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:06 smithi178 bash[23441]: audit 2024-04-19T22:58:05.297294+0000 mon.a (mon.0) 2859 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:07.547 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[28910]: cluster 2024-04-19T22:58:06.064468+0000 mgr.y (mgr.24389) 506 : cluster 0 pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[28910]: audit 2024-04-19T22:58:06.268426+0000 mon.a (mon.0) 2860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[28910]: cluster 2024-04-19T22:58:06.279097+0000 mon.a (mon.0) 2861 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[28910]: audit 2024-04-19T22:58:06.279348+0000 mon.c (mon.2) 749 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[28910]: audit 2024-04-19T22:58:06.282221+0000 mon.a (mon.0) 2862 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21528]: cluster 2024-04-19T22:58:06.064468+0000 mgr.y (mgr.24389) 506 : cluster 0 pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21528]: audit 2024-04-19T22:58:06.268426+0000 mon.a (mon.0) 2860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:07.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21528]: cluster 2024-04-19T22:58:06.279097+0000 mon.a (mon.0) 2861 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-04-19T22:58:07.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21528]: audit 2024-04-19T22:58:06.279348+0000 mon.c (mon.2) 749 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:07.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:07 smithi113 bash[21528]: audit 2024-04-19T22:58:06.282221+0000 mon.a (mon.0) 2862 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:07 smithi178 bash[23441]: cluster 2024-04-19T22:58:06.064468+0000 mgr.y (mgr.24389) 506 : cluster 0 pgmap v765: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-04-19T22:58:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:07 smithi178 bash[23441]: audit 2024-04-19T22:58:06.268426+0000 mon.a (mon.0) 2860 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:07 smithi178 bash[23441]: cluster 2024-04-19T22:58:06.279097+0000 mon.a (mon.0) 2861 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-04-19T22:58:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:07 smithi178 bash[23441]: audit 2024-04-19T22:58:06.279348+0000 mon.c (mon.2) 749 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:07 smithi178 bash[23441]: audit 2024-04-19T22:58:06.282221+0000 mon.a (mon.0) 2862 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:08.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: audit 2024-04-19T22:58:07.271112+0000 mon.a (mon.0) 2863 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: cluster 2024-04-19T22:58:07.279602+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: audit 2024-04-19T22:58:07.280744+0000 mon.c (mon.2) 750 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: audit 2024-04-19T22:58:07.282919+0000 mon.a (mon.0) 2865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: audit 2024-04-19T22:58:08.273877+0000 mon.a (mon.0) 2866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[28910]: cluster 2024-04-19T22:58:08.280416+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: audit 2024-04-19T22:58:07.271112+0000 mon.a (mon.0) 2863 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: cluster 2024-04-19T22:58:07.279602+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: audit 2024-04-19T22:58:07.280744+0000 mon.c (mon.2) 750 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: audit 2024-04-19T22:58:07.282919+0000 mon.a (mon.0) 2865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: audit 2024-04-19T22:58:08.273877+0000 mon.a (mon.0) 2866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:08.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:08 smithi113 bash[21528]: cluster 2024-04-19T22:58:08.280416+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: audit 2024-04-19T22:58:07.271112+0000 mon.a (mon.0) 2863 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: cluster 2024-04-19T22:58:07.279602+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: audit 2024-04-19T22:58:07.280744+0000 mon.c (mon.2) 750 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: audit 2024-04-19T22:58:07.282919+0000 mon.a (mon.0) 2865 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: audit 2024-04-19T22:58:08.273877+0000 mon.a (mon.0) 2866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:08.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:08 smithi178 bash[23441]: cluster 2024-04-19T22:58:08.280416+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-04-19T22:58:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:09 smithi178 bash[23441]: cluster 2024-04-19T22:58:08.065284+0000 mgr.y (mgr.24389) 507 : cluster 0 pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-04-19T22:58:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:09 smithi178 bash[23441]: audit 2024-04-19T22:58:08.284728+0000 mon.c (mon.2) 751 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:09 smithi178 bash[23441]: audit 2024-04-19T22:58:08.285749+0000 mon.a (mon.0) 2868 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:09 smithi178 bash[23441]: audit 2024-04-19T22:58:09.276586+0000 mon.a (mon.0) 2869 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:09.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:09 smithi178 bash[23441]: cluster 2024-04-19T22:58:09.283735+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[21528]: cluster 2024-04-19T22:58:08.065284+0000 mgr.y (mgr.24389) 507 : cluster 0 pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[21528]: audit 2024-04-19T22:58:08.284728+0000 mon.c (mon.2) 751 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[21528]: audit 2024-04-19T22:58:08.285749+0000 mon.a (mon.0) 2868 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[21528]: audit 2024-04-19T22:58:09.276586+0000 mon.a (mon.0) 2869 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[21528]: cluster 2024-04-19T22:58:09.283735+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[28910]: cluster 2024-04-19T22:58:08.065284+0000 mgr.y (mgr.24389) 507 : cluster 0 pgmap v768: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[28910]: audit 2024-04-19T22:58:08.284728+0000 mon.c (mon.2) 751 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[28910]: audit 2024-04-19T22:58:08.285749+0000 mon.a (mon.0) 2868 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:09.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[28910]: audit 2024-04-19T22:58:09.276586+0000 mon.a (mon.0) 2869 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:09.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:09 smithi113 bash[28910]: cluster 2024-04-19T22:58:09.283735+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-04-19T22:58:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:11 smithi113 bash[21528]: cluster 2024-04-19T22:58:10.067491+0000 mgr.y (mgr.24389) 508 : cluster 0 pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:11.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:11 smithi113 bash[21528]: cluster 2024-04-19T22:58:10.317967+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-04-19T22:58:11.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:11 smithi113 bash[28910]: cluster 2024-04-19T22:58:10.067491+0000 mgr.y (mgr.24389) 508 : cluster 0 pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:11.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:11 smithi113 bash[28910]: cluster 2024-04-19T22:58:10.317967+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-04-19T22:58:11.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:11 smithi178 bash[23441]: cluster 2024-04-19T22:58:10.067491+0000 mgr.y (mgr.24389) 508 : cluster 0 pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:11.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:11 smithi178 bash[23441]: cluster 2024-04-19T22:58:10.317967+0000 mon.a (mon.0) 2871 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-04-19T22:58:12.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[28910]: cluster 2024-04-19T22:58:11.320234+0000 mon.a (mon.0) 2872 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[28910]: audit 2024-04-19T22:58:11.401119+0000 mon.c (mon.2) 752 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[28910]: audit 2024-04-19T22:58:11.401933+0000 mon.a (mon.0) 2873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[28910]: audit 2024-04-19T22:58:11.403295+0000 mon.c (mon.2) 753 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[28910]: audit 2024-04-19T22:58:11.404019+0000 mon.a (mon.0) 2874 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[21528]: cluster 2024-04-19T22:58:11.320234+0000 mon.a (mon.0) 2872 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[21528]: audit 2024-04-19T22:58:11.401119+0000 mon.c (mon.2) 752 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[21528]: audit 2024-04-19T22:58:11.401933+0000 mon.a (mon.0) 2873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[21528]: audit 2024-04-19T22:58:11.403295+0000 mon.c (mon.2) 753 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:12.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:12 smithi113 bash[21528]: audit 2024-04-19T22:58:11.404019+0000 mon.a (mon.0) 2874 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:12.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:12 smithi178 bash[23441]: cluster 2024-04-19T22:58:11.320234+0000 mon.a (mon.0) 2872 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-04-19T22:58:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:12 smithi178 bash[23441]: audit 2024-04-19T22:58:11.401119+0000 mon.c (mon.2) 752 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:12 smithi178 bash[23441]: audit 2024-04-19T22:58:11.401933+0000 mon.a (mon.0) 2873 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:12 smithi178 bash[23441]: audit 2024-04-19T22:58:11.403295+0000 mon.c (mon.2) 753 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:12 smithi178 bash[23441]: audit 2024-04-19T22:58:11.404019+0000 mon.a (mon.0) 2874 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-83"}]: dispatch 2024-04-19T22:58:13.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:13 smithi113 bash[28910]: cluster 2024-04-19T22:58:12.068337+0000 mgr.y (mgr.24389) 509 : cluster 0 pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:13.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:13 smithi113 bash[28910]: cluster 2024-04-19T22:58:12.345365+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-04-19T22:58:13.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:13 smithi113 bash[21528]: cluster 2024-04-19T22:58:12.068337+0000 mgr.y (mgr.24389) 509 : cluster 0 pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:13.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:13 smithi113 bash[21528]: cluster 2024-04-19T22:58:12.345365+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-04-19T22:58:13.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:13 smithi178 bash[23441]: cluster 2024-04-19T22:58:12.068337+0000 mgr.y (mgr.24389) 509 : cluster 0 pgmap v774: 228 pgs: 228 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:13.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:13 smithi178 bash[23441]: cluster 2024-04-19T22:58:12.345365+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[21528]: cluster 2024-04-19T22:58:13.356015+0000 mon.a (mon.0) 2876 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[21528]: audit 2024-04-19T22:58:13.364087+0000 mon.c (mon.2) 754 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[21528]: audit 2024-04-19T22:58:13.372379+0000 mon.a (mon.0) 2877 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[28910]: cluster 2024-04-19T22:58:13.356015+0000 mon.a (mon.0) 2876 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[28910]: audit 2024-04-19T22:58:13.364087+0000 mon.c (mon.2) 754 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:14.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:14 smithi113 bash[28910]: audit 2024-04-19T22:58:13.372379+0000 mon.a (mon.0) 2877 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:14 smithi178 bash[23441]: cluster 2024-04-19T22:58:13.356015+0000 mon.a (mon.0) 2876 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-04-19T22:58:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:14 smithi178 bash[23441]: audit 2024-04-19T22:58:13.364087+0000 mon.c (mon.2) 754 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:14 smithi178 bash[23441]: audit 2024-04-19T22:58:13.372379+0000 mon.a (mon.0) 2877 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:15.555 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: cluster 2024-04-19T22:58:14.069165+0000 mgr.y (mgr.24389) 510 : cluster 0 pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: cluster 2024-04-19T22:58:14.347772+0000 mon.a (mon.0) 2878 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: audit 2024-04-19T22:58:14.359759+0000 mon.a (mon.0) 2879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: cluster 2024-04-19T22:58:14.370832+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: audit 2024-04-19T22:58:14.374987+0000 mon.c (mon.2) 755 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: audit 2024-04-19T22:58:14.390685+0000 mon.c (mon.2) 756 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:15 smithi178 bash[23441]: audit 2024-04-19T22:58:14.392338+0000 mon.a (mon.0) 2881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: cluster 2024-04-19T22:58:14.069165+0000 mgr.y (mgr.24389) 510 : cluster 0 pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: cluster 2024-04-19T22:58:14.347772+0000 mon.a (mon.0) 2878 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: audit 2024-04-19T22:58:14.359759+0000 mon.a (mon.0) 2879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: cluster 2024-04-19T22:58:14.370832+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: audit 2024-04-19T22:58:14.374987+0000 mon.c (mon.2) 755 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: audit 2024-04-19T22:58:14.390685+0000 mon.c (mon.2) 756 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[28910]: audit 2024-04-19T22:58:14.392338+0000 mon.a (mon.0) 2881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:15.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: cluster 2024-04-19T22:58:14.069165+0000 mgr.y (mgr.24389) 510 : cluster 0 pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: cluster 2024-04-19T22:58:14.347772+0000 mon.a (mon.0) 2878 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: audit 2024-04-19T22:58:14.359759+0000 mon.a (mon.0) 2879 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: cluster 2024-04-19T22:58:14.370832+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: audit 2024-04-19T22:58:14.374987+0000 mon.c (mon.2) 755 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: audit 2024-04-19T22:58:14.390685+0000 mon.c (mon.2) 756 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:15.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:15 smithi113 bash[21528]: audit 2024-04-19T22:58:14.392338+0000 mon.a (mon.0) 2881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[28910]: audit 2024-04-19T22:58:15.253469+0000 mgr.y (mgr.24389) 511 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[28910]: audit 2024-04-19T22:58:15.372955+0000 mon.a (mon.0) 2882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[28910]: cluster 2024-04-19T22:58:15.380938+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[28910]: audit 2024-04-19T22:58:15.386777+0000 mon.c (mon.2) 757 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[28910]: audit 2024-04-19T22:58:15.389029+0000 mon.a (mon.0) 2884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[21528]: audit 2024-04-19T22:58:15.253469+0000 mgr.y (mgr.24389) 511 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:16.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[21528]: audit 2024-04-19T22:58:15.372955+0000 mon.a (mon.0) 2882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:16.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[21528]: cluster 2024-04-19T22:58:15.380938+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-04-19T22:58:16.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[21528]: audit 2024-04-19T22:58:15.386777+0000 mon.c (mon.2) 757 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:16.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:16 smithi113 bash[21528]: audit 2024-04-19T22:58:15.389029+0000 mon.a (mon.0) 2884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:16 smithi178 bash[23441]: audit 2024-04-19T22:58:15.253469+0000 mgr.y (mgr.24389) 511 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:16 smithi178 bash[23441]: audit 2024-04-19T22:58:15.372955+0000 mon.a (mon.0) 2882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:16 smithi178 bash[23441]: cluster 2024-04-19T22:58:15.380938+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-04-19T22:58:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:16 smithi178 bash[23441]: audit 2024-04-19T22:58:15.386777+0000 mon.c (mon.2) 757 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:16 smithi178 bash[23441]: audit 2024-04-19T22:58:15.389029+0000 mon.a (mon.0) 2884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:17.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[28910]: cluster 2024-04-19T22:58:16.070001+0000 mgr.y (mgr.24389) 512 : cluster 0 pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[28910]: audit 2024-04-19T22:58:16.382208+0000 mon.a (mon.0) 2885 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[28910]: cluster 2024-04-19T22:58:16.392148+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[28910]: audit 2024-04-19T22:58:16.395278+0000 mon.c (mon.2) 758 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[28910]: audit 2024-04-19T22:58:16.396744+0000 mon.a (mon.0) 2887 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21528]: cluster 2024-04-19T22:58:16.070001+0000 mgr.y (mgr.24389) 512 : cluster 0 pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-19T22:58:17.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21528]: audit 2024-04-19T22:58:16.382208+0000 mon.a (mon.0) 2885 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:17.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21528]: cluster 2024-04-19T22:58:16.392148+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-04-19T22:58:17.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21528]: audit 2024-04-19T22:58:16.395278+0000 mon.c (mon.2) 758 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:17.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:17 smithi113 bash[21528]: audit 2024-04-19T22:58:16.396744+0000 mon.a (mon.0) 2887 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:17 smithi178 bash[23441]: cluster 2024-04-19T22:58:16.070001+0000 mgr.y (mgr.24389) 512 : cluster 0 pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-19T22:58:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:17 smithi178 bash[23441]: audit 2024-04-19T22:58:16.382208+0000 mon.a (mon.0) 2885 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_tier","val": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:58:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:17 smithi178 bash[23441]: cluster 2024-04-19T22:58:16.392148+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-04-19T22:58:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:17 smithi178 bash[23441]: audit 2024-04-19T22:58:16.395278+0000 mon.c (mon.2) 758 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:17 smithi178 bash[23441]: audit 2024-04-19T22:58:16.396744+0000 mon.a (mon.0) 2887 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: audit 2024-04-19T22:58:17.384916+0000 mon.a (mon.0) 2888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: cluster 2024-04-19T22:58:17.393472+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: audit 2024-04-19T22:58:17.394994+0000 mon.c (mon.2) 759 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: audit 2024-04-19T22:58:17.396073+0000 mon.a (mon.0) 2890 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: audit 2024-04-19T22:58:18.387603+0000 mon.a (mon.0) 2891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[21528]: cluster 2024-04-19T22:58:18.395315+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: audit 2024-04-19T22:58:17.384916+0000 mon.a (mon.0) 2888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:18.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: cluster 2024-04-19T22:58:17.393472+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-04-19T22:58:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: audit 2024-04-19T22:58:17.394994+0000 mon.c (mon.2) 759 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: audit 2024-04-19T22:58:17.396073+0000 mon.a (mon.0) 2890 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: audit 2024-04-19T22:58:18.387603+0000 mon.a (mon.0) 2891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:18 smithi113 bash[28910]: cluster 2024-04-19T22:58:18.395315+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: audit 2024-04-19T22:58:17.384916+0000 mon.a (mon.0) 2888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: cluster 2024-04-19T22:58:17.393472+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: audit 2024-04-19T22:58:17.394994+0000 mon.c (mon.2) 759 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: audit 2024-04-19T22:58:17.396073+0000 mon.a (mon.0) 2890 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: audit 2024-04-19T22:58:18.387603+0000 mon.a (mon.0) 2891 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:18 smithi178 bash[23441]: cluster 2024-04-19T22:58:18.395315+0000 mon.a (mon.0) 2892 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-04-19T22:58:19.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:19 smithi113 bash[28910]: cluster 2024-04-19T22:58:18.070824+0000 mgr.y (mgr.24389) 513 : cluster 0 pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-19T22:58:19.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:19 smithi113 bash[28910]: audit 2024-04-19T22:58:19.211858+0000 mon.a (mon.0) 2893 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:19.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:19 smithi113 bash[21528]: cluster 2024-04-19T22:58:18.070824+0000 mgr.y (mgr.24389) 513 : cluster 0 pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-19T22:58:19.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:19 smithi113 bash[21528]: audit 2024-04-19T22:58:19.211858+0000 mon.a (mon.0) 2893 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:19.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:19 smithi178 bash[23441]: cluster 2024-04-19T22:58:18.070824+0000 mgr.y (mgr.24389) 513 : cluster 0 pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 590 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-04-19T22:58:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:19 smithi178 bash[23441]: audit 2024-04-19T22:58:19.211858+0000 mon.a (mon.0) 2893 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:20.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:20 smithi113 bash[21528]: cluster 2024-04-19T22:58:19.437111+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-04-19T22:58:20.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:20 smithi113 bash[28910]: cluster 2024-04-19T22:58:19.437111+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-04-19T22:58:20.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:20 smithi178 bash[23441]: cluster 2024-04-19T22:58:19.437111+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: cluster 2024-04-19T22:58:20.072914+0000 mgr.y (mgr.24389) 514 : cluster 0 pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: cluster 2024-04-19T22:58:20.443906+0000 mon.a (mon.0) 2895 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: audit 2024-04-19T22:58:20.525574+0000 mon.c (mon.2) 760 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: audit 2024-04-19T22:58:20.526400+0000 mon.a (mon.0) 2896 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: audit 2024-04-19T22:58:20.527603+0000 mon.c (mon.2) 761 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: audit 2024-04-19T22:58:20.528246+0000 mon.a (mon.0) 2897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[21528]: cluster 2024-04-19T22:58:20.990267+0000 mon.a (mon.0) 2898 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: cluster 2024-04-19T22:58:20.072914+0000 mgr.y (mgr.24389) 514 : cluster 0 pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-19T22:58:21.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: cluster 2024-04-19T22:58:20.443906+0000 mon.a (mon.0) 2895 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-04-19T22:58:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: audit 2024-04-19T22:58:20.525574+0000 mon.c (mon.2) 760 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: audit 2024-04-19T22:58:20.526400+0000 mon.a (mon.0) 2896 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: audit 2024-04-19T22:58:20.527603+0000 mon.c (mon.2) 761 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: audit 2024-04-19T22:58:20.528246+0000 mon.a (mon.0) 2897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:21 smithi113 bash[28910]: cluster 2024-04-19T22:58:20.990267+0000 mon.a (mon.0) 2898 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: cluster 2024-04-19T22:58:20.072914+0000 mgr.y (mgr.24389) 514 : cluster 0 pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: cluster 2024-04-19T22:58:20.443906+0000 mon.a (mon.0) 2895 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: audit 2024-04-19T22:58:20.525574+0000 mon.c (mon.2) 760 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: audit 2024-04-19T22:58:20.526400+0000 mon.a (mon.0) 2896 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: audit 2024-04-19T22:58:20.527603+0000 mon.c (mon.2) 761 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: audit 2024-04-19T22:58:20.528246+0000 mon.a (mon.0) 2897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-85"}]: dispatch 2024-04-19T22:58:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:21 smithi178 bash[23441]: cluster 2024-04-19T22:58:20.990267+0000 mon.a (mon.0) 2898 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:22.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:22 smithi113 bash[21528]: cluster 2024-04-19T22:58:21.444341+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-04-19T22:58:22.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:22 smithi113 bash[28910]: cluster 2024-04-19T22:58:21.444341+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-04-19T22:58:22.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:22 smithi178 bash[23441]: cluster 2024-04-19T22:58:21.444341+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-04-19T22:58:23.514 INFO:tasks.workunit.client.0.smithi113.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (17759 ms) 2024-04-19T22:58:23.514 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22194 ms) 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3033 ms) 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3051 ms) 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3033 ms) 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3046 ms) 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-19T22:58:23.515 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4044 ms) 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38516 ms) 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17122 ms) 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4050 ms) 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3041 ms) 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.516 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25126 ms) 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15076 ms) 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5081 ms) 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4085 ms) 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: waiting for scrubs... 2024-04-19T22:58:23.517 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: done waiting 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24439 ms) 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10073 ms) 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9100 ms) 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9098 ms) 2024-04-19T22:58:23.518 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-19T22:58:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[21528]: cluster 2024-04-19T22:58:22.073690+0000 mgr.y (mgr.24389) 515 : cluster 0 pgmap v789: 196 pgs: 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[21528]: cluster 2024-04-19T22:58:22.473279+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[21528]: audit 2024-04-19T22:58:22.476187+0000 mon.c (mon.2) 762 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[21528]: audit 2024-04-19T22:58:22.480952+0000 mon.a (mon.0) 2901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[28910]: cluster 2024-04-19T22:58:22.073690+0000 mgr.y (mgr.24389) 515 : cluster 0 pgmap v789: 196 pgs: 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[28910]: cluster 2024-04-19T22:58:22.473279+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[28910]: audit 2024-04-19T22:58:22.476187+0000 mon.c (mon.2) 762 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:23 smithi113 bash[28910]: audit 2024-04-19T22:58:22.480952+0000 mon.a (mon.0) 2901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:23.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:23 smithi178 bash[23441]: cluster 2024-04-19T22:58:22.073690+0000 mgr.y (mgr.24389) 515 : cluster 0 pgmap v789: 196 pgs: 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T22:58:23.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:23 smithi178 bash[23441]: cluster 2024-04-19T22:58:22.473279+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-04-19T22:58:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:23 smithi178 bash[23441]: audit 2024-04-19T22:58:22.476187+0000 mon.c (mon.2) 762 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:23 smithi178 bash[23441]: audit 2024-04-19T22:58:22.480952+0000 mon.a (mon.0) 2901 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:24.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[21528]: audit 2024-04-19T22:58:23.466376+0000 mon.a (mon.0) 2902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:24.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[21528]: cluster 2024-04-19T22:58:23.477386+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-04-19T22:58:24.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[21528]: audit 2024-04-19T22:58:23.480619+0000 mon.c (mon.2) 763 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:24.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[28910]: audit 2024-04-19T22:58:23.466376+0000 mon.a (mon.0) 2902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:24.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[28910]: cluster 2024-04-19T22:58:23.477386+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-04-19T22:58:24.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:24 smithi113 bash[28910]: audit 2024-04-19T22:58:23.480619+0000 mon.c (mon.2) 763 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:24.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:24 smithi178 bash[23441]: audit 2024-04-19T22:58:23.466376+0000 mon.a (mon.0) 2902 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:24.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:24 smithi178 bash[23441]: cluster 2024-04-19T22:58:23.477386+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-04-19T22:58:24.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:24 smithi178 bash[23441]: audit 2024-04-19T22:58:23.480619+0000 mon.c (mon.2) 763 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:25.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:25.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[28910]: cluster 2024-04-19T22:58:24.074512+0000 mgr.y (mgr.24389) 516 : cluster 0 pgmap v792: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[28910]: cluster 2024-04-19T22:58:24.510284+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[28910]: audit 2024-04-19T22:58:24.517003+0000 mon.c (mon.2) 764 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[28910]: audit 2024-04-19T22:58:24.521068+0000 mon.a (mon.0) 2905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[21528]: cluster 2024-04-19T22:58:24.074512+0000 mgr.y (mgr.24389) 516 : cluster 0 pgmap v792: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[21528]: cluster 2024-04-19T22:58:24.510284+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[21528]: audit 2024-04-19T22:58:24.517003+0000 mon.c (mon.2) 764 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:25 smithi113 bash[21528]: audit 2024-04-19T22:58:24.521068+0000 mon.a (mon.0) 2905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:25 smithi178 bash[23441]: cluster 2024-04-19T22:58:24.074512+0000 mgr.y (mgr.24389) 516 : cluster 0 pgmap v792: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:25.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:25 smithi178 bash[23441]: cluster 2024-04-19T22:58:24.510284+0000 mon.a (mon.0) 2904 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-04-19T22:58:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:25 smithi178 bash[23441]: audit 2024-04-19T22:58:24.517003+0000 mon.c (mon.2) 764 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:25 smithi178 bash[23441]: audit 2024-04-19T22:58:24.521068+0000 mon.a (mon.0) 2905 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:25.261971+0000 mgr.y (mgr.24389) 517 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:25.502386+0000 mon.a (mon.0) 2906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: cluster 2024-04-19T22:58:25.512405+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:25.514444+0000 mon.c (mon.2) 765 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:25.530393+0000 mon.a (mon.0) 2908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:26.505104+0000 mon.a (mon.0) 2909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]': finished 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: cluster 2024-04-19T22:58:26.514176+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:26.516177+0000 mon.c (mon.2) 766 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:26 smithi178 bash[23441]: audit 2024-04-19T22:58:26.517998+0000 mon.a (mon.0) 2911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:25.261971+0000 mgr.y (mgr.24389) 517 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:25.502386+0000 mon.a (mon.0) 2906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: cluster 2024-04-19T22:58:25.512405+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-04-19T22:58:27.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:25.514444+0000 mon.c (mon.2) 765 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:25.530393+0000 mon.a (mon.0) 2908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:26.505104+0000 mon.a (mon.0) 2909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]': finished 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: cluster 2024-04-19T22:58:26.514176+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:26.516177+0000 mon.c (mon.2) 766 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[28910]: audit 2024-04-19T22:58:26.517998+0000 mon.a (mon.0) 2911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:25.261971+0000 mgr.y (mgr.24389) 517 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:25.502386+0000 mon.a (mon.0) 2906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: cluster 2024-04-19T22:58:25.512405+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:25.514444+0000 mon.c (mon.2) 765 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:25.530393+0000 mon.a (mon.0) 2908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]: dispatch 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:26.505104+0000 mon.a (mon.0) 2909 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_tier","val": "test-rados-api-smithi113-63998-89-test-flush"}]': finished 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: cluster 2024-04-19T22:58:26.514176+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:26.516177+0000 mon.c (mon.2) 766 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:27.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:26 smithi113 bash[21528]: audit 2024-04-19T22:58:26.517998+0000 mon.a (mon.0) 2911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:58:27.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: cluster 2024-04-19T22:58:26.075311+0000 mgr.y (mgr.24389) 518 : cluster 0 pgmap v795: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: cluster 2024-04-19T22:58:26.539386+0000 mon.a (mon.0) 2912 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: audit 2024-04-19T22:58:27.507918+0000 mon.a (mon.0) 2913 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: cluster 2024-04-19T22:58:27.516093+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: audit 2024-04-19T22:58:27.517671+0000 mon.c (mon.2) 767 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[21528]: audit 2024-04-19T22:58:27.522738+0000 mon.a (mon.0) 2915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: cluster 2024-04-19T22:58:26.075311+0000 mgr.y (mgr.24389) 518 : cluster 0 pgmap v795: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: cluster 2024-04-19T22:58:26.539386+0000 mon.a (mon.0) 2912 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: audit 2024-04-19T22:58:27.507918+0000 mon.a (mon.0) 2913 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: cluster 2024-04-19T22:58:27.516093+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: audit 2024-04-19T22:58:27.517671+0000 mon.c (mon.2) 767 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:27 smithi113 bash[28910]: audit 2024-04-19T22:58:27.522738+0000 mon.a (mon.0) 2915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: cluster 2024-04-19T22:58:26.075311+0000 mgr.y (mgr.24389) 518 : cluster 0 pgmap v795: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: cluster 2024-04-19T22:58:26.539386+0000 mon.a (mon.0) 2912 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: audit 2024-04-19T22:58:27.507918+0000 mon.a (mon.0) 2913 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: cluster 2024-04-19T22:58:27.516093+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: audit 2024-04-19T22:58:27.517671+0000 mon.c (mon.2) 767 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:27 smithi178 bash[23441]: audit 2024-04-19T22:58:27.522738+0000 mon.a (mon.0) 2915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:58:29.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[28910]: cluster 2024-04-19T22:58:28.076233+0000 mgr.y (mgr.24389) 519 : cluster 0 pgmap v798: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[28910]: audit 2024-04-19T22:58:28.510538+0000 mon.a (mon.0) 2916 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[28910]: cluster 2024-04-19T22:58:28.518131+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-04-19T22:58:29.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[21528]: cluster 2024-04-19T22:58:28.076233+0000 mgr.y (mgr.24389) 519 : cluster 0 pgmap v798: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:29.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[21528]: audit 2024-04-19T22:58:28.510538+0000 mon.a (mon.0) 2916 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:29.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:29 smithi113 bash[21528]: cluster 2024-04-19T22:58:28.518131+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-04-19T22:58:29.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:29 smithi178 bash[23441]: cluster 2024-04-19T22:58:28.076233+0000 mgr.y (mgr.24389) 519 : cluster 0 pgmap v798: 260 pgs: 32 creating+peering, 228 active+clean; 8.4 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-04-19T22:58:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:29 smithi178 bash[23441]: audit 2024-04-19T22:58:28.510538+0000 mon.a (mon.0) 2916 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:58:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:29 smithi178 bash[23441]: cluster 2024-04-19T22:58:28.518131+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-04-19T22:58:30.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[28910]: cluster 2024-04-19T22:58:29.520652+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[28910]: audit 2024-04-19T22:58:29.622081+0000 mon.c (mon.2) 768 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[28910]: audit 2024-04-19T22:58:29.622881+0000 mon.a (mon.0) 2919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[28910]: audit 2024-04-19T22:58:29.624153+0000 mon.c (mon.2) 769 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[28910]: audit 2024-04-19T22:58:29.624804+0000 mon.a (mon.0) 2920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[21528]: cluster 2024-04-19T22:58:29.520652+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[21528]: audit 2024-04-19T22:58:29.622081+0000 mon.c (mon.2) 768 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[21528]: audit 2024-04-19T22:58:29.622881+0000 mon.a (mon.0) 2919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[21528]: audit 2024-04-19T22:58:29.624153+0000 mon.c (mon.2) 769 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:30.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:30 smithi113 bash[21528]: audit 2024-04-19T22:58:29.624804+0000 mon.a (mon.0) 2920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:30.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:30 smithi178 bash[23441]: cluster 2024-04-19T22:58:29.520652+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-04-19T22:58:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:30 smithi178 bash[23441]: audit 2024-04-19T22:58:29.622081+0000 mon.c (mon.2) 768 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:30 smithi178 bash[23441]: audit 2024-04-19T22:58:29.622881+0000 mon.a (mon.0) 2919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:30 smithi178 bash[23441]: audit 2024-04-19T22:58:29.624153+0000 mon.c (mon.2) 769 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:30 smithi178 bash[23441]: audit 2024-04-19T22:58:29.624804+0000 mon.a (mon.0) 2920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-87"}]: dispatch 2024-04-19T22:58:31.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:31 smithi113 bash[28910]: cluster 2024-04-19T22:58:30.078356+0000 mgr.y (mgr.24389) 520 : cluster 0 pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:31.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:31 smithi113 bash[28910]: cluster 2024-04-19T22:58:30.546699+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-04-19T22:58:31.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:31 smithi113 bash[21528]: cluster 2024-04-19T22:58:30.078356+0000 mgr.y (mgr.24389) 520 : cluster 0 pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:31.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:31 smithi113 bash[21528]: cluster 2024-04-19T22:58:30.546699+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-04-19T22:58:31.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:31 smithi178 bash[23441]: cluster 2024-04-19T22:58:30.078356+0000 mgr.y (mgr.24389) 520 : cluster 0 pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-04-19T22:58:31.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:31 smithi178 bash[23441]: cluster 2024-04-19T22:58:30.546699+0000 mon.a (mon.0) 2921 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-04-19T22:58:33.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[28910]: cluster 2024-04-19T22:58:31.558323+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-04-19T22:58:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[28910]: audit 2024-04-19T22:58:31.566351+0000 mon.c (mon.2) 770 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[28910]: audit 2024-04-19T22:58:31.576989+0000 mon.a (mon.0) 2923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[21528]: cluster 2024-04-19T22:58:31.558323+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-04-19T22:58:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[21528]: audit 2024-04-19T22:58:31.566351+0000 mon.c (mon.2) 770 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:32 smithi113 bash[21528]: audit 2024-04-19T22:58:31.576989+0000 mon.a (mon.0) 2923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:32 smithi178 bash[23441]: cluster 2024-04-19T22:58:31.558323+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-04-19T22:58:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:32 smithi178 bash[23441]: audit 2024-04-19T22:58:31.566351+0000 mon.c (mon.2) 770 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:33.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:32 smithi178 bash[23441]: audit 2024-04-19T22:58:31.576989+0000 mon.a (mon.0) 2923 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: cluster 2024-04-19T22:58:32.079190+0000 mgr.y (mgr.24389) 521 : cluster 0 pgmap v804: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: cluster 2024-04-19T22:58:32.550832+0000 mon.a (mon.0) 2924 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: audit 2024-04-19T22:58:32.563116+0000 mon.a (mon.0) 2925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: cluster 2024-04-19T22:58:32.573668+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: audit 2024-04-19T22:58:32.577398+0000 mon.c (mon.2) 771 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: audit 2024-04-19T22:58:32.592175+0000 mon.c (mon.2) 772 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:34.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[28910]: audit 2024-04-19T22:58:32.593613+0000 mon.a (mon.0) 2927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: cluster 2024-04-19T22:58:32.079190+0000 mgr.y (mgr.24389) 521 : cluster 0 pgmap v804: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: cluster 2024-04-19T22:58:32.550832+0000 mon.a (mon.0) 2924 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: audit 2024-04-19T22:58:32.563116+0000 mon.a (mon.0) 2925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: cluster 2024-04-19T22:58:32.573668+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: audit 2024-04-19T22:58:32.577398+0000 mon.c (mon.2) 771 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: audit 2024-04-19T22:58:32.592175+0000 mon.c (mon.2) 772 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:33 smithi113 bash[21528]: audit 2024-04-19T22:58:32.593613+0000 mon.a (mon.0) 2927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:34.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: cluster 2024-04-19T22:58:32.079190+0000 mgr.y (mgr.24389) 521 : cluster 0 pgmap v804: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: cluster 2024-04-19T22:58:32.550832+0000 mon.a (mon.0) 2924 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: audit 2024-04-19T22:58:32.563116+0000 mon.a (mon.0) 2925 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: cluster 2024-04-19T22:58:32.573668+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: audit 2024-04-19T22:58:32.577398+0000 mon.c (mon.2) 771 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: audit 2024-04-19T22:58:32.592175+0000 mon.c (mon.2) 772 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:33 smithi178 bash[23441]: audit 2024-04-19T22:58:32.593613+0000 mon.a (mon.0) 2927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:58:35.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[28910]: audit 2024-04-19T22:58:33.579354+0000 mon.a (mon.0) 2928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[28910]: cluster 2024-04-19T22:58:33.585907+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-04-19T22:58:35.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[28910]: audit 2024-04-19T22:58:34.247494+0000 mon.a (mon.0) 2930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[21528]: audit 2024-04-19T22:58:33.579354+0000 mon.a (mon.0) 2928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[21528]: cluster 2024-04-19T22:58:33.585907+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-04-19T22:58:35.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:34 smithi113 bash[21528]: audit 2024-04-19T22:58:34.247494+0000 mon.a (mon.0) 2930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:35.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:34 smithi178 bash[23441]: audit 2024-04-19T22:58:33.579354+0000 mon.a (mon.0) 2928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:58:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:34 smithi178 bash[23441]: cluster 2024-04-19T22:58:33.585907+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-04-19T22:58:35.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:34 smithi178 bash[23441]: audit 2024-04-19T22:58:34.247494+0000 mon.a (mon.0) 2930 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:35.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:35 smithi113 bash[28910]: cluster 2024-04-19T22:58:34.079988+0000 mgr.y (mgr.24389) 522 : cluster 0 pgmap v807: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:35 smithi113 bash[28910]: cluster 2024-04-19T22:58:34.602228+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-04-19T22:58:36.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:35 smithi113 bash[21528]: cluster 2024-04-19T22:58:34.079988+0000 mgr.y (mgr.24389) 522 : cluster 0 pgmap v807: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:36.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:35 smithi113 bash[21528]: cluster 2024-04-19T22:58:34.602228+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-04-19T22:58:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:35 smithi178 bash[23441]: cluster 2024-04-19T22:58:34.079988+0000 mgr.y (mgr.24389) 522 : cluster 0 pgmap v807: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:35 smithi178 bash[23441]: cluster 2024-04-19T22:58:34.602228+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-04-19T22:58:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: audit 2024-04-19T22:58:35.270035+0000 mgr.y (mgr.24389) 523 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: cluster 2024-04-19T22:58:35.600374+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: audit 2024-04-19T22:58:35.697634+0000 mon.c (mon.2) 773 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: audit 2024-04-19T22:58:35.698332+0000 mon.a (mon.0) 2933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: audit 2024-04-19T22:58:35.699577+0000 mon.c (mon.2) 774 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[28910]: audit 2024-04-19T22:58:35.700233+0000 mon.a (mon.0) 2934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: audit 2024-04-19T22:58:35.270035+0000 mgr.y (mgr.24389) 523 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: cluster 2024-04-19T22:58:35.600374+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: audit 2024-04-19T22:58:35.697634+0000 mon.c (mon.2) 773 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: audit 2024-04-19T22:58:35.698332+0000 mon.a (mon.0) 2933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: audit 2024-04-19T22:58:35.699577+0000 mon.c (mon.2) 774 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:36 smithi113 bash[21528]: audit 2024-04-19T22:58:35.700233+0000 mon.a (mon.0) 2934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: audit 2024-04-19T22:58:35.270035+0000 mgr.y (mgr.24389) 523 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: cluster 2024-04-19T22:58:35.600374+0000 mon.a (mon.0) 2932 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-04-19T22:58:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: audit 2024-04-19T22:58:35.697634+0000 mon.c (mon.2) 773 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: audit 2024-04-19T22:58:35.698332+0000 mon.a (mon.0) 2933 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: audit 2024-04-19T22:58:35.699577+0000 mon.c (mon.2) 774 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:36 smithi178 bash[23441]: audit 2024-04-19T22:58:35.700233+0000 mon.a (mon.0) 2934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-90"}]: dispatch 2024-04-19T22:58:37.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:37 smithi113 bash[21528]: cluster 2024-04-19T22:58:36.080801+0000 mgr.y (mgr.24389) 524 : cluster 0 pgmap v810: 228 pgs: 228 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-04-19T22:58:37.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:37 smithi113 bash[21528]: cluster 2024-04-19T22:58:36.627896+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-04-19T22:58:37.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:37.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:37 smithi113 bash[28910]: cluster 2024-04-19T22:58:36.080801+0000 mgr.y (mgr.24389) 524 : cluster 0 pgmap v810: 228 pgs: 228 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-04-19T22:58:37.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:37 smithi113 bash[28910]: cluster 2024-04-19T22:58:36.627896+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-04-19T22:58:38.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:37 smithi178 bash[23441]: cluster 2024-04-19T22:58:36.080801+0000 mgr.y (mgr.24389) 524 : cluster 0 pgmap v810: 228 pgs: 228 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-04-19T22:58:38.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:37 smithi178 bash[23441]: cluster 2024-04-19T22:58:36.627896+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[21528]: cluster 2024-04-19T22:58:37.638543+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[21528]: audit 2024-04-19T22:58:37.641604+0000 mon.c (mon.2) 775 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[21528]: audit 2024-04-19T22:58:37.654112+0000 mon.a (mon.0) 2937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[28910]: cluster 2024-04-19T22:58:37.638543+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[28910]: audit 2024-04-19T22:58:37.641604+0000 mon.c (mon.2) 775 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:39.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:38 smithi113 bash[28910]: audit 2024-04-19T22:58:37.654112+0000 mon.a (mon.0) 2937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:38 smithi178 bash[23441]: cluster 2024-04-19T22:58:37.638543+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-04-19T22:58:39.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:38 smithi178 bash[23441]: audit 2024-04-19T22:58:37.641604+0000 mon.c (mon.2) 775 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:39.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:38 smithi178 bash[23441]: audit 2024-04-19T22:58:37.654112+0000 mon.a (mon.0) 2937 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[21528]: cluster 2024-04-19T22:58:38.081643+0000 mgr.y (mgr.24389) 525 : cluster 0 pgmap v813: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[21528]: cluster 2024-04-19T22:58:38.630619+0000 mon.a (mon.0) 2938 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[21528]: audit 2024-04-19T22:58:38.641786+0000 mon.a (mon.0) 2939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[21528]: cluster 2024-04-19T22:58:38.654373+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[21528]: audit 2024-04-19T22:58:38.663368+0000 mon.c (mon.2) 776 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[28910]: cluster 2024-04-19T22:58:38.081643+0000 mgr.y (mgr.24389) 525 : cluster 0 pgmap v813: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[28910]: cluster 2024-04-19T22:58:38.630619+0000 mon.a (mon.0) 2938 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[28910]: audit 2024-04-19T22:58:38.641786+0000 mon.a (mon.0) 2939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:40.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[28910]: cluster 2024-04-19T22:58:38.654373+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-04-19T22:58:40.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:39 smithi113 bash[28910]: audit 2024-04-19T22:58:38.663368+0000 mon.c (mon.2) 776 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:39 smithi178 bash[23441]: cluster 2024-04-19T22:58:38.081643+0000 mgr.y (mgr.24389) 525 : cluster 0 pgmap v813: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 596 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:39 smithi178 bash[23441]: cluster 2024-04-19T22:58:38.630619+0000 mon.a (mon.0) 2938 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:39 smithi178 bash[23441]: audit 2024-04-19T22:58:38.641786+0000 mon.a (mon.0) 2939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:39 smithi178 bash[23441]: cluster 2024-04-19T22:58:38.654373+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-04-19T22:58:40.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:39 smithi178 bash[23441]: audit 2024-04-19T22:58:38.663368+0000 mon.c (mon.2) 776 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:41.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:40 smithi113 bash[21528]: cluster 2024-04-19T22:58:39.654012+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-04-19T22:58:41.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:40 smithi113 bash[28910]: cluster 2024-04-19T22:58:39.654012+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-04-19T22:58:41.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:40 smithi178 bash[23441]: cluster 2024-04-19T22:58:39.654012+0000 mon.a (mon.0) 2941 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: cluster 2024-04-19T22:58:40.083978+0000 mgr.y (mgr.24389) 526 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: cluster 2024-04-19T22:58:40.678720+0000 mon.a (mon.0) 2942 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: audit 2024-04-19T22:58:40.773209+0000 mon.c (mon.2) 777 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: audit 2024-04-19T22:58:40.774041+0000 mon.a (mon.0) 2943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: audit 2024-04-19T22:58:40.775425+0000 mon.c (mon.2) 778 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[21528]: audit 2024-04-19T22:58:40.776068+0000 mon.a (mon.0) 2944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: cluster 2024-04-19T22:58:40.083978+0000 mgr.y (mgr.24389) 526 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:42.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: cluster 2024-04-19T22:58:40.678720+0000 mon.a (mon.0) 2942 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-04-19T22:58:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: audit 2024-04-19T22:58:40.773209+0000 mon.c (mon.2) 777 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: audit 2024-04-19T22:58:40.774041+0000 mon.a (mon.0) 2943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: audit 2024-04-19T22:58:40.775425+0000 mon.c (mon.2) 778 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:41 smithi113 bash[28910]: audit 2024-04-19T22:58:40.776068+0000 mon.a (mon.0) 2944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:42.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: cluster 2024-04-19T22:58:40.083978+0000 mgr.y (mgr.24389) 526 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: cluster 2024-04-19T22:58:40.678720+0000 mon.a (mon.0) 2942 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-04-19T22:58:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: audit 2024-04-19T22:58:40.773209+0000 mon.c (mon.2) 777 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: audit 2024-04-19T22:58:40.774041+0000 mon.a (mon.0) 2943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:58:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: audit 2024-04-19T22:58:40.775425+0000 mon.c (mon.2) 778 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:41 smithi178 bash[23441]: audit 2024-04-19T22:58:40.776068+0000 mon.a (mon.0) 2944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-92"}]: dispatch 2024-04-19T22:58:43.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:42 smithi113 bash[28910]: cluster 2024-04-19T22:58:41.679133+0000 mon.a (mon.0) 2945 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-04-19T22:58:43.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:42 smithi113 bash[28910]: cluster 2024-04-19T22:58:42.084720+0000 mgr.y (mgr.24389) 527 : cluster 0 pgmap v819: 196 pgs: 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:43.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:42 smithi113 bash[21528]: cluster 2024-04-19T22:58:41.679133+0000 mon.a (mon.0) 2945 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-04-19T22:58:43.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:42 smithi113 bash[21528]: cluster 2024-04-19T22:58:42.084720+0000 mgr.y (mgr.24389) 527 : cluster 0 pgmap v819: 196 pgs: 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:43.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:42 smithi178 bash[23441]: cluster 2024-04-19T22:58:41.679133+0000 mon.a (mon.0) 2945 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-04-19T22:58:43.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:42 smithi178 bash[23441]: cluster 2024-04-19T22:58:42.084720+0000 mgr.y (mgr.24389) 527 : cluster 0 pgmap v819: 196 pgs: 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T22:58:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[21528]: cluster 2024-04-19T22:58:42.707371+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-04-19T22:58:44.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[21528]: audit 2024-04-19T22:58:42.716354+0000 mon.c (mon.2) 779 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:44.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[21528]: audit 2024-04-19T22:58:42.722156+0000 mon.a (mon.0) 2947 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[28910]: cluster 2024-04-19T22:58:42.707371+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-04-19T22:58:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[28910]: audit 2024-04-19T22:58:42.716354+0000 mon.c (mon.2) 779 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:43 smithi113 bash[28910]: audit 2024-04-19T22:58:42.722156+0000 mon.a (mon.0) 2947 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:43 smithi178 bash[23441]: cluster 2024-04-19T22:58:42.707371+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-04-19T22:58:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:43 smithi178 bash[23441]: audit 2024-04-19T22:58:42.716354+0000 mon.c (mon.2) 779 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:44.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:43 smithi178 bash[23441]: audit 2024-04-19T22:58:42.722156+0000 mon.a (mon.0) 2947 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[21528]: audit 2024-04-19T22:58:43.701045+0000 mon.a (mon.0) 2948 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[21528]: cluster 2024-04-19T22:58:43.711290+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[21528]: audit 2024-04-19T22:58:43.713905+0000 mon.c (mon.2) 780 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[21528]: cluster 2024-04-19T22:58:44.085525+0000 mgr.y (mgr.24389) 528 : cluster 0 pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[28910]: audit 2024-04-19T22:58:43.701045+0000 mon.a (mon.0) 2948 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[28910]: cluster 2024-04-19T22:58:43.711290+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[28910]: audit 2024-04-19T22:58:43.713905+0000 mon.c (mon.2) 780 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:44 smithi113 bash[28910]: cluster 2024-04-19T22:58:44.085525+0000 mgr.y (mgr.24389) 528 : cluster 0 pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:44 smithi178 bash[23441]: audit 2024-04-19T22:58:43.701045+0000 mon.a (mon.0) 2948 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:58:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:44 smithi178 bash[23441]: cluster 2024-04-19T22:58:43.711290+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-04-19T22:58:45.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:44 smithi178 bash[23441]: audit 2024-04-19T22:58:43.713905+0000 mon.c (mon.2) 780 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:58:45.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:44 smithi178 bash[23441]: cluster 2024-04-19T22:58:44.085525+0000 mgr.y (mgr.24389) 528 : cluster 0 pgmap v822: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:58:45.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:45 smithi113 bash[21528]: cluster 2024-04-19T22:58:44.740221+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-04-19T22:58:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:45 smithi113 bash[21528]: audit 2024-04-19T22:58:45.281440+0000 mgr.y (mgr.24389) 529 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:45 smithi113 bash[28910]: cluster 2024-04-19T22:58:44.740221+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-04-19T22:58:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:45 smithi113 bash[28910]: audit 2024-04-19T22:58:45.281440+0000 mgr.y (mgr.24389) 529 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:45 smithi178 bash[23441]: cluster 2024-04-19T22:58:44.740221+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-04-19T22:58:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:45 smithi178 bash[23441]: audit 2024-04-19T22:58:45.281440+0000 mgr.y (mgr.24389) 529 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[28910]: cluster 2024-04-19T22:58:45.765089+0000 mon.a (mon.0) 2951 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-04-19T22:58:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[28910]: cluster 2024-04-19T22:58:46.017426+0000 mon.a (mon.0) 2952 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[28910]: cluster 2024-04-19T22:58:46.086130+0000 mgr.y (mgr.24389) 530 : cluster 0 pgmap v825: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-04-19T22:58:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[21528]: cluster 2024-04-19T22:58:45.765089+0000 mon.a (mon.0) 2951 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-04-19T22:58:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[21528]: cluster 2024-04-19T22:58:46.017426+0000 mon.a (mon.0) 2952 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:47.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:46 smithi113 bash[21528]: cluster 2024-04-19T22:58:46.086130+0000 mgr.y (mgr.24389) 530 : cluster 0 pgmap v825: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-04-19T22:58:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:46 smithi178 bash[23441]: cluster 2024-04-19T22:58:45.765089+0000 mon.a (mon.0) 2951 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-04-19T22:58:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:46 smithi178 bash[23441]: cluster 2024-04-19T22:58:46.017426+0000 mon.a (mon.0) 2952 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:58:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:46 smithi178 bash[23441]: cluster 2024-04-19T22:58:46.086130+0000 mgr.y (mgr.24389) 530 : cluster 0 pgmap v825: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-04-19T22:58:47.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:49.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:49 smithi113 bash[28910]: cluster 2024-04-19T22:58:48.087097+0000 mgr.y (mgr.24389) 531 : cluster 0 pgmap v826: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:58:49.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:49 smithi113 bash[21528]: cluster 2024-04-19T22:58:48.087097+0000 mgr.y (mgr.24389) 531 : cluster 0 pgmap v826: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:58:49.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:49 smithi178 bash[23441]: cluster 2024-04-19T22:58:48.087097+0000 mgr.y (mgr.24389) 531 : cluster 0 pgmap v826: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-04-19T22:58:50.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:50 smithi113 bash[28910]: audit 2024-04-19T22:58:49.282537+0000 mon.a (mon.0) 2953 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:50.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:50 smithi113 bash[21528]: audit 2024-04-19T22:58:49.282537+0000 mon.a (mon.0) 2953 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:50.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:50 smithi178 bash[23441]: audit 2024-04-19T22:58:49.282537+0000 mon.a (mon.0) 2953 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:58:51.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:51 smithi113 bash[28910]: cluster 2024-04-19T22:58:50.089295+0000 mgr.y (mgr.24389) 532 : cluster 0 pgmap v827: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-19T22:58:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:51 smithi113 bash[21528]: cluster 2024-04-19T22:58:50.089295+0000 mgr.y (mgr.24389) 532 : cluster 0 pgmap v827: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-19T22:58:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:51 smithi178 bash[23441]: cluster 2024-04-19T22:58:50.089295+0000 mgr.y (mgr.24389) 532 : cluster 0 pgmap v827: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-19T22:58:53.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:53 smithi113 bash[28910]: cluster 2024-04-19T22:58:52.090112+0000 mgr.y (mgr.24389) 533 : cluster 0 pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:58:53.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:53 smithi113 bash[21528]: cluster 2024-04-19T22:58:52.090112+0000 mgr.y (mgr.24389) 533 : cluster 0 pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:58:53.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:53 smithi178 bash[23441]: cluster 2024-04-19T22:58:52.090112+0000 mgr.y (mgr.24389) 533 : cluster 0 pgmap v828: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-19T22:58:55.547 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:55 smithi113 bash[28910]: cluster 2024-04-19T22:58:54.090930+0000 mgr.y (mgr.24389) 534 : cluster 0 pgmap v829: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 984 B/s wr, 4 op/s 2024-04-19T22:58:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:55 smithi113 bash[21528]: cluster 2024-04-19T22:58:54.090930+0000 mgr.y (mgr.24389) 534 : cluster 0 pgmap v829: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 984 B/s wr, 4 op/s 2024-04-19T22:58:55.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:58:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:58:55.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:55 smithi178 bash[23441]: cluster 2024-04-19T22:58:54.090930+0000 mgr.y (mgr.24389) 534 : cluster 0 pgmap v829: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 984 B/s wr, 4 op/s 2024-04-19T22:58:56.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:56 smithi113 bash[21528]: audit 2024-04-19T22:58:55.292331+0000 mgr.y (mgr.24389) 535 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:56.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:56 smithi113 bash[28910]: audit 2024-04-19T22:58:55.292331+0000 mgr.y (mgr.24389) 535 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:56.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:56 smithi178 bash[23441]: audit 2024-04-19T22:58:55.292331+0000 mgr.y (mgr.24389) 535 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:58:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:57 smithi113 bash[28910]: cluster 2024-04-19T22:58:56.093095+0000 mgr.y (mgr.24389) 536 : cluster 0 pgmap v830: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 99 B/s wr, 2 op/s 2024-04-19T22:58:57.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:57 smithi113 bash[28910]: cluster 2024-04-19T22:58:56.179586+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-04-19T22:58:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:57 smithi113 bash[21528]: cluster 2024-04-19T22:58:56.093095+0000 mgr.y (mgr.24389) 536 : cluster 0 pgmap v830: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 99 B/s wr, 2 op/s 2024-04-19T22:58:57.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:57 smithi113 bash[21528]: cluster 2024-04-19T22:58:56.179586+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-04-19T22:58:57.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:57 smithi178 bash[23441]: cluster 2024-04-19T22:58:56.093095+0000 mgr.y (mgr.24389) 536 : cluster 0 pgmap v830: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 99 B/s wr, 2 op/s 2024-04-19T22:58:57.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:57 smithi178 bash[23441]: cluster 2024-04-19T22:58:56.179586+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-04-19T22:58:57.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:58:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:58:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:58:59.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:58:59 smithi113 bash[28910]: cluster 2024-04-19T22:58:58.093939+0000 mgr.y (mgr.24389) 537 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-04-19T22:58:59.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:58:59 smithi113 bash[21528]: cluster 2024-04-19T22:58:58.093939+0000 mgr.y (mgr.24389) 537 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-04-19T22:58:59.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:58:59 smithi178 bash[23441]: cluster 2024-04-19T22:58:58.093939+0000 mgr.y (mgr.24389) 537 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[28910]: cluster 2024-04-19T22:59:00.096047+0000 mgr.y (mgr.24389) 538 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[28910]: audit 2024-04-19T22:59:00.949131+0000 mon.a (mon.0) 2955 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[28910]: cluster 2024-04-19T22:59:01.037436+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[21528]: cluster 2024-04-19T22:59:00.096047+0000 mgr.y (mgr.24389) 538 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[21528]: audit 2024-04-19T22:59:00.949131+0000 mon.a (mon.0) 2955 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:59:01.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:01 smithi113 bash[21528]: cluster 2024-04-19T22:59:01.037436+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-04-19T22:59:01.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:01 smithi178 bash[23441]: cluster 2024-04-19T22:59:00.096047+0000 mgr.y (mgr.24389) 538 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:01.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:01 smithi178 bash[23441]: audit 2024-04-19T22:59:00.949131+0000 mon.a (mon.0) 2955 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T22:59:01.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:01 smithi178 bash[23441]: cluster 2024-04-19T22:59:01.037436+0000 mon.a (mon.0) 2956 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[21528]: audit 2024-04-19T22:59:01.682728+0000 mon.a (mon.0) 2957 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[21528]: audit 2024-04-19T22:59:01.684492+0000 mon.a (mon.0) 2958 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[21528]: audit 2024-04-19T22:59:01.692499+0000 mon.a (mon.0) 2959 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[28910]: audit 2024-04-19T22:59:01.682728+0000 mon.a (mon.0) 2957 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[28910]: audit 2024-04-19T22:59:01.684492+0000 mon.a (mon.0) 2958 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:59:02.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:02 smithi113 bash[28910]: audit 2024-04-19T22:59:01.692499+0000 mon.a (mon.0) 2959 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:59:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:02 smithi178 bash[23441]: audit 2024-04-19T22:59:01.682728+0000 mon.a (mon.0) 2957 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T22:59:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:02 smithi178 bash[23441]: audit 2024-04-19T22:59:01.684492+0000 mon.a (mon.0) 2958 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T22:59:02.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:02 smithi178 bash[23441]: audit 2024-04-19T22:59:01.692499+0000 mon.a (mon.0) 2959 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T22:59:03.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:03 smithi113 bash[21528]: cluster 2024-04-19T22:59:02.096897+0000 mgr.y (mgr.24389) 539 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:03.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:03 smithi113 bash[28910]: cluster 2024-04-19T22:59:02.096897+0000 mgr.y (mgr.24389) 539 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:03.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:03 smithi178 bash[23441]: cluster 2024-04-19T22:59:02.096897+0000 mgr.y (mgr.24389) 539 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:04.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:04 smithi113 bash[28910]: audit 2024-04-19T22:59:04.043275+0000 mon.a (mon.0) 2960 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]: dispatch 2024-04-19T22:59:04.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:04 smithi113 bash[21528]: audit 2024-04-19T22:59:04.043275+0000 mon.a (mon.0) 2960 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]: dispatch 2024-04-19T22:59:04.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:04 smithi178 bash[23441]: audit 2024-04-19T22:59:04.043275+0000 mon.a (mon.0) 2960 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]: dispatch 2024-04-19T22:59:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[21528]: cluster 2024-04-19T22:59:04.097817+0000 mgr.y (mgr.24389) 540 : cluster 0 pgmap v836: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[21528]: audit 2024-04-19T22:59:04.195310+0000 mon.a (mon.0) 2961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]': finished 2024-04-19T22:59:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[21528]: cluster 2024-04-19T22:59:04.202297+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-04-19T22:59:05.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[21528]: audit 2024-04-19T22:59:04.328851+0000 mon.a (mon.0) 2963 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:05.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[28910]: cluster 2024-04-19T22:59:04.097817+0000 mgr.y (mgr.24389) 540 : cluster 0 pgmap v836: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:05.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[28910]: audit 2024-04-19T22:59:04.195310+0000 mon.a (mon.0) 2961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]': finished 2024-04-19T22:59:05.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[28910]: cluster 2024-04-19T22:59:04.202297+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-04-19T22:59:05.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:05 smithi113 bash[28910]: audit 2024-04-19T22:59:04.328851+0000 mon.a (mon.0) 2963 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:05.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:05 smithi178 bash[23441]: cluster 2024-04-19T22:59:04.097817+0000 mgr.y (mgr.24389) 540 : cluster 0 pgmap v836: 228 pgs: 228 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:05 smithi178 bash[23441]: audit 2024-04-19T22:59:04.195310+0000 mon.a (mon.0) 2961 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "313.7", "id": [0, 1]}]': finished 2024-04-19T22:59:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:05 smithi178 bash[23441]: cluster 2024-04-19T22:59:04.202297+0000 mon.a (mon.0) 2962 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-04-19T22:59:05.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:05 smithi178 bash[23441]: audit 2024-04-19T22:59:04.328851+0000 mon.a (mon.0) 2963 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:06.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:06 smithi113 bash[21528]: cluster 2024-04-19T22:59:05.206365+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-04-19T22:59:06.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:06 smithi113 bash[21528]: audit 2024-04-19T22:59:05.303613+0000 mgr.y (mgr.24389) 541 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:06 smithi113 bash[28910]: cluster 2024-04-19T22:59:05.206365+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-04-19T22:59:06.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:06 smithi113 bash[28910]: audit 2024-04-19T22:59:05.303613+0000 mgr.y (mgr.24389) 541 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:06.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:06 smithi178 bash[23441]: cluster 2024-04-19T22:59:05.206365+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-04-19T22:59:06.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:06 smithi178 bash[23441]: audit 2024-04-19T22:59:05.303613+0000 mgr.y (mgr.24389) 541 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[28910]: cluster 2024-04-19T22:59:06.098676+0000 mgr.y (mgr.24389) 542 : cluster 0 pgmap v839: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[28910]: audit 2024-04-19T22:59:06.232490+0000 mon.c (mon.2) 781 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[28910]: audit 2024-04-19T22:59:06.233144+0000 mon.a (mon.0) 2965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[28910]: audit 2024-04-19T22:59:06.234485+0000 mon.c (mon.2) 782 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[28910]: audit 2024-04-19T22:59:06.235297+0000 mon.a (mon.0) 2966 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21528]: cluster 2024-04-19T22:59:06.098676+0000 mgr.y (mgr.24389) 542 : cluster 0 pgmap v839: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21528]: audit 2024-04-19T22:59:06.232490+0000 mon.c (mon.2) 781 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.478 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21528]: audit 2024-04-19T22:59:06.233144+0000 mon.a (mon.0) 2965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21528]: audit 2024-04-19T22:59:06.234485+0000 mon.c (mon.2) 782 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.479 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21528]: audit 2024-04-19T22:59:06.235297+0000 mon.a (mon.0) 2966 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:07 smithi178 bash[23441]: cluster 2024-04-19T22:59:06.098676+0000 mgr.y (mgr.24389) 542 : cluster 0 pgmap v839: 228 pgs: 1 peering, 227 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:07 smithi178 bash[23441]: audit 2024-04-19T22:59:06.232490+0000 mon.c (mon.2) 781 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:07 smithi178 bash[23441]: audit 2024-04-19T22:59:06.233144+0000 mon.a (mon.0) 2965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:07 smithi178 bash[23441]: audit 2024-04-19T22:59:06.234485+0000 mon.c (mon.2) 782 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:07 smithi178 bash[23441]: audit 2024-04-19T22:59:06.235297+0000 mon.a (mon.0) 2966 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-94"}]: dispatch 2024-04-19T22:59:07.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:08.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:08 smithi113 bash[28910]: cluster 2024-04-19T22:59:07.244926+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-04-19T22:59:08.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:08 smithi113 bash[21528]: cluster 2024-04-19T22:59:07.244926+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-04-19T22:59:08.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:08 smithi178 bash[23441]: cluster 2024-04-19T22:59:07.244926+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-04-19T22:59:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[28910]: cluster 2024-04-19T22:59:08.099429+0000 mgr.y (mgr.24389) 543 : cluster 0 pgmap v841: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[28910]: cluster 2024-04-19T22:59:08.254196+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-04-19T22:59:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[28910]: audit 2024-04-19T22:59:08.258539+0000 mon.c (mon.2) 783 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[28910]: audit 2024-04-19T22:59:08.260284+0000 mon.a (mon.0) 2969 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:09.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[21528]: cluster 2024-04-19T22:59:08.099429+0000 mgr.y (mgr.24389) 543 : cluster 0 pgmap v841: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:09.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[21528]: cluster 2024-04-19T22:59:08.254196+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-04-19T22:59:09.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[21528]: audit 2024-04-19T22:59:08.258539+0000 mon.c (mon.2) 783 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:09.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:09 smithi113 bash[21528]: audit 2024-04-19T22:59:08.260284+0000 mon.a (mon.0) 2969 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:09 smithi178 bash[23441]: cluster 2024-04-19T22:59:08.099429+0000 mgr.y (mgr.24389) 543 : cluster 0 pgmap v841: 196 pgs: 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:09 smithi178 bash[23441]: cluster 2024-04-19T22:59:08.254196+0000 mon.a (mon.0) 2968 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-04-19T22:59:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:09 smithi178 bash[23441]: audit 2024-04-19T22:59:08.258539+0000 mon.c (mon.2) 783 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:09.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:09 smithi178 bash[23441]: audit 2024-04-19T22:59:08.260284+0000 mon.a (mon.0) 2969 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:10.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[28910]: audit 2024-04-19T22:59:09.257571+0000 mon.a (mon.0) 2970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:10.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[28910]: cluster 2024-04-19T22:59:09.265929+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-04-19T22:59:10.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[28910]: audit 2024-04-19T22:59:09.269464+0000 mon.c (mon.2) 784 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:10.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[21528]: audit 2024-04-19T22:59:09.257571+0000 mon.a (mon.0) 2970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:10.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[21528]: cluster 2024-04-19T22:59:09.265929+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-04-19T22:59:10.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:10 smithi113 bash[21528]: audit 2024-04-19T22:59:09.269464+0000 mon.c (mon.2) 784 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:10.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:10 smithi178 bash[23441]: audit 2024-04-19T22:59:09.257571+0000 mon.a (mon.0) 2970 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:10 smithi178 bash[23441]: cluster 2024-04-19T22:59:09.265929+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-04-19T22:59:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:10 smithi178 bash[23441]: audit 2024-04-19T22:59:09.269464+0000 mon.c (mon.2) 784 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:11.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:11 smithi113 bash[28910]: cluster 2024-04-19T22:59:10.101560+0000 mgr.y (mgr.24389) 544 : cluster 0 pgmap v844: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:11.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:11 smithi113 bash[28910]: cluster 2024-04-19T22:59:10.277729+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-04-19T22:59:11.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:11 smithi113 bash[21528]: cluster 2024-04-19T22:59:10.101560+0000 mgr.y (mgr.24389) 544 : cluster 0 pgmap v844: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:11.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:11 smithi113 bash[21528]: cluster 2024-04-19T22:59:10.277729+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-04-19T22:59:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:11 smithi178 bash[23441]: cluster 2024-04-19T22:59:10.101560+0000 mgr.y (mgr.24389) 544 : cluster 0 pgmap v844: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:11.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:11 smithi178 bash[23441]: cluster 2024-04-19T22:59:10.277729+0000 mon.a (mon.0) 2972 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-04-19T22:59:13.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:13 smithi113 bash[21528]: cluster 2024-04-19T22:59:12.102539+0000 mgr.y (mgr.24389) 545 : cluster 0 pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-19T22:59:13.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:13 smithi113 bash[28910]: cluster 2024-04-19T22:59:12.102539+0000 mgr.y (mgr.24389) 545 : cluster 0 pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-19T22:59:13.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:13 smithi178 bash[23441]: cluster 2024-04-19T22:59:12.102539+0000 mgr.y (mgr.24389) 545 : cluster 0 pgmap v846: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-04-19T22:59:15.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:15 smithi113 bash[28910]: cluster 2024-04-19T22:59:14.103362+0000 mgr.y (mgr.24389) 546 : cluster 0 pgmap v847: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 1 op/s 2024-04-19T22:59:15.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:15 smithi113 bash[21528]: cluster 2024-04-19T22:59:14.103362+0000 mgr.y (mgr.24389) 546 : cluster 0 pgmap v847: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 1 op/s 2024-04-19T22:59:15.554 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:15.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:15 smithi178 bash[23441]: cluster 2024-04-19T22:59:14.103362+0000 mgr.y (mgr.24389) 546 : cluster 0 pgmap v847: 228 pgs: 228 active+clean; 8.4 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 1 op/s 2024-04-19T22:59:16.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:16 smithi113 bash[21528]: audit 2024-04-19T22:59:15.305699+0000 mgr.y (mgr.24389) 547 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:16.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:16 smithi113 bash[28910]: audit 2024-04-19T22:59:15.305699+0000 mgr.y (mgr.24389) 547 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:16.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:16 smithi178 bash[23441]: audit 2024-04-19T22:59:15.305699+0000 mgr.y (mgr.24389) 547 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:17.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:17 smithi113 bash[28910]: cluster 2024-04-19T22:59:16.105584+0000 mgr.y (mgr.24389) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 781 B/s wr, 2 op/s 2024-04-19T22:59:17.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:17 smithi113 bash[21528]: cluster 2024-04-19T22:59:16.105584+0000 mgr.y (mgr.24389) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 781 B/s wr, 2 op/s 2024-04-19T22:59:17.548 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:17.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:17 smithi178 bash[23441]: cluster 2024-04-19T22:59:16.105584+0000 mgr.y (mgr.24389) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 781 B/s wr, 2 op/s 2024-04-19T22:59:19.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:19 smithi113 bash[28910]: cluster 2024-04-19T22:59:18.106376+0000 mgr.y (mgr.24389) 549 : cluster 0 pgmap v849: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 694 B/s wr, 2 op/s 2024-04-19T22:59:19.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:19 smithi113 bash[21528]: cluster 2024-04-19T22:59:18.106376+0000 mgr.y (mgr.24389) 549 : cluster 0 pgmap v849: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 694 B/s wr, 2 op/s 2024-04-19T22:59:19.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:19 smithi178 bash[23441]: cluster 2024-04-19T22:59:18.106376+0000 mgr.y (mgr.24389) 549 : cluster 0 pgmap v849: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 694 B/s wr, 2 op/s 2024-04-19T22:59:20.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:20 smithi178 bash[23441]: audit 2024-04-19T22:59:19.378890+0000 mon.a (mon.0) 2973 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:20.555 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 22:59:20 smithi178 bash[43677]: debug 2024-04-19T22:59:20.317+0000 7ff0d930d700 -1 snap_mapper.add_oid found existing snaps mapped on 122:470f6891:test-rados-api-smithi113-63998-97::foo:21, removing 2024-04-19T22:59:20.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:20 smithi113 bash[28910]: audit 2024-04-19T22:59:19.378890+0000 mon.a (mon.0) 2973 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:20.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:20 smithi113 bash[21528]: audit 2024-04-19T22:59:19.378890+0000 mon.a (mon.0) 2973 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:20.799 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 22:59:20 smithi113 bash[37270]: debug 2024-04-19T22:59:20.322+0000 7ffb643cc700 -1 snap_mapper.add_oid found existing snaps mapped on 122:470f6891:test-rados-api-smithi113-63998-97::foo:21, removing 2024-04-19T22:59:20.799 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 22:59:20 smithi113 bash[48401]: debug 2024-04-19T22:59:20.322+0000 7fb4ff65b700 -1 snap_mapper.add_oid found existing snaps mapped on 122:470f6891:test-rados-api-smithi113-63998-97::foo:21, removing 2024-04-19T22:59:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[21528]: cluster 2024-04-19T22:59:20.108442+0000 mgr.y (mgr.24389) 550 : cluster 0 pgmap v850: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-04-19T22:59:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[21528]: audit 2024-04-19T22:59:20.360515+0000 mon.c (mon.2) 785 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[21528]: audit 2024-04-19T22:59:20.361285+0000 mon.a (mon.0) 2974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[21528]: audit 2024-04-19T22:59:20.362692+0000 mon.c (mon.2) 786 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[21528]: audit 2024-04-19T22:59:20.363396+0000 mon.a (mon.0) 2975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[28910]: cluster 2024-04-19T22:59:20.108442+0000 mgr.y (mgr.24389) 550 : cluster 0 pgmap v850: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[28910]: audit 2024-04-19T22:59:20.360515+0000 mon.c (mon.2) 785 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[28910]: audit 2024-04-19T22:59:20.361285+0000 mon.a (mon.0) 2974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[28910]: audit 2024-04-19T22:59:20.362692+0000 mon.c (mon.2) 786 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:21 smithi113 bash[28910]: audit 2024-04-19T22:59:20.363396+0000 mon.a (mon.0) 2975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:21 smithi178 bash[23441]: cluster 2024-04-19T22:59:20.108442+0000 mgr.y (mgr.24389) 550 : cluster 0 pgmap v850: 228 pgs: 228 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-04-19T22:59:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:21 smithi178 bash[23441]: audit 2024-04-19T22:59:20.360515+0000 mon.c (mon.2) 785 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:21 smithi178 bash[23441]: audit 2024-04-19T22:59:20.361285+0000 mon.a (mon.0) 2974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:21 smithi178 bash[23441]: audit 2024-04-19T22:59:20.362692+0000 mon.c (mon.2) 786 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:21 smithi178 bash[23441]: audit 2024-04-19T22:59:20.363396+0000 mon.a (mon.0) 2975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-96"}]: dispatch 2024-04-19T22:59:22.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:22 smithi113 bash[21528]: cluster 2024-04-19T22:59:21.310071+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-04-19T22:59:22.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:22 smithi113 bash[28910]: cluster 2024-04-19T22:59:21.310071+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-04-19T22:59:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:22 smithi178 bash[23441]: cluster 2024-04-19T22:59:21.310071+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-04-19T22:59:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[28910]: cluster 2024-04-19T22:59:22.109208+0000 mgr.y (mgr.24389) 551 : cluster 0 pgmap v852: 196 pgs: 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:59:23.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[28910]: cluster 2024-04-19T22:59:22.343316+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[28910]: audit 2024-04-19T22:59:22.358920+0000 mon.c (mon.2) 787 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[28910]: audit 2024-04-19T22:59:22.361849+0000 mon.a (mon.0) 2978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[21528]: cluster 2024-04-19T22:59:22.109208+0000 mgr.y (mgr.24389) 551 : cluster 0 pgmap v852: 196 pgs: 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[21528]: cluster 2024-04-19T22:59:22.343316+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[21528]: audit 2024-04-19T22:59:22.358920+0000 mon.c (mon.2) 787 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:23 smithi113 bash[21528]: audit 2024-04-19T22:59:22.361849+0000 mon.a (mon.0) 2978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:23 smithi178 bash[23441]: cluster 2024-04-19T22:59:22.109208+0000 mgr.y (mgr.24389) 551 : cluster 0 pgmap v852: 196 pgs: 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T22:59:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:23 smithi178 bash[23441]: cluster 2024-04-19T22:59:22.343316+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-04-19T22:59:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:23 smithi178 bash[23441]: audit 2024-04-19T22:59:22.358920+0000 mon.c (mon.2) 787 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:23 smithi178 bash[23441]: audit 2024-04-19T22:59:22.361849+0000 mon.a (mon.0) 2978 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:24.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[28910]: audit 2024-04-19T22:59:23.336606+0000 mon.a (mon.0) 2979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[28910]: cluster 2024-04-19T22:59:23.344849+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[28910]: audit 2024-04-19T22:59:23.387521+0000 mon.c (mon.2) 788 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[28910]: audit 2024-04-19T22:59:23.389639+0000 mon.a (mon.0) 2981 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[21528]: audit 2024-04-19T22:59:23.336606+0000 mon.a (mon.0) 2979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[21528]: cluster 2024-04-19T22:59:23.344849+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[21528]: audit 2024-04-19T22:59:23.387521+0000 mon.c (mon.2) 788 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:24.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:24 smithi113 bash[21528]: audit 2024-04-19T22:59:23.389639+0000 mon.a (mon.0) 2981 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:24.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:24 smithi178 bash[23441]: audit 2024-04-19T22:59:23.336606+0000 mon.a (mon.0) 2979 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:24.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:24 smithi178 bash[23441]: cluster 2024-04-19T22:59:23.344849+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-04-19T22:59:24.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:24 smithi178 bash[23441]: audit 2024-04-19T22:59:23.387521+0000 mon.c (mon.2) 788 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:24.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:24 smithi178 bash[23441]: audit 2024-04-19T22:59:23.389639+0000 mon.a (mon.0) 2981 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[21528]: cluster 2024-04-19T22:59:24.110120+0000 mgr.y (mgr.24389) 552 : cluster 0 pgmap v855: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[21528]: audit 2024-04-19T22:59:24.351054+0000 mon.a (mon.0) 2982 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[21528]: cluster 2024-04-19T22:59:24.358068+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[21528]: audit 2024-04-19T22:59:24.361082+0000 mon.c (mon.2) 789 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[21528]: audit 2024-04-19T22:59:24.372672+0000 mon.a (mon.0) 2984 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[28910]: cluster 2024-04-19T22:59:24.110120+0000 mgr.y (mgr.24389) 552 : cluster 0 pgmap v855: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[28910]: audit 2024-04-19T22:59:24.351054+0000 mon.a (mon.0) 2982 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[28910]: cluster 2024-04-19T22:59:24.358068+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[28910]: audit 2024-04-19T22:59:24.361082+0000 mon.c (mon.2) 789 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:25.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:25 smithi113 bash[28910]: audit 2024-04-19T22:59:24.372672+0000 mon.a (mon.0) 2984 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:25.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[23441]: cluster 2024-04-19T22:59:24.110120+0000 mgr.y (mgr.24389) 552 : cluster 0 pgmap v855: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T22:59:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[23441]: audit 2024-04-19T22:59:24.351054+0000 mon.a (mon.0) 2982 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[23441]: cluster 2024-04-19T22:59:24.358068+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-04-19T22:59:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[23441]: audit 2024-04-19T22:59:24.361082+0000 mon.c (mon.2) 789 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:25.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:25 smithi178 bash[23441]: audit 2024-04-19T22:59:24.372672+0000 mon.a (mon.0) 2984 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]: dispatch 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: audit 2024-04-19T22:59:25.315566+0000 mgr.y (mgr.24389) 553 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: cluster 2024-04-19T22:59:25.362118+0000 mon.a (mon.0) 2985 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: audit 2024-04-19T22:59:25.364554+0000 mon.a (mon.0) 2986 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]': finished 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: cluster 2024-04-19T22:59:25.374776+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: audit 2024-04-19T22:59:25.375382+0000 mon.c (mon.2) 790 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: audit 2024-04-19T22:59:25.377483+0000 mon.a (mon.0) 2988 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: audit 2024-04-19T22:59:26.367310+0000 mon.a (mon.0) 2989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[21528]: cluster 2024-04-19T22:59:26.374106+0000 mon.a (mon.0) 2990 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-04-19T22:59:26.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: audit 2024-04-19T22:59:25.315566+0000 mgr.y (mgr.24389) 553 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: cluster 2024-04-19T22:59:25.362118+0000 mon.a (mon.0) 2985 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: audit 2024-04-19T22:59:25.364554+0000 mon.a (mon.0) 2986 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]': finished 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: cluster 2024-04-19T22:59:25.374776+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: audit 2024-04-19T22:59:25.375382+0000 mon.c (mon.2) 790 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: audit 2024-04-19T22:59:25.377483+0000 mon.a (mon.0) 2988 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: audit 2024-04-19T22:59:26.367310+0000 mon.a (mon.0) 2989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:26 smithi113 bash[28910]: cluster 2024-04-19T22:59:26.374106+0000 mon.a (mon.0) 2990 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: audit 2024-04-19T22:59:25.315566+0000 mgr.y (mgr.24389) 553 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: cluster 2024-04-19T22:59:25.362118+0000 mon.a (mon.0) 2985 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: audit 2024-04-19T22:59:25.364554+0000 mon.a (mon.0) 2986 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-98", "mode": "writeback"}]': finished 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: cluster 2024-04-19T22:59:25.374776+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: audit 2024-04-19T22:59:25.375382+0000 mon.c (mon.2) 790 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: audit 2024-04-19T22:59:25.377483+0000 mon.a (mon.0) 2988 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: audit 2024-04-19T22:59:26.367310+0000 mon.a (mon.0) 2989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:26 smithi178 bash[23441]: cluster 2024-04-19T22:59:26.374106+0000 mon.a (mon.0) 2990 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-04-19T22:59:27.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: cluster 2024-04-19T22:59:26.111050+0000 mgr.y (mgr.24389) 554 : cluster 0 pgmap v858: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: audit 2024-04-19T22:59:26.378465+0000 mon.c (mon.2) 791 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: audit 2024-04-19T22:59:26.379680+0000 mon.a (mon.0) 2991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: cluster 2024-04-19T22:59:27.367616+0000 mon.a (mon.0) 2992 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: audit 2024-04-19T22:59:27.369900+0000 mon.a (mon.0) 2993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: cluster 2024-04-19T22:59:27.379126+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: audit 2024-04-19T22:59:27.383169+0000 mon.c (mon.2) 792 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[28910]: audit 2024-04-19T22:59:27.384264+0000 mon.a (mon.0) 2995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: cluster 2024-04-19T22:59:26.111050+0000 mgr.y (mgr.24389) 554 : cluster 0 pgmap v858: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:27.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: audit 2024-04-19T22:59:26.378465+0000 mon.c (mon.2) 791 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: audit 2024-04-19T22:59:26.379680+0000 mon.a (mon.0) 2991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: cluster 2024-04-19T22:59:27.367616+0000 mon.a (mon.0) 2992 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: audit 2024-04-19T22:59:27.369900+0000 mon.a (mon.0) 2993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: cluster 2024-04-19T22:59:27.379126+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: audit 2024-04-19T22:59:27.383169+0000 mon.c (mon.2) 792 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:27 smithi113 bash[21528]: audit 2024-04-19T22:59:27.384264+0000 mon.a (mon.0) 2995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: cluster 2024-04-19T22:59:26.111050+0000 mgr.y (mgr.24389) 554 : cluster 0 pgmap v858: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: audit 2024-04-19T22:59:26.378465+0000 mon.c (mon.2) 791 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: audit 2024-04-19T22:59:26.379680+0000 mon.a (mon.0) 2991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: cluster 2024-04-19T22:59:27.367616+0000 mon.a (mon.0) 2992 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: audit 2024-04-19T22:59:27.369900+0000 mon.a (mon.0) 2993 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: cluster 2024-04-19T22:59:27.379126+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: audit 2024-04-19T22:59:27.383169+0000 mon.c (mon.2) 792 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:27 smithi178 bash[23441]: audit 2024-04-19T22:59:27.384264+0000 mon.a (mon.0) 2995 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]: dispatch 2024-04-19T22:59:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[28910]: cluster 2024-04-19T22:59:28.111896+0000 mgr.y (mgr.24389) 555 : cluster 0 pgmap v861: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[28910]: audit 2024-04-19T22:59:28.372458+0000 mon.a (mon.0) 2996 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]': finished 2024-04-19T22:59:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[28910]: cluster 2024-04-19T22:59:28.379823+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-04-19T22:59:29.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[28910]: audit 2024-04-19T22:59:28.381812+0000 mon.c (mon.2) 793 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[28910]: audit 2024-04-19T22:59:28.382798+0000 mon.a (mon.0) 2998 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[21528]: cluster 2024-04-19T22:59:28.111896+0000 mgr.y (mgr.24389) 555 : cluster 0 pgmap v861: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[21528]: audit 2024-04-19T22:59:28.372458+0000 mon.a (mon.0) 2996 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]': finished 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[21528]: cluster 2024-04-19T22:59:28.379823+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[21528]: audit 2024-04-19T22:59:28.381812+0000 mon.c (mon.2) 793 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:29.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:29 smithi113 bash[21528]: audit 2024-04-19T22:59:28.382798+0000 mon.a (mon.0) 2998 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:29 smithi178 bash[23441]: cluster 2024-04-19T22:59:28.111896+0000 mgr.y (mgr.24389) 555 : cluster 0 pgmap v861: 228 pgs: 228 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T22:59:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:29 smithi178 bash[23441]: audit 2024-04-19T22:59:28.372458+0000 mon.a (mon.0) 2996 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_count","val": "1"}]': finished 2024-04-19T22:59:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:29 smithi178 bash[23441]: cluster 2024-04-19T22:59:28.379823+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-04-19T22:59:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:29 smithi178 bash[23441]: audit 2024-04-19T22:59:28.381812+0000 mon.c (mon.2) 793 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:29.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:29 smithi178 bash[23441]: audit 2024-04-19T22:59:28.382798+0000 mon.a (mon.0) 2998 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[28910]: audit 2024-04-19T22:59:29.375017+0000 mon.a (mon.0) 2999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[28910]: cluster 2024-04-19T22:59:29.382479+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-04-19T22:59:30.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[28910]: audit 2024-04-19T22:59:29.384943+0000 mon.c (mon.2) 794 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:30.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[28910]: audit 2024-04-19T22:59:29.397849+0000 mon.a (mon.0) 3001 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:30.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[21528]: audit 2024-04-19T22:59:29.375017+0000 mon.a (mon.0) 2999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:30.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[21528]: cluster 2024-04-19T22:59:29.382479+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-04-19T22:59:30.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[21528]: audit 2024-04-19T22:59:29.384943+0000 mon.c (mon.2) 794 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:30.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:30 smithi113 bash[21528]: audit 2024-04-19T22:59:29.397849+0000 mon.a (mon.0) 3001 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:30 smithi178 bash[23441]: audit 2024-04-19T22:59:29.375017+0000 mon.a (mon.0) 2999 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:30 smithi178 bash[23441]: cluster 2024-04-19T22:59:29.382479+0000 mon.a (mon.0) 3000 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-04-19T22:59:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:30 smithi178 bash[23441]: audit 2024-04-19T22:59:29.384943+0000 mon.c (mon.2) 794 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:30.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:30 smithi178 bash[23441]: audit 2024-04-19T22:59:29.397849+0000 mon.a (mon.0) 3001 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]: dispatch 2024-04-19T22:59:31.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[28910]: cluster 2024-04-19T22:59:30.114090+0000 mgr.y (mgr.24389) 556 : cluster 0 pgmap v864: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:31.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[28910]: audit 2024-04-19T22:59:30.398331+0000 mon.a (mon.0) 3002 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]': finished 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[28910]: cluster 2024-04-19T22:59:30.405916+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[28910]: audit 2024-04-19T22:59:30.485968+0000 mon.c (mon.2) 795 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[28910]: audit 2024-04-19T22:59:30.486796+0000 mon.a (mon.0) 3004 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[21528]: cluster 2024-04-19T22:59:30.114090+0000 mgr.y (mgr.24389) 556 : cluster 0 pgmap v864: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[21528]: audit 2024-04-19T22:59:30.398331+0000 mon.a (mon.0) 3002 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]': finished 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[21528]: cluster 2024-04-19T22:59:30.405916+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[21528]: audit 2024-04-19T22:59:30.485968+0000 mon.c (mon.2) 795 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:31.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:31 smithi113 bash[21528]: audit 2024-04-19T22:59:30.486796+0000 mon.a (mon.0) 3004 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:31.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:31 smithi178 bash[23441]: cluster 2024-04-19T22:59:30.114090+0000 mgr.y (mgr.24389) 556 : cluster 0 pgmap v864: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:31.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:31 smithi178 bash[23441]: audit 2024-04-19T22:59:30.398331+0000 mon.a (mon.0) 3002 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-98","var": "target_max_objects","val": "250"}]': finished 2024-04-19T22:59:31.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:31 smithi178 bash[23441]: cluster 2024-04-19T22:59:30.405916+0000 mon.a (mon.0) 3003 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-04-19T22:59:31.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:31 smithi178 bash[23441]: audit 2024-04-19T22:59:30.485968+0000 mon.c (mon.2) 795 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:31.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:31 smithi178 bash[23441]: audit 2024-04-19T22:59:30.486796+0000 mon.a (mon.0) 3004 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:32.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: audit 2024-04-19T22:59:31.400671+0000 mon.a (mon.0) 3005 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: cluster 2024-04-19T22:59:31.410219+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: audit 2024-04-19T22:59:31.410807+0000 mon.c (mon.2) 796 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: audit 2024-04-19T22:59:31.413318+0000 mon.a (mon.0) 3007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: audit 2024-04-19T22:59:32.403448+0000 mon.a (mon.0) 3008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[21528]: cluster 2024-04-19T22:59:32.410878+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: audit 2024-04-19T22:59:31.400671+0000 mon.a (mon.0) 3005 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: cluster 2024-04-19T22:59:31.410219+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: audit 2024-04-19T22:59:31.410807+0000 mon.c (mon.2) 796 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: audit 2024-04-19T22:59:31.413318+0000 mon.a (mon.0) 3007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: audit 2024-04-19T22:59:32.403448+0000 mon.a (mon.0) 3008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:32 smithi113 bash[28910]: cluster 2024-04-19T22:59:32.410878+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: audit 2024-04-19T22:59:31.400671+0000 mon.a (mon.0) 3005 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: cluster 2024-04-19T22:59:31.410219+0000 mon.a (mon.0) 3006 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: audit 2024-04-19T22:59:31.410807+0000 mon.c (mon.2) 796 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: audit 2024-04-19T22:59:31.413318+0000 mon.a (mon.0) 3007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]: dispatch 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: audit 2024-04-19T22:59:32.403448+0000 mon.a (mon.0) 3008 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-98"}]': finished 2024-04-19T22:59:32.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:32 smithi178 bash[23441]: cluster 2024-04-19T22:59:32.410878+0000 mon.a (mon.0) 3009 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-04-19T22:59:33.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:33 smithi113 bash[28910]: cluster 2024-04-19T22:59:32.114928+0000 mgr.y (mgr.24389) 557 : cluster 0 pgmap v867: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:33.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:33 smithi113 bash[21528]: cluster 2024-04-19T22:59:32.114928+0000 mgr.y (mgr.24389) 557 : cluster 0 pgmap v867: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:33.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:33 smithi178 bash[23441]: cluster 2024-04-19T22:59:32.114928+0000 mgr.y (mgr.24389) 557 : cluster 0 pgmap v867: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:34.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:34 smithi113 bash[21528]: cluster 2024-04-19T22:59:33.446472+0000 mon.a (mon.0) 3010 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-04-19T22:59:34.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:34 smithi113 bash[21528]: audit 2024-04-19T22:59:34.411800+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:34 smithi113 bash[28910]: cluster 2024-04-19T22:59:33.446472+0000 mon.a (mon.0) 3010 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-04-19T22:59:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:34 smithi113 bash[28910]: audit 2024-04-19T22:59:34.411800+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:34 smithi178 bash[23441]: cluster 2024-04-19T22:59:33.446472+0000 mon.a (mon.0) 3010 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-04-19T22:59:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:34 smithi178 bash[23441]: audit 2024-04-19T22:59:34.411800+0000 mon.a (mon.0) 3011 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:35.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: cluster 2024-04-19T22:59:34.115706+0000 mgr.y (mgr.24389) 558 : cluster 0 pgmap v870: 196 pgs: 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: cluster 2024-04-19T22:59:34.458309+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: audit 2024-04-19T22:59:34.464240+0000 mon.c (mon.2) 797 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: audit 2024-04-19T22:59:34.467294+0000 mon.a (mon.0) 3013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: audit 2024-04-19T22:59:35.446175+0000 mon.a (mon.0) 3014 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: cluster 2024-04-19T22:59:35.456208+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: audit 2024-04-19T22:59:35.459328+0000 mon.c (mon.2) 798 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[21528]: audit 2024-04-19T22:59:35.462108+0000 mon.a (mon.0) 3016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: cluster 2024-04-19T22:59:34.115706+0000 mgr.y (mgr.24389) 558 : cluster 0 pgmap v870: 196 pgs: 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: cluster 2024-04-19T22:59:34.458309+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-04-19T22:59:35.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: audit 2024-04-19T22:59:34.464240+0000 mon.c (mon.2) 797 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: audit 2024-04-19T22:59:34.467294+0000 mon.a (mon.0) 3013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: audit 2024-04-19T22:59:35.446175+0000 mon.a (mon.0) 3014 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: cluster 2024-04-19T22:59:35.456208+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-04-19T22:59:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: audit 2024-04-19T22:59:35.459328+0000 mon.c (mon.2) 798 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:35 smithi113 bash[28910]: audit 2024-04-19T22:59:35.462108+0000 mon.a (mon.0) 3016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:35.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: cluster 2024-04-19T22:59:34.115706+0000 mgr.y (mgr.24389) 558 : cluster 0 pgmap v870: 196 pgs: 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: cluster 2024-04-19T22:59:34.458309+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: audit 2024-04-19T22:59:34.464240+0000 mon.c (mon.2) 797 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: audit 2024-04-19T22:59:34.467294+0000 mon.a (mon.0) 3013 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: audit 2024-04-19T22:59:35.446175+0000 mon.a (mon.0) 3014 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: cluster 2024-04-19T22:59:35.456208+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-04-19T22:59:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: audit 2024-04-19T22:59:35.459328+0000 mon.c (mon.2) 798 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:35 smithi178 bash[23441]: audit 2024-04-19T22:59:35.462108+0000 mon.a (mon.0) 3016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T22:59:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[28910]: audit 2024-04-19T22:59:35.326870+0000 mgr.y (mgr.24389) 559 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:36.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[28910]: audit 2024-04-19T22:59:36.449025+0000 mon.a (mon.0) 3017 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[28910]: cluster 2024-04-19T22:59:36.456193+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[28910]: audit 2024-04-19T22:59:36.458483+0000 mon.c (mon.2) 799 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[28910]: audit 2024-04-19T22:59:36.460216+0000 mon.a (mon.0) 3019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[21528]: audit 2024-04-19T22:59:35.326870+0000 mgr.y (mgr.24389) 559 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[21528]: audit 2024-04-19T22:59:36.449025+0000 mon.a (mon.0) 3017 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[21528]: cluster 2024-04-19T22:59:36.456193+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[21528]: audit 2024-04-19T22:59:36.458483+0000 mon.c (mon.2) 799 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:36 smithi113 bash[21528]: audit 2024-04-19T22:59:36.460216+0000 mon.a (mon.0) 3019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:36 smithi178 bash[23441]: audit 2024-04-19T22:59:35.326870+0000 mgr.y (mgr.24389) 559 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:36 smithi178 bash[23441]: audit 2024-04-19T22:59:36.449025+0000 mon.a (mon.0) 3017 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T22:59:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:36 smithi178 bash[23441]: cluster 2024-04-19T22:59:36.456193+0000 mon.a (mon.0) 3018 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-04-19T22:59:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:36 smithi178 bash[23441]: audit 2024-04-19T22:59:36.458483+0000 mon.c (mon.2) 799 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:36 smithi178 bash[23441]: audit 2024-04-19T22:59:36.460216+0000 mon.a (mon.0) 3019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:37.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21528]: cluster 2024-04-19T22:59:36.116579+0000 mgr.y (mgr.24389) 560 : cluster 0 pgmap v873: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21528]: audit 2024-04-19T22:59:37.451588+0000 mon.a (mon.0) 3020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21528]: cluster 2024-04-19T22:59:37.463848+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21528]: audit 2024-04-19T22:59:37.465884+0000 mon.c (mon.2) 800 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[21528]: audit 2024-04-19T22:59:37.468118+0000 mon.a (mon.0) 3022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[28910]: cluster 2024-04-19T22:59:36.116579+0000 mgr.y (mgr.24389) 560 : cluster 0 pgmap v873: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[28910]: audit 2024-04-19T22:59:37.451588+0000 mon.a (mon.0) 3020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[28910]: cluster 2024-04-19T22:59:37.463848+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-04-19T22:59:37.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[28910]: audit 2024-04-19T22:59:37.465884+0000 mon.c (mon.2) 800 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:37 smithi113 bash[28910]: audit 2024-04-19T22:59:37.468118+0000 mon.a (mon.0) 3022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:37 smithi178 bash[23441]: cluster 2024-04-19T22:59:36.116579+0000 mgr.y (mgr.24389) 560 : cluster 0 pgmap v873: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:37 smithi178 bash[23441]: audit 2024-04-19T22:59:37.451588+0000 mon.a (mon.0) 3020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-6", "overlaypool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:37 smithi178 bash[23441]: cluster 2024-04-19T22:59:37.463848+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-04-19T22:59:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:37 smithi178 bash[23441]: audit 2024-04-19T22:59:37.465884+0000 mon.c (mon.2) 800 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:37 smithi178 bash[23441]: audit 2024-04-19T22:59:37.468118+0000 mon.a (mon.0) 3022 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]: dispatch 2024-04-19T22:59:38.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[28910]: cluster 2024-04-19T22:59:38.451952+0000 mon.a (mon.0) 3023 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:38.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[28910]: audit 2024-04-19T22:59:38.454295+0000 mon.a (mon.0) 3024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]': finished 2024-04-19T22:59:38.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[28910]: cluster 2024-04-19T22:59:38.461688+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-04-19T22:59:38.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[21528]: cluster 2024-04-19T22:59:38.451952+0000 mon.a (mon.0) 3023 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:38.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[21528]: audit 2024-04-19T22:59:38.454295+0000 mon.a (mon.0) 3024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]': finished 2024-04-19T22:59:38.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:38 smithi113 bash[21528]: cluster 2024-04-19T22:59:38.461688+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-04-19T22:59:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:38 smithi178 bash[23441]: cluster 2024-04-19T22:59:38.451952+0000 mon.a (mon.0) 3023 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T22:59:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:38 smithi178 bash[23441]: audit 2024-04-19T22:59:38.454295+0000 mon.a (mon.0) 3024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-100", "mode": "writeback"}]': finished 2024-04-19T22:59:38.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:38 smithi178 bash[23441]: cluster 2024-04-19T22:59:38.461688+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-04-19T22:59:39.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: cluster 2024-04-19T22:59:38.117338+0000 mgr.y (mgr.24389) 561 : cluster 0 pgmap v876: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: audit 2024-04-19T22:59:38.466551+0000 mon.c (mon.2) 801 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: audit 2024-04-19T22:59:38.483903+0000 mon.a (mon.0) 3026 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: audit 2024-04-19T22:59:39.470555+0000 mon.a (mon.0) 3027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: cluster 2024-04-19T22:59:39.480667+0000 mon.a (mon.0) 3028 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: audit 2024-04-19T22:59:39.482231+0000 mon.c (mon.2) 802 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[28910]: audit 2024-04-19T22:59:39.483727+0000 mon.a (mon.0) 3029 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:39.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: cluster 2024-04-19T22:59:38.117338+0000 mgr.y (mgr.24389) 561 : cluster 0 pgmap v876: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: audit 2024-04-19T22:59:38.466551+0000 mon.c (mon.2) 801 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: audit 2024-04-19T22:59:38.483903+0000 mon.a (mon.0) 3026 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: audit 2024-04-19T22:59:39.470555+0000 mon.a (mon.0) 3027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: cluster 2024-04-19T22:59:39.480667+0000 mon.a (mon.0) 3028 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: audit 2024-04-19T22:59:39.482231+0000 mon.c (mon.2) 802 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:39 smithi113 bash[21528]: audit 2024-04-19T22:59:39.483727+0000 mon.a (mon.0) 3029 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: cluster 2024-04-19T22:59:38.117338+0000 mgr.y (mgr.24389) 561 : cluster 0 pgmap v876: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: audit 2024-04-19T22:59:38.466551+0000 mon.c (mon.2) 801 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: audit 2024-04-19T22:59:38.483903+0000 mon.a (mon.0) 3026 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: audit 2024-04-19T22:59:39.470555+0000 mon.a (mon.0) 3027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_count","val": "2"}]': finished 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: cluster 2024-04-19T22:59:39.480667+0000 mon.a (mon.0) 3028 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: audit 2024-04-19T22:59:39.482231+0000 mon.c (mon.2) 802 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:39 smithi178 bash[23441]: audit 2024-04-19T22:59:39.483727+0000 mon.a (mon.0) 3029 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T22:59:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[21528]: cluster 2024-04-19T22:59:40.119530+0000 mgr.y (mgr.24389) 562 : cluster 0 pgmap v879: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[21528]: audit 2024-04-19T22:59:40.472770+0000 mon.a (mon.0) 3030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[21528]: cluster 2024-04-19T22:59:40.480240+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[21528]: audit 2024-04-19T22:59:40.482893+0000 mon.c (mon.2) 803 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[21528]: audit 2024-04-19T22:59:40.484363+0000 mon.a (mon.0) 3032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[28910]: cluster 2024-04-19T22:59:40.119530+0000 mgr.y (mgr.24389) 562 : cluster 0 pgmap v879: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[28910]: audit 2024-04-19T22:59:40.472770+0000 mon.a (mon.0) 3030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[28910]: cluster 2024-04-19T22:59:40.480240+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[28910]: audit 2024-04-19T22:59:40.482893+0000 mon.c (mon.2) 803 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:41 smithi113 bash[28910]: audit 2024-04-19T22:59:40.484363+0000 mon.a (mon.0) 3032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:41 smithi178 bash[23441]: cluster 2024-04-19T22:59:40.119530+0000 mgr.y (mgr.24389) 562 : cluster 0 pgmap v879: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:41 smithi178 bash[23441]: audit 2024-04-19T22:59:40.472770+0000 mon.a (mon.0) 3030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_period","val": "600"}]': finished 2024-04-19T22:59:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:41 smithi178 bash[23441]: cluster 2024-04-19T22:59:40.480240+0000 mon.a (mon.0) 3031 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-04-19T22:59:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:41 smithi178 bash[23441]: audit 2024-04-19T22:59:40.482893+0000 mon.c (mon.2) 803 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:41 smithi178 bash[23441]: audit 2024-04-19T22:59:40.484363+0000 mon.a (mon.0) 3032 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T22:59:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: cluster 2024-04-19T22:59:41.473090+0000 mon.a (mon.0) 3033 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: audit 2024-04-19T22:59:41.475396+0000 mon.a (mon.0) 3034 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: cluster 2024-04-19T22:59:41.483704+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: audit 2024-04-19T22:59:41.484635+0000 mon.c (mon.2) 804 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: audit 2024-04-19T22:59:41.486586+0000 mon.a (mon.0) 3036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: audit 2024-04-19T22:59:42.477939+0000 mon.a (mon.0) 3037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[28910]: cluster 2024-04-19T22:59:42.484479+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: cluster 2024-04-19T22:59:41.473090+0000 mon.a (mon.0) 3033 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: audit 2024-04-19T22:59:41.475396+0000 mon.a (mon.0) 3034 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: cluster 2024-04-19T22:59:41.483704+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-04-19T22:59:42.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: audit 2024-04-19T22:59:41.484635+0000 mon.c (mon.2) 804 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: audit 2024-04-19T22:59:41.486586+0000 mon.a (mon.0) 3036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: audit 2024-04-19T22:59:42.477939+0000 mon.a (mon.0) 3037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-19T22:59:42.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:42 smithi113 bash[21528]: cluster 2024-04-19T22:59:42.484479+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: cluster 2024-04-19T22:59:41.473090+0000 mon.a (mon.0) 3033 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: audit 2024-04-19T22:59:41.475396+0000 mon.a (mon.0) 3034 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: cluster 2024-04-19T22:59:41.483704+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: audit 2024-04-19T22:59:41.484635+0000 mon.c (mon.2) 804 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: audit 2024-04-19T22:59:41.486586+0000 mon.a (mon.0) 3036 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-04-19T22:59:42.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: audit 2024-04-19T22:59:42.477939+0000 mon.a (mon.0) 3037 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-04-19T22:59:42.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:42 smithi178 bash[23441]: cluster 2024-04-19T22:59:42.484479+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-04-19T22:59:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[21528]: cluster 2024-04-19T22:59:42.120303+0000 mgr.y (mgr.24389) 563 : cluster 0 pgmap v882: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:43.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[21528]: audit 2024-04-19T22:59:42.568188+0000 mon.c (mon.2) 805 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:43.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[21528]: audit 2024-04-19T22:59:42.568974+0000 mon.a (mon.0) 3039 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:43.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[28910]: cluster 2024-04-19T22:59:42.120303+0000 mgr.y (mgr.24389) 563 : cluster 0 pgmap v882: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:43.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[28910]: audit 2024-04-19T22:59:42.568188+0000 mon.c (mon.2) 805 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:43.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:43 smithi113 bash[28910]: audit 2024-04-19T22:59:42.568974+0000 mon.a (mon.0) 3039 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:43 smithi178 bash[23441]: cluster 2024-04-19T22:59:42.120303+0000 mgr.y (mgr.24389) 563 : cluster 0 pgmap v882: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:43 smithi178 bash[23441]: audit 2024-04-19T22:59:42.568188+0000 mon.c (mon.2) 805 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:43 smithi178 bash[23441]: audit 2024-04-19T22:59:42.568974+0000 mon.a (mon.0) 3039 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:44.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[28910]: audit 2024-04-19T22:59:43.515236+0000 mon.a (mon.0) 3040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[28910]: cluster 2024-04-19T22:59:43.522298+0000 mon.a (mon.0) 3041 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[28910]: audit 2024-04-19T22:59:43.526859+0000 mon.c (mon.2) 806 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[28910]: audit 2024-04-19T22:59:43.527914+0000 mon.a (mon.0) 3042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[21528]: audit 2024-04-19T22:59:43.515236+0000 mon.a (mon.0) 3040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[21528]: cluster 2024-04-19T22:59:43.522298+0000 mon.a (mon.0) 3041 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[21528]: audit 2024-04-19T22:59:43.526859+0000 mon.c (mon.2) 806 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:44.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:44 smithi113 bash[21528]: audit 2024-04-19T22:59:43.527914+0000 mon.a (mon.0) 3042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:44.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:44 smithi178 bash[23441]: audit 2024-04-19T22:59:43.515236+0000 mon.a (mon.0) 3040 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]': finished 2024-04-19T22:59:44.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:44 smithi178 bash[23441]: cluster 2024-04-19T22:59:43.522298+0000 mon.a (mon.0) 3041 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-04-19T22:59:44.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:44 smithi178 bash[23441]: audit 2024-04-19T22:59:43.526859+0000 mon.c (mon.2) 806 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:44.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:44 smithi178 bash[23441]: audit 2024-04-19T22:59:43.527914+0000 mon.a (mon.0) 3042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]: dispatch 2024-04-19T22:59:45.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:45.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:45 smithi178 bash[23441]: cluster 2024-04-19T22:59:44.121117+0000 mgr.y (mgr.24389) 564 : cluster 0 pgmap v885: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:45.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:45 smithi178 bash[23441]: audit 2024-04-19T22:59:44.529212+0000 mon.a (mon.0) 3043 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:45.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:45 smithi178 bash[23441]: cluster 2024-04-19T22:59:44.539938+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[28910]: cluster 2024-04-19T22:59:44.121117+0000 mgr.y (mgr.24389) 564 : cluster 0 pgmap v885: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[28910]: audit 2024-04-19T22:59:44.529212+0000 mon.a (mon.0) 3043 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[28910]: cluster 2024-04-19T22:59:44.539938+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[21528]: cluster 2024-04-19T22:59:44.121117+0000 mgr.y (mgr.24389) 564 : cluster 0 pgmap v885: 228 pgs: 228 active+clean; 8.4 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[21528]: audit 2024-04-19T22:59:44.529212+0000 mon.a (mon.0) 3043 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-100"}]': finished 2024-04-19T22:59:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:45 smithi113 bash[21528]: cluster 2024-04-19T22:59:44.539938+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-04-19T22:59:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:46 smithi113 bash[28910]: audit 2024-04-19T22:59:45.338288+0000 mgr.y (mgr.24389) 565 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:47.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:46 smithi113 bash[28910]: cluster 2024-04-19T22:59:45.538311+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-04-19T22:59:47.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:46 smithi113 bash[21528]: audit 2024-04-19T22:59:45.338288+0000 mgr.y (mgr.24389) 565 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:47.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:46 smithi113 bash[21528]: cluster 2024-04-19T22:59:45.538311+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-04-19T22:59:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:46 smithi178 bash[23441]: audit 2024-04-19T22:59:45.338288+0000 mgr.y (mgr.24389) 565 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:46 smithi178 bash[23441]: cluster 2024-04-19T22:59:45.538311+0000 mon.a (mon.0) 3045 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-04-19T22:59:47.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[28910]: cluster 2024-04-19T22:59:46.121806+0000 mgr.y (mgr.24389) 566 : cluster 0 pgmap v888: 196 pgs: 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[28910]: cluster 2024-04-19T22:59:46.571363+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[28910]: audit 2024-04-19T22:59:46.575936+0000 mon.c (mon.2) 807 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[28910]: audit 2024-04-19T22:59:46.576883+0000 mon.a (mon.0) 3047 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[21528]: cluster 2024-04-19T22:59:46.121806+0000 mgr.y (mgr.24389) 566 : cluster 0 pgmap v888: 196 pgs: 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[21528]: cluster 2024-04-19T22:59:46.571363+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-04-19T22:59:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[21528]: audit 2024-04-19T22:59:46.575936+0000 mon.c (mon.2) 807 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:47.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:47 smithi113 bash[21528]: audit 2024-04-19T22:59:46.576883+0000 mon.a (mon.0) 3047 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:47 smithi178 bash[23441]: cluster 2024-04-19T22:59:46.121806+0000 mgr.y (mgr.24389) 566 : cluster 0 pgmap v888: 196 pgs: 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:47 smithi178 bash[23441]: cluster 2024-04-19T22:59:46.571363+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-04-19T22:59:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:47 smithi178 bash[23441]: audit 2024-04-19T22:59:46.575936+0000 mon.c (mon.2) 807 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:47 smithi178 bash[23441]: audit 2024-04-19T22:59:46.576883+0000 mon.a (mon.0) 3047 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:49.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[21528]: audit 2024-04-19T22:59:47.573198+0000 mon.a (mon.0) 3048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[21528]: cluster 2024-04-19T22:59:47.580951+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[21528]: audit 2024-04-19T22:59:47.586874+0000 mon.c (mon.2) 808 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[21528]: audit 2024-04-19T22:59:47.607285+0000 mon.c (mon.2) 809 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[21528]: audit 2024-04-19T22:59:47.610201+0000 mon.a (mon.0) 3050 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[28910]: audit 2024-04-19T22:59:47.573198+0000 mon.a (mon.0) 3048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[28910]: cluster 2024-04-19T22:59:47.580951+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[28910]: audit 2024-04-19T22:59:47.586874+0000 mon.c (mon.2) 808 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:49.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[28910]: audit 2024-04-19T22:59:47.607285+0000 mon.c (mon.2) 809 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:48 smithi113 bash[28910]: audit 2024-04-19T22:59:47.610201+0000 mon.a (mon.0) 3050 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:49.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:48 smithi178 bash[23441]: audit 2024-04-19T22:59:47.573198+0000 mon.a (mon.0) 3048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T22:59:49.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:48 smithi178 bash[23441]: cluster 2024-04-19T22:59:47.580951+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-04-19T22:59:49.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:48 smithi178 bash[23441]: audit 2024-04-19T22:59:47.586874+0000 mon.c (mon.2) 808 : audit 0 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-04-19T22:59:49.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:48 smithi178 bash[23441]: audit 2024-04-19T22:59:47.607285+0000 mon.c (mon.2) 809 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:49.058 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:48 smithi178 bash[23441]: audit 2024-04-19T22:59:47.610201+0000 mon.a (mon.0) 3050 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: cluster 2024-04-19T22:59:48.122659+0000 mgr.y (mgr.24389) 567 : cluster 0 pgmap v891: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:48.575856+0000 mon.a (mon.0) 3051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: cluster 2024-04-19T22:59:48.584539+0000 mon.a (mon.0) 3052 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:48.589368+0000 mon.c (mon.2) 810 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:48.591973+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:49.445159+0000 mon.a (mon.0) 3054 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:49.578638+0000 mon.a (mon.0) 3055 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: cluster 2024-04-19T22:59:49.588601+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:49.589807+0000 mon.c (mon.2) 811 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[28910]: audit 2024-04-19T22:59:49.590944+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: cluster 2024-04-19T22:59:48.122659+0000 mgr.y (mgr.24389) 567 : cluster 0 pgmap v891: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:48.575856+0000 mon.a (mon.0) 3051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: cluster 2024-04-19T22:59:48.584539+0000 mon.a (mon.0) 3052 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:48.589368+0000 mon.c (mon.2) 810 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:48.591973+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:49.445159+0000 mon.a (mon.0) 3054 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:49.578638+0000 mon.a (mon.0) 3055 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: cluster 2024-04-19T22:59:49.588601+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:49.589807+0000 mon.c (mon.2) 811 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:49 smithi113 bash[21528]: audit 2024-04-19T22:59:49.590944+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: cluster 2024-04-19T22:59:48.122659+0000 mgr.y (mgr.24389) 567 : cluster 0 pgmap v891: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T22:59:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:48.575856+0000 mon.a (mon.0) 3051 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-04-19T22:59:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: cluster 2024-04-19T22:59:48.584539+0000 mon.a (mon.0) 3052 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-04-19T22:59:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:48.589368+0000 mon.c (mon.2) 810 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:48.591973+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:49.445159+0000 mon.a (mon.0) 3054 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:49.578638+0000 mon.a (mon.0) 3055 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: cluster 2024-04-19T22:59:49.588601+0000 mon.a (mon.0) 3056 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:49.589807+0000 mon.c (mon.2) 811 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:49 smithi178 bash[23441]: audit 2024-04-19T22:59:49.590944+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: cluster 2024-04-19T22:59:50.124614+0000 mgr.y (mgr.24389) 568 : cluster 0 pgmap v894: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: audit 2024-04-19T22:59:50.581354+0000 mon.a (mon.0) 3058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: cluster 2024-04-19T22:59:50.589997+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: audit 2024-04-19T22:59:50.661995+0000 mon.c (mon.2) 812 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: audit 2024-04-19T22:59:50.662809+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: audit 2024-04-19T22:59:50.664398+0000 mon.c (mon.2) 813 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[28910]: audit 2024-04-19T22:59:50.665320+0000 mon.a (mon.0) 3061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: cluster 2024-04-19T22:59:50.124614+0000 mgr.y (mgr.24389) 568 : cluster 0 pgmap v894: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: audit 2024-04-19T22:59:50.581354+0000 mon.a (mon.0) 3058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:59:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: cluster 2024-04-19T22:59:50.589997+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-04-19T22:59:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: audit 2024-04-19T22:59:50.661995+0000 mon.c (mon.2) 812 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: audit 2024-04-19T22:59:50.662809+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: audit 2024-04-19T22:59:50.664398+0000 mon.c (mon.2) 813 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:51 smithi113 bash[21528]: audit 2024-04-19T22:59:50.665320+0000 mon.a (mon.0) 3061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: cluster 2024-04-19T22:59:50.124614+0000 mgr.y (mgr.24389) 568 : cluster 0 pgmap v894: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: audit 2024-04-19T22:59:50.581354+0000 mon.a (mon.0) 3058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-04-19T22:59:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: cluster 2024-04-19T22:59:50.589997+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-04-19T22:59:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: audit 2024-04-19T22:59:50.661995+0000 mon.c (mon.2) 812 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: audit 2024-04-19T22:59:50.662809+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-6"}]: dispatch 2024-04-19T22:59:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: audit 2024-04-19T22:59:50.664398+0000 mon.c (mon.2) 813 : audit 1 from='client.? 172.21.15.113:0/2272057171' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:51 smithi178 bash[23441]: audit 2024-04-19T22:59:50.665320+0000 mon.a (mon.0) 3061 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-6", "tierpool": "test-rados-api-smithi113-63998-102"}]: dispatch 2024-04-19T22:59:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:52 smithi113 bash[28910]: cluster 2024-04-19T22:59:51.612387+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-04-19T22:59:53.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:52 smithi113 bash[21528]: cluster 2024-04-19T22:59:51.612387+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-04-19T22:59:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:52 smithi178 bash[23441]: cluster 2024-04-19T22:59:51.612387+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[28910]: cluster 2024-04-19T22:59:52.125425+0000 mgr.y (mgr.24389) 569 : cluster 0 pgmap v897: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[28910]: cluster 2024-04-19T22:59:52.622300+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[28910]: audit 2024-04-19T22:59:52.668611+0000 mon.a (mon.0) 3064 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[28910]: audit 2024-04-19T22:59:52.669936+0000 mon.a (mon.0) 3065 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[28910]: audit 2024-04-19T22:59:52.670337+0000 mon.a (mon.0) 3066 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[21528]: cluster 2024-04-19T22:59:52.125425+0000 mgr.y (mgr.24389) 569 : cluster 0 pgmap v897: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:54.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[21528]: cluster 2024-04-19T22:59:52.622300+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-04-19T22:59:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[21528]: audit 2024-04-19T22:59:52.668611+0000 mon.a (mon.0) 3064 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[21528]: audit 2024-04-19T22:59:52.669936+0000 mon.a (mon.0) 3065 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:53 smithi113 bash[21528]: audit 2024-04-19T22:59:52.670337+0000 mon.a (mon.0) 3066 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:59:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:53 smithi178 bash[23441]: cluster 2024-04-19T22:59:52.125425+0000 mgr.y (mgr.24389) 569 : cluster 0 pgmap v897: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T22:59:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:53 smithi178 bash[23441]: cluster 2024-04-19T22:59:52.622300+0000 mon.a (mon.0) 3063 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-04-19T22:59:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:53 smithi178 bash[23441]: audit 2024-04-19T22:59:52.668611+0000 mon.a (mon.0) 3064 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:53 smithi178 bash[23441]: audit 2024-04-19T22:59:52.669936+0000 mon.a (mon.0) 3065 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:53 smithi178 bash[23441]: audit 2024-04-19T22:59:52.670337+0000 mon.a (mon.0) 3066 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T22:59:55.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:55 smithi178 bash[23441]: audit 2024-04-19T22:59:53.616362+0000 mon.a (mon.0) 3067 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:59:55.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:55 smithi178 bash[23441]: cluster 2024-04-19T22:59:53.621455+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-04-19T22:59:55.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:55 smithi178 bash[23441]: audit 2024-04-19T22:59:53.623059+0000 mon.a (mon.0) 3069 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:55.548 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[21528]: audit 2024-04-19T22:59:53.616362+0000 mon.a (mon.0) 3067 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:59:55.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[21528]: cluster 2024-04-19T22:59:53.621455+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-04-19T22:59:55.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[21528]: audit 2024-04-19T22:59:53.623059+0000 mon.a (mon.0) 3069 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[28910]: audit 2024-04-19T22:59:53.616362+0000 mon.a (mon.0) 3067 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T22:59:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[28910]: cluster 2024-04-19T22:59:53.621455+0000 mon.a (mon.0) 3068 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-04-19T22:59:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:55 smithi113 bash[28910]: audit 2024-04-19T22:59:53.623059+0000 mon.a (mon.0) 3069 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T22:59:55.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 22:59:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[28910]: cluster 2024-04-19T22:59:54.126261+0000 mgr.y (mgr.24389) 570 : cluster 0 pgmap v900: 164 pgs: 164 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[28910]: cluster 2024-04-19T22:59:55.073315+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[28910]: audit 2024-04-19T22:59:55.349693+0000 mgr.y (mgr.24389) 571 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[28910]: audit 2024-04-19T22:59:55.623063+0000 mon.a (mon.0) 3071 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[28910]: cluster 2024-04-19T22:59:55.633656+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[21528]: cluster 2024-04-19T22:59:54.126261+0000 mgr.y (mgr.24389) 570 : cluster 0 pgmap v900: 164 pgs: 164 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[21528]: cluster 2024-04-19T22:59:55.073315+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-04-19T22:59:56.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[21528]: audit 2024-04-19T22:59:55.349693+0000 mgr.y (mgr.24389) 571 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:56.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[21528]: audit 2024-04-19T22:59:55.623063+0000 mon.a (mon.0) 3071 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T22:59:56.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:56 smithi113 bash[21528]: cluster 2024-04-19T22:59:55.633656+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-04-19T22:59:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:56 smithi178 bash[23441]: cluster 2024-04-19T22:59:54.126261+0000 mgr.y (mgr.24389) 570 : cluster 0 pgmap v900: 164 pgs: 164 active+clean; 583 KiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:56 smithi178 bash[23441]: cluster 2024-04-19T22:59:55.073315+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-04-19T22:59:56.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:56 smithi178 bash[23441]: audit 2024-04-19T22:59:55.349693+0000 mgr.y (mgr.24389) 571 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T22:59:56.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:56 smithi178 bash[23441]: audit 2024-04-19T22:59:55.623063+0000 mon.a (mon.0) 3071 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi113-63998-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T22:59:56.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:56 smithi178 bash[23441]: cluster 2024-04-19T22:59:55.633656+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-04-19T22:59:57.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:22:59:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[28910]: cluster 2024-04-19T22:59:56.127019+0000 mgr.y (mgr.24389) 572 : cluster 0 pgmap v903: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[28910]: cluster 2024-04-19T22:59:56.635723+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[28910]: cluster 2024-04-19T22:59:57.148893+0000 mon.a (mon.0) 3074 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[21528]: cluster 2024-04-19T22:59:56.127019+0000 mgr.y (mgr.24389) 572 : cluster 0 pgmap v903: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[21528]: cluster 2024-04-19T22:59:56.635723+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-04-19T22:59:57.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:57 smithi113 bash[21528]: cluster 2024-04-19T22:59:57.148893+0000 mon.a (mon.0) 3074 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:59:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:57 smithi178 bash[23441]: cluster 2024-04-19T22:59:56.127019+0000 mgr.y (mgr.24389) 572 : cluster 0 pgmap v903: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-04-19T22:59:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:57 smithi178 bash[23441]: cluster 2024-04-19T22:59:56.635723+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-04-19T22:59:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:57 smithi178 bash[23441]: cluster 2024-04-19T22:59:57.148893+0000 mon.a (mon.0) 3074 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T22:59:59.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[21528]: cluster 2024-04-19T22:59:57.645422+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-04-19T22:59:59.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[21528]: audit 2024-04-19T22:59:57.648859+0000 mon.c (mon.2) 814 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:59.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[21528]: audit 2024-04-19T22:59:57.649467+0000 mon.a (mon.0) 3076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[28910]: cluster 2024-04-19T22:59:57.645422+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-04-19T22:59:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[28910]: audit 2024-04-19T22:59:57.648859+0000 mon.c (mon.2) 814 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:58 smithi113 bash[28910]: audit 2024-04-19T22:59:57.649467+0000 mon.a (mon.0) 3076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:59.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:58 smithi178 bash[23441]: cluster 2024-04-19T22:59:57.645422+0000 mon.a (mon.0) 3075 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-04-19T22:59:59.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:58 smithi178 bash[23441]: audit 2024-04-19T22:59:57.648859+0000 mon.c (mon.2) 814 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T22:59:59.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:58 smithi178 bash[23441]: audit 2024-04-19T22:59:57.649467+0000 mon.a (mon.0) 3076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[28910]: cluster 2024-04-19T22:59:58.127894+0000 mgr.y (mgr.24389) 573 : cluster 0 pgmap v906: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[28910]: audit 2024-04-19T22:59:58.647190+0000 mon.a (mon.0) 3077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[28910]: cluster 2024-04-19T22:59:58.658615+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[21528]: cluster 2024-04-19T22:59:58.127894+0000 mgr.y (mgr.24389) 573 : cluster 0 pgmap v906: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[21528]: audit 2024-04-19T22:59:58.647190+0000 mon.a (mon.0) 3077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:00.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 22:59:59 smithi113 bash[21528]: cluster 2024-04-19T22:59:58.658615+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-04-19T23:00:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:59 smithi178 bash[23441]: cluster 2024-04-19T22:59:58.127894+0000 mgr.y (mgr.24389) 573 : cluster 0 pgmap v906: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:59 smithi178 bash[23441]: audit 2024-04-19T22:59:58.647190+0000 mon.a (mon.0) 3077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:00.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 22:59:59 smithi178 bash[23441]: cluster 2024-04-19T22:59:58.658615+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T22:59:59.671720+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: audit 2024-04-19T22:59:59.678242+0000 mon.c (mon.2) 815 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: audit 2024-04-19T22:59:59.679645+0000 mon.a (mon.0) 3080 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000198+0000 mon.a (mon.0) 3081 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000284+0000 mon.a (mon.0) 3082 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000304+0000 mon.a (mon.0) 3083 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T23:00:01.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000323+0000 mon.a (mon.0) 3084 : cluster 3 application not enabled on pool 'LibRadosTierECPP_smithi113-63998-104' 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000344+0000 mon.a (mon.0) 3085 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-107' 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.000364+0000 mon.a (mon.0) 3086 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T22:59:59.671720+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: audit 2024-04-19T22:59:59.678242+0000 mon.c (mon.2) 815 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: audit 2024-04-19T22:59:59.679645+0000 mon.a (mon.0) 3080 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000198+0000 mon.a (mon.0) 3081 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000284+0000 mon.a (mon.0) 3082 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000304+0000 mon.a (mon.0) 3083 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000323+0000 mon.a (mon.0) 3084 : cluster 3 application not enabled on pool 'LibRadosTierECPP_smithi113-63998-104' 2024-04-19T23:00:01.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000344+0000 mon.a (mon.0) 3085 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-107' 2024-04-19T23:00:01.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:00 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.000364+0000 mon.a (mon.0) 3086 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T23:00:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T22:59:59.671720+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-04-19T23:00:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: audit 2024-04-19T22:59:59.678242+0000 mon.c (mon.2) 815 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: audit 2024-04-19T22:59:59.679645+0000 mon.a (mon.0) 3080 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000198+0000 mon.a (mon.0) 3081 : cluster 3 Health detail: HEALTH_WARN 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000284+0000 mon.a (mon.0) 3082 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000304+0000 mon.a (mon.0) 3083 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000323+0000 mon.a (mon.0) 3084 : cluster 3 application not enabled on pool 'LibRadosTierECPP_smithi113-63998-104' 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000344+0000 mon.a (mon.0) 3085 : cluster 3 application not enabled on pool 'test-rados-api-smithi113-63998-107' 2024-04-19T23:00:01.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:00 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.000364+0000 mon.a (mon.0) 3086 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.129957+0000 mgr.y (mgr.24389) 574 : cluster 0 pgmap v909: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[21528]: audit 2024-04-19T23:00:00.673584+0000 mon.a (mon.0) 3087 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[21528]: cluster 2024-04-19T23:00:00.684409+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[21528]: audit 2024-04-19T23:00:00.688126+0000 mon.c (mon.2) 816 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[21528]: audit 2024-04-19T23:00:00.688846+0000 mon.a (mon.0) 3089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:02.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.129957+0000 mgr.y (mgr.24389) 574 : cluster 0 pgmap v909: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[28910]: audit 2024-04-19T23:00:00.673584+0000 mon.a (mon.0) 3087 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[28910]: cluster 2024-04-19T23:00:00.684409+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-04-19T23:00:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[28910]: audit 2024-04-19T23:00:00.688126+0000 mon.c (mon.2) 816 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:01 smithi113 bash[28910]: audit 2024-04-19T23:00:00.688846+0000 mon.a (mon.0) 3089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:01 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.129957+0000 mgr.y (mgr.24389) 574 : cluster 0 pgmap v909: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:01 smithi178 bash[23441]: audit 2024-04-19T23:00:00.673584+0000 mon.a (mon.0) 3087 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:01 smithi178 bash[23441]: cluster 2024-04-19T23:00:00.684409+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-04-19T23:00:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:01 smithi178 bash[23441]: audit 2024-04-19T23:00:00.688126+0000 mon.c (mon.2) 816 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:02.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:01 smithi178 bash[23441]: audit 2024-04-19T23:00:00.688846+0000 mon.a (mon.0) 3089 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:01.676645+0000 mon.a (mon.0) 3090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: cluster 2024-04-19T23:00:01.684039+0000 mon.a (mon.0) 3091 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:01.686337+0000 mon.c (mon.2) 817 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:01.698489+0000 mon.a (mon.0) 3092 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:01.786447+0000 mon.a (mon.0) 3093 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:02.536801+0000 mon.a (mon.0) 3094 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:00:03.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:02.538477+0000 mon.a (mon.0) 3095 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[21528]: audit 2024-04-19T23:00:02.548719+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:01.676645+0000 mon.a (mon.0) 3090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: cluster 2024-04-19T23:00:01.684039+0000 mon.a (mon.0) 3091 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:01.686337+0000 mon.c (mon.2) 817 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:01.698489+0000 mon.a (mon.0) 3092 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:01.786447+0000 mon.a (mon.0) 3093 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:02.536801+0000 mon.a (mon.0) 3094 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:02.538477+0000 mon.a (mon.0) 3095 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:00:03.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:02 smithi113 bash[28910]: audit 2024-04-19T23:00:02.548719+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:01.676645+0000 mon.a (mon.0) 3090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:03.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: cluster 2024-04-19T23:00:01.684039+0000 mon.a (mon.0) 3091 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:01.686337+0000 mon.c (mon.2) 817 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:01.698489+0000 mon.a (mon.0) 3092 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:01.786447+0000 mon.a (mon.0) 3093 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:02.536801+0000 mon.a (mon.0) 3094 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:02.538477+0000 mon.a (mon.0) 3095 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:00:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:02 smithi178 bash[23441]: audit 2024-04-19T23:00:02.548719+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: cluster 2024-04-19T23:00:02.130894+0000 mgr.y (mgr.24389) 575 : cluster 0 pgmap v912: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: cluster 2024-04-19T23:00:02.689461+0000 mon.a (mon.0) 3097 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: audit 2024-04-19T23:00:02.699132+0000 mon.a (mon.0) 3098 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: cluster 2024-04-19T23:00:02.711832+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: audit 2024-04-19T23:00:02.713291+0000 mon.c (mon.2) 818 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[21528]: audit 2024-04-19T23:00:02.714169+0000 mon.a (mon.0) 3100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: cluster 2024-04-19T23:00:02.130894+0000 mgr.y (mgr.24389) 575 : cluster 0 pgmap v912: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: cluster 2024-04-19T23:00:02.689461+0000 mon.a (mon.0) 3097 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: audit 2024-04-19T23:00:02.699132+0000 mon.a (mon.0) 3098 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: cluster 2024-04-19T23:00:02.711832+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: audit 2024-04-19T23:00:02.713291+0000 mon.c (mon.2) 818 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:04.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:03 smithi113 bash[28910]: audit 2024-04-19T23:00:02.714169+0000 mon.a (mon.0) 3100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: cluster 2024-04-19T23:00:02.130894+0000 mgr.y (mgr.24389) 575 : cluster 0 pgmap v912: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:00:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: cluster 2024-04-19T23:00:02.689461+0000 mon.a (mon.0) 3097 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: audit 2024-04-19T23:00:02.699132+0000 mon.a (mon.0) 3098 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-107", "overlaypool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:04.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: cluster 2024-04-19T23:00:02.711832+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-04-19T23:00:04.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: audit 2024-04-19T23:00:02.713291+0000 mon.c (mon.2) 818 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:04.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:03 smithi178 bash[23441]: audit 2024-04-19T23:00:02.714169+0000 mon.a (mon.0) 3100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: cluster 2024-04-19T23:00:03.700088+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: audit 2024-04-19T23:00:03.713126+0000 mon.a (mon.0) 3102 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: cluster 2024-04-19T23:00:03.722209+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: audit 2024-04-19T23:00:03.752980+0000 mon.c (mon.2) 819 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: audit 2024-04-19T23:00:03.753553+0000 mon.a (mon.0) 3104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: cluster 2024-04-19T23:00:04.131768+0000 mgr.y (mgr.24389) 576 : cluster 0 pgmap v915: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: audit 2024-04-19T23:00:04.484893+0000 mon.a (mon.0) 3105 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[28910]: audit 2024-04-19T23:00:04.487297+0000 mon.a (mon.0) 3106 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:05.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: cluster 2024-04-19T23:00:03.700088+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: audit 2024-04-19T23:00:03.713126+0000 mon.a (mon.0) 3102 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: cluster 2024-04-19T23:00:03.722209+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: audit 2024-04-19T23:00:03.752980+0000 mon.c (mon.2) 819 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: audit 2024-04-19T23:00:03.753553+0000 mon.a (mon.0) 3104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: cluster 2024-04-19T23:00:04.131768+0000 mgr.y (mgr.24389) 576 : cluster 0 pgmap v915: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: audit 2024-04-19T23:00:04.484893+0000 mon.a (mon.0) 3105 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:05.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:04 smithi113 bash[21528]: audit 2024-04-19T23:00:04.487297+0000 mon.a (mon.0) 3106 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: cluster 2024-04-19T23:00:03.700088+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: audit 2024-04-19T23:00:03.713126+0000 mon.a (mon.0) 3102 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-107-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:05.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: cluster 2024-04-19T23:00:03.722209+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-04-19T23:00:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: audit 2024-04-19T23:00:03.752980+0000 mon.c (mon.2) 819 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: audit 2024-04-19T23:00:03.753553+0000 mon.a (mon.0) 3104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]: dispatch 2024-04-19T23:00:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: cluster 2024-04-19T23:00:04.131768+0000 mgr.y (mgr.24389) 576 : cluster 0 pgmap v915: 236 pgs: 32 creating+peering, 204 active+clean; 583 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: audit 2024-04-19T23:00:04.484893+0000 mon.a (mon.0) 3105 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:04 smithi178 bash[23441]: audit 2024-04-19T23:00:04.487297+0000 mon.a (mon.0) 3106 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:05.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[28910]: audit 2024-04-19T23:00:04.722871+0000 mon.a (mon.0) 3107 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]': finished 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[28910]: cluster 2024-04-19T23:00:04.730001+0000 mon.a (mon.0) 3108 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[28910]: audit 2024-04-19T23:00:04.731525+0000 mon.c (mon.2) 820 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[28910]: audit 2024-04-19T23:00:04.732557+0000 mon.a (mon.0) 3109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[28910]: audit 2024-04-19T23:00:05.357665+0000 mgr.y (mgr.24389) 577 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[21528]: audit 2024-04-19T23:00:04.722871+0000 mon.a (mon.0) 3107 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]': finished 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[21528]: cluster 2024-04-19T23:00:04.730001+0000 mon.a (mon.0) 3108 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-04-19T23:00:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[21528]: audit 2024-04-19T23:00:04.731525+0000 mon.c (mon.2) 820 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[21528]: audit 2024-04-19T23:00:04.732557+0000 mon.a (mon.0) 3109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:05 smithi113 bash[21528]: audit 2024-04-19T23:00:05.357665+0000 mgr.y (mgr.24389) 577 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[23441]: audit 2024-04-19T23:00:04.722871+0000 mon.a (mon.0) 3107 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-107"}]': finished 2024-04-19T23:00:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[23441]: cluster 2024-04-19T23:00:04.730001+0000 mon.a (mon.0) 3108 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-04-19T23:00:06.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[23441]: audit 2024-04-19T23:00:04.731525+0000 mon.c (mon.2) 820 : audit 1 from='client.? 172.21.15.113:0/215939555' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[23441]: audit 2024-04-19T23:00:04.732557+0000 mon.a (mon.0) 3109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]: dispatch 2024-04-19T23:00:06.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:05 smithi178 bash[23441]: audit 2024-04-19T23:00:05.357665+0000 mgr.y (mgr.24389) 577 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[28910]: cluster 2024-04-19T23:00:05.723207+0000 mon.a (mon.0) 3110 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[28910]: audit 2024-04-19T23:00:05.725643+0000 mon.a (mon.0) 3111 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[28910]: cluster 2024-04-19T23:00:05.733262+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[28910]: cluster 2024-04-19T23:00:06.132566+0000 mgr.y (mgr.24389) 578 : cluster 0 pgmap v918: 236 pgs: 236 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[21528]: cluster 2024-04-19T23:00:05.723207+0000 mon.a (mon.0) 3110 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[21528]: audit 2024-04-19T23:00:05.725643+0000 mon.a (mon.0) 3111 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:07.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[21528]: cluster 2024-04-19T23:00:05.733262+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-04-19T23:00:07.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:06 smithi113 bash[21528]: cluster 2024-04-19T23:00:06.132566+0000 mgr.y (mgr.24389) 578 : cluster 0 pgmap v918: 236 pgs: 236 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:00:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:06 smithi178 bash[23441]: cluster 2024-04-19T23:00:05.723207+0000 mon.a (mon.0) 3110 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:06 smithi178 bash[23441]: audit 2024-04-19T23:00:05.725643+0000 mon.a (mon.0) 3111 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-107", "tierpool": "test-rados-api-smithi113-63998-107-cache"}]': finished 2024-04-19T23:00:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:06 smithi178 bash[23441]: cluster 2024-04-19T23:00:05.733262+0000 mon.a (mon.0) 3112 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-04-19T23:00:07.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:06 smithi178 bash[23441]: cluster 2024-04-19T23:00:06.132566+0000 mgr.y (mgr.24389) 578 : cluster 0 pgmap v918: 236 pgs: 236 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:00:07.772 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:08.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:07 smithi113 bash[28910]: cluster 2024-04-19T23:00:06.756260+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-04-19T23:00:08.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:07 smithi113 bash[21528]: cluster 2024-04-19T23:00:06.756260+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-04-19T23:00:08.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:07 smithi178 bash[23441]: cluster 2024-04-19T23:00:06.756260+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[28910]: cluster 2024-04-19T23:00:07.756789+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[28910]: audit 2024-04-19T23:00:07.809933+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[28910]: audit 2024-04-19T23:00:07.811377+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[28910]: audit 2024-04-19T23:00:07.811770+0000 mon.a (mon.0) 3117 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[28910]: cluster 2024-04-19T23:00:08.133470+0000 mgr.y (mgr.24389) 579 : cluster 0 pgmap v921: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:09.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[21528]: cluster 2024-04-19T23:00:07.756789+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-04-19T23:00:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[21528]: audit 2024-04-19T23:00:07.809933+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[21528]: audit 2024-04-19T23:00:07.811377+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[21528]: audit 2024-04-19T23:00:07.811770+0000 mon.a (mon.0) 3117 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:08 smithi113 bash[21528]: cluster 2024-04-19T23:00:08.133470+0000 mgr.y (mgr.24389) 579 : cluster 0 pgmap v921: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:09.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:08 smithi178 bash[23441]: cluster 2024-04-19T23:00:07.756789+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-04-19T23:00:09.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:08 smithi178 bash[23441]: audit 2024-04-19T23:00:07.809933+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:08 smithi178 bash[23441]: audit 2024-04-19T23:00:07.811377+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:08 smithi178 bash[23441]: audit 2024-04-19T23:00:07.811770+0000 mon.a (mon.0) 3117 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:08 smithi178 bash[23441]: cluster 2024-04-19T23:00:08.133470+0000 mgr.y (mgr.24389) 579 : cluster 0 pgmap v921: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[28910]: audit 2024-04-19T23:00:08.780415+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[28910]: cluster 2024-04-19T23:00:08.788809+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[28910]: audit 2024-04-19T23:00:08.789942+0000 mon.a (mon.0) 3120 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[21528]: audit 2024-04-19T23:00:08.780415+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[21528]: cluster 2024-04-19T23:00:08.788809+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-04-19T23:00:10.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:10 smithi113 bash[21528]: audit 2024-04-19T23:00:08.789942+0000 mon.a (mon.0) 3120 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:10 smithi178 bash[23441]: audit 2024-04-19T23:00:08.780415+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:10 smithi178 bash[23441]: cluster 2024-04-19T23:00:08.788809+0000 mon.a (mon.0) 3119 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-04-19T23:00:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:10 smithi178 bash[23441]: audit 2024-04-19T23:00:08.789942+0000 mon.a (mon.0) 3120 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[28910]: cluster 2024-04-19T23:00:10.135168+0000 mgr.y (mgr.24389) 580 : cluster 0 pgmap v924: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[28910]: cluster 2024-04-19T23:00:10.234190+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[28910]: audit 2024-04-19T23:00:10.793150+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[28910]: cluster 2024-04-19T23:00:10.801436+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[21528]: cluster 2024-04-19T23:00:10.135168+0000 mgr.y (mgr.24389) 580 : cluster 0 pgmap v924: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[21528]: cluster 2024-04-19T23:00:10.234190+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-04-19T23:00:11.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[21528]: audit 2024-04-19T23:00:10.793150+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:11.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:11 smithi113 bash[21528]: cluster 2024-04-19T23:00:10.801436+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-04-19T23:00:11.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:11 smithi178 bash[23441]: cluster 2024-04-19T23:00:10.135168+0000 mgr.y (mgr.24389) 580 : cluster 0 pgmap v924: 172 pgs: 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:11.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:11 smithi178 bash[23441]: cluster 2024-04-19T23:00:10.234190+0000 mon.a (mon.0) 3121 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-04-19T23:00:11.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:11 smithi178 bash[23441]: audit 2024-04-19T23:00:10.793150+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:11.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:11 smithi178 bash[23441]: cluster 2024-04-19T23:00:10.801436+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[28910]: cluster 2024-04-19T23:00:11.805380+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[28910]: audit 2024-04-19T23:00:11.810152+0000 mon.a (mon.0) 3125 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[28910]: cluster 2024-04-19T23:00:12.136062+0000 mgr.y (mgr.24389) 581 : cluster 0 pgmap v927: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[21528]: cluster 2024-04-19T23:00:11.805380+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[21528]: audit 2024-04-19T23:00:11.810152+0000 mon.a (mon.0) 3125 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:13.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:12 smithi113 bash[21528]: cluster 2024-04-19T23:00:12.136062+0000 mgr.y (mgr.24389) 581 : cluster 0 pgmap v927: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:13.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:12 smithi178 bash[23441]: cluster 2024-04-19T23:00:11.805380+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-04-19T23:00:13.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:12 smithi178 bash[23441]: audit 2024-04-19T23:00:11.810152+0000 mon.a (mon.0) 3125 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:13.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:12 smithi178 bash[23441]: cluster 2024-04-19T23:00:12.136062+0000 mgr.y (mgr.24389) 581 : cluster 0 pgmap v927: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[28910]: cluster 2024-04-19T23:00:12.796857+0000 mon.a (mon.0) 3126 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[28910]: audit 2024-04-19T23:00:12.809051+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[28910]: cluster 2024-04-19T23:00:12.819113+0000 mon.a (mon.0) 3128 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[28910]: audit 2024-04-19T23:00:12.823407+0000 mon.a (mon.0) 3129 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[21528]: cluster 2024-04-19T23:00:12.796857+0000 mon.a (mon.0) 3126 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:14.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[21528]: audit 2024-04-19T23:00:12.809051+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:14.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[21528]: cluster 2024-04-19T23:00:12.819113+0000 mon.a (mon.0) 3128 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-04-19T23:00:14.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:13 smithi113 bash[21528]: audit 2024-04-19T23:00:12.823407+0000 mon.a (mon.0) 3129 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:14.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:13 smithi178 bash[23441]: cluster 2024-04-19T23:00:12.796857+0000 mon.a (mon.0) 3126 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:14.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:13 smithi178 bash[23441]: audit 2024-04-19T23:00:12.809051+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:14.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:13 smithi178 bash[23441]: cluster 2024-04-19T23:00:12.819113+0000 mon.a (mon.0) 3128 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-04-19T23:00:14.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:13 smithi178 bash[23441]: audit 2024-04-19T23:00:12.823407+0000 mon.a (mon.0) 3129 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[21528]: audit 2024-04-19T23:00:13.825044+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[21528]: cluster 2024-04-19T23:00:13.834549+0000 mon.a (mon.0) 3131 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-04-19T23:00:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[21528]: audit 2024-04-19T23:00:13.837278+0000 mon.a (mon.0) 3132 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:15.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[21528]: cluster 2024-04-19T23:00:14.137020+0000 mgr.y (mgr.24389) 582 : cluster 0 pgmap v930: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:15.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[28910]: audit 2024-04-19T23:00:13.825044+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:15.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[28910]: cluster 2024-04-19T23:00:13.834549+0000 mon.a (mon.0) 3131 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-04-19T23:00:15.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[28910]: audit 2024-04-19T23:00:13.837278+0000 mon.a (mon.0) 3132 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:15.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:14 smithi113 bash[28910]: cluster 2024-04-19T23:00:14.137020+0000 mgr.y (mgr.24389) 582 : cluster 0 pgmap v930: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:15.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:14 smithi178 bash[23441]: audit 2024-04-19T23:00:13.825044+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:15.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:14 smithi178 bash[23441]: cluster 2024-04-19T23:00:13.834549+0000 mon.a (mon.0) 3131 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-04-19T23:00:15.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:14 smithi178 bash[23441]: audit 2024-04-19T23:00:13.837278+0000 mon.a (mon.0) 3132 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:15.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:14 smithi178 bash[23441]: cluster 2024-04-19T23:00:14.137020+0000 mgr.y (mgr.24389) 582 : cluster 0 pgmap v930: 212 pgs: 40 unknown, 172 active+clean; 583 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:15.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[28910]: audit 2024-04-19T23:00:14.837594+0000 mon.a (mon.0) 3133 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[28910]: cluster 2024-04-19T23:00:14.848417+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[28910]: audit 2024-04-19T23:00:14.853265+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[28910]: audit 2024-04-19T23:00:15.369133+0000 mgr.y (mgr.24389) 583 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[21528]: audit 2024-04-19T23:00:14.837594+0000 mon.a (mon.0) 3133 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:16.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[21528]: cluster 2024-04-19T23:00:14.848417+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-04-19T23:00:16.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[21528]: audit 2024-04-19T23:00:14.853265+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:16.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:15 smithi113 bash[21528]: audit 2024-04-19T23:00:15.369133+0000 mgr.y (mgr.24389) 583 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:15 smithi178 bash[23441]: audit 2024-04-19T23:00:14.837594+0000 mon.a (mon.0) 3133 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-109", "overlaypool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:15 smithi178 bash[23441]: cluster 2024-04-19T23:00:14.848417+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-04-19T23:00:16.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:15 smithi178 bash[23441]: audit 2024-04-19T23:00:14.853265+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]: dispatch 2024-04-19T23:00:16.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:15 smithi178 bash[23441]: audit 2024-04-19T23:00:15.369133+0000 mgr.y (mgr.24389) 583 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:17.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[21528]: cluster 2024-04-19T23:00:15.837987+0000 mon.a (mon.0) 3136 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:17.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[21528]: audit 2024-04-19T23:00:15.840572+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:17.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[21528]: cluster 2024-04-19T23:00:15.850981+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-04-19T23:00:17.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[21528]: audit 2024-04-19T23:00:15.852902+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:00:17.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[21528]: cluster 2024-04-19T23:00:16.137982+0000 mgr.y (mgr.24389) 584 : cluster 0 pgmap v933: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:17.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[28910]: cluster 2024-04-19T23:00:15.837987+0000 mon.a (mon.0) 3136 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:17.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[28910]: audit 2024-04-19T23:00:15.840572+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:17.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[28910]: cluster 2024-04-19T23:00:15.850981+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-04-19T23:00:17.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[28910]: audit 2024-04-19T23:00:15.852902+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:00:17.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:16 smithi113 bash[28910]: cluster 2024-04-19T23:00:16.137982+0000 mgr.y (mgr.24389) 584 : cluster 0 pgmap v933: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:17.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:16 smithi178 bash[23441]: cluster 2024-04-19T23:00:15.837987+0000 mon.a (mon.0) 3136 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:17.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:16 smithi178 bash[23441]: audit 2024-04-19T23:00:15.840572+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-109-cache", "mode": "writeback"}]': finished 2024-04-19T23:00:17.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:16 smithi178 bash[23441]: cluster 2024-04-19T23:00:15.850981+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-04-19T23:00:17.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:16 smithi178 bash[23441]: audit 2024-04-19T23:00:15.852902+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:00:17.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:16 smithi178 bash[23441]: cluster 2024-04-19T23:00:16.137982+0000 mgr.y (mgr.24389) 584 : cluster 0 pgmap v933: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:17.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: audit 2024-04-19T23:00:16.843928+0000 mon.a (mon.0) 3140 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:00:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: cluster 2024-04-19T23:00:16.852138+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-04-19T23:00:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: audit 2024-04-19T23:00:16.856362+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:00:18.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: audit 2024-04-19T23:00:17.846632+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: cluster 2024-04-19T23:00:17.854737+0000 mon.a (mon.0) 3144 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[21528]: audit 2024-04-19T23:00:17.856383+0000 mon.a (mon.0) 3145 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: audit 2024-04-19T23:00:16.843928+0000 mon.a (mon.0) 3140 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: cluster 2024-04-19T23:00:16.852138+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: audit 2024-04-19T23:00:16.856362+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: audit 2024-04-19T23:00:17.846632+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: cluster 2024-04-19T23:00:17.854737+0000 mon.a (mon.0) 3144 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-04-19T23:00:18.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:17 smithi113 bash[28910]: audit 2024-04-19T23:00:17.856383+0000 mon.a (mon.0) 3145 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:00:18.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: audit 2024-04-19T23:00:16.843928+0000 mon.a (mon.0) 3140 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:00:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: cluster 2024-04-19T23:00:16.852138+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-04-19T23:00:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: audit 2024-04-19T23:00:16.856362+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:00:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: audit 2024-04-19T23:00:17.846632+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:00:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: cluster 2024-04-19T23:00:17.854737+0000 mon.a (mon.0) 3144 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-04-19T23:00:18.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:17 smithi178 bash[23441]: audit 2024-04-19T23:00:17.856383+0000 mon.a (mon.0) 3145 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:00:19.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[28910]: cluster 2024-04-19T23:00:18.138998+0000 mgr.y (mgr.24389) 585 : cluster 0 pgmap v936: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:19.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[28910]: cluster 2024-04-19T23:00:18.846999+0000 mon.a (mon.0) 3146 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:19.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[28910]: audit 2024-04-19T23:00:18.849303+0000 mon.a (mon.0) 3147 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:00:19.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[28910]: cluster 2024-04-19T23:00:18.857391+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-04-19T23:00:19.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[28910]: audit 2024-04-19T23:00:18.862835+0000 mon.a (mon.0) 3149 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-19T23:00:19.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[21528]: cluster 2024-04-19T23:00:18.138998+0000 mgr.y (mgr.24389) 585 : cluster 0 pgmap v936: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:19.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[21528]: cluster 2024-04-19T23:00:18.846999+0000 mon.a (mon.0) 3146 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:19.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[21528]: audit 2024-04-19T23:00:18.849303+0000 mon.a (mon.0) 3147 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:00:19.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[21528]: cluster 2024-04-19T23:00:18.857391+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-04-19T23:00:19.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:18 smithi113 bash[21528]: audit 2024-04-19T23:00:18.862835+0000 mon.a (mon.0) 3149 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-19T23:00:19.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:18 smithi178 bash[23441]: cluster 2024-04-19T23:00:18.138998+0000 mgr.y (mgr.24389) 585 : cluster 0 pgmap v936: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:19.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:18 smithi178 bash[23441]: cluster 2024-04-19T23:00:18.846999+0000 mon.a (mon.0) 3146 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:19.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:18 smithi178 bash[23441]: audit 2024-04-19T23:00:18.849303+0000 mon.a (mon.0) 3147 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:00:19.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:18 smithi178 bash[23441]: cluster 2024-04-19T23:00:18.857391+0000 mon.a (mon.0) 3148 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-04-19T23:00:19.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:18 smithi178 bash[23441]: audit 2024-04-19T23:00:18.862835+0000 mon.a (mon.0) 3149 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-04-19T23:00:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[21528]: audit 2024-04-19T23:00:19.527304+0000 mon.a (mon.0) 3150 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[21528]: audit 2024-04-19T23:00:19.529710+0000 mon.a (mon.0) 3151 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[21528]: audit 2024-04-19T23:00:19.852106+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-19T23:00:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[21528]: cluster 2024-04-19T23:00:19.859314+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-04-19T23:00:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[21528]: audit 2024-04-19T23:00:19.928636+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[28910]: audit 2024-04-19T23:00:19.527304+0000 mon.a (mon.0) 3150 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[28910]: audit 2024-04-19T23:00:19.529710+0000 mon.a (mon.0) 3151 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[28910]: audit 2024-04-19T23:00:19.852106+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-19T23:00:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[28910]: cluster 2024-04-19T23:00:19.859314+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-04-19T23:00:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:20 smithi113 bash[28910]: audit 2024-04-19T23:00:19.928636+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:20 smithi178 bash[23441]: audit 2024-04-19T23:00:19.527304+0000 mon.a (mon.0) 3150 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:00:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:20 smithi178 bash[23441]: audit 2024-04-19T23:00:19.529710+0000 mon.a (mon.0) 3151 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:20 smithi178 bash[23441]: audit 2024-04-19T23:00:19.852106+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-04-19T23:00:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:20 smithi178 bash[23441]: cluster 2024-04-19T23:00:19.859314+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-04-19T23:00:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:20 smithi178 bash[23441]: audit 2024-04-19T23:00:19.928636+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[21528]: cluster 2024-04-19T23:00:20.139890+0000 mgr.y (mgr.24389) 586 : cluster 0 pgmap v939: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[21528]: audit 2024-04-19T23:00:20.855139+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[21528]: cluster 2024-04-19T23:00:20.862754+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-04-19T23:00:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[21528]: audit 2024-04-19T23:00:20.865703+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[21528]: cluster 2024-04-19T23:00:21.248627+0000 mon.a (mon.0) 3158 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[28910]: cluster 2024-04-19T23:00:20.139890+0000 mgr.y (mgr.24389) 586 : cluster 0 pgmap v939: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[28910]: audit 2024-04-19T23:00:20.855139+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[28910]: cluster 2024-04-19T23:00:20.862754+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-04-19T23:00:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[28910]: audit 2024-04-19T23:00:20.865703+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:21 smithi113 bash[28910]: cluster 2024-04-19T23:00:21.248627+0000 mon.a (mon.0) 3158 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:21 smithi178 bash[23441]: cluster 2024-04-19T23:00:20.139890+0000 mgr.y (mgr.24389) 586 : cluster 0 pgmap v939: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:21 smithi178 bash[23441]: audit 2024-04-19T23:00:20.855139+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:21 smithi178 bash[23441]: cluster 2024-04-19T23:00:20.862754+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-04-19T23:00:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:21 smithi178 bash[23441]: audit 2024-04-19T23:00:20.865703+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]: dispatch 2024-04-19T23:00:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:21 smithi178 bash[23441]: cluster 2024-04-19T23:00:21.248627+0000 mon.a (mon.0) 3158 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:23.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[21528]: audit 2024-04-19T23:00:21.857778+0000 mon.a (mon.0) 3159 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:23.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[21528]: cluster 2024-04-19T23:00:21.864686+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-04-19T23:00:23.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[21528]: cluster 2024-04-19T23:00:22.140690+0000 mgr.y (mgr.24389) 587 : cluster 0 pgmap v942: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:23.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[28910]: audit 2024-04-19T23:00:21.857778+0000 mon.a (mon.0) 3159 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:23.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[28910]: cluster 2024-04-19T23:00:21.864686+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-04-19T23:00:23.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:22 smithi113 bash[28910]: cluster 2024-04-19T23:00:22.140690+0000 mgr.y (mgr.24389) 587 : cluster 0 pgmap v942: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:23.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:22 smithi178 bash[23441]: audit 2024-04-19T23:00:21.857778+0000 mon.a (mon.0) 3159 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-109", "tierpool": "test-rados-api-smithi113-63998-109-cache"}]': finished 2024-04-19T23:00:23.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:22 smithi178 bash[23441]: cluster 2024-04-19T23:00:21.864686+0000 mon.a (mon.0) 3160 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-04-19T23:00:23.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:22 smithi178 bash[23441]: cluster 2024-04-19T23:00:22.140690+0000 mgr.y (mgr.24389) 587 : cluster 0 pgmap v942: 212 pgs: 212 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:24.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:23 smithi113 bash[28910]: cluster 2024-04-19T23:00:22.878120+0000 mon.a (mon.0) 3161 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-04-19T23:00:24.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:23 smithi113 bash[21528]: cluster 2024-04-19T23:00:22.878120+0000 mon.a (mon.0) 3161 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-04-19T23:00:24.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:23 smithi178 bash[23441]: cluster 2024-04-19T23:00:22.878120+0000 mon.a (mon.0) 3161 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-04-19T23:00:25.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: cluster 2024-04-19T23:00:23.877576+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-04-19T23:00:25.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: audit 2024-04-19T23:00:23.880856+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: cluster 2024-04-19T23:00:24.141461+0000 mgr.y (mgr.24389) 588 : cluster 0 pgmap v945: 172 pgs: 172 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:25.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: audit 2024-04-19T23:00:24.872606+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: cluster 2024-04-19T23:00:24.880013+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[21528]: audit 2024-04-19T23:00:24.881363+0000 mon.a (mon.0) 3166 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: cluster 2024-04-19T23:00:23.877576+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: audit 2024-04-19T23:00:23.880856+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: cluster 2024-04-19T23:00:24.141461+0000 mgr.y (mgr.24389) 588 : cluster 0 pgmap v945: 172 pgs: 172 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: audit 2024-04-19T23:00:24.872606+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: cluster 2024-04-19T23:00:24.880013+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-04-19T23:00:25.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:24 smithi113 bash[28910]: audit 2024-04-19T23:00:24.881363+0000 mon.a (mon.0) 3166 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: cluster 2024-04-19T23:00:23.877576+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: audit 2024-04-19T23:00:23.880856+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: cluster 2024-04-19T23:00:24.141461+0000 mgr.y (mgr.24389) 588 : cluster 0 pgmap v945: 172 pgs: 172 active+clean; 583 KiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: audit 2024-04-19T23:00:24.872606+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: cluster 2024-04-19T23:00:24.880013+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-04-19T23:00:25.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:24 smithi178 bash[23441]: audit 2024-04-19T23:00:24.881363+0000 mon.a (mon.0) 3166 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]: dispatch 2024-04-19T23:00:25.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[28910]: audit 2024-04-19T23:00:25.377366+0000 mgr.y (mgr.24389) 589 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[28910]: audit 2024-04-19T23:00:25.875984+0000 mon.a (mon.0) 3167 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[28910]: cluster 2024-04-19T23:00:25.884802+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[21528]: audit 2024-04-19T23:00:25.377366+0000 mgr.y (mgr.24389) 589 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[21528]: audit 2024-04-19T23:00:25.875984+0000 mon.a (mon.0) 3167 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:26.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:25 smithi113 bash[21528]: cluster 2024-04-19T23:00:25.884802+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-04-19T23:00:26.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:25 smithi178 bash[23441]: audit 2024-04-19T23:00:25.377366+0000 mgr.y (mgr.24389) 589 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:26.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:25 smithi178 bash[23441]: audit 2024-04-19T23:00:25.875984+0000 mon.a (mon.0) 3167 : audit 1 from='client.? 172.21.15.113:0/3573830841' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-109"}]': finished 2024-04-19T23:00:26.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:25 smithi178 bash[23441]: cluster 2024-04-19T23:00:25.884802+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-04-19T23:00:27.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:26 smithi113 bash[28910]: cluster 2024-04-19T23:00:26.142311+0000 mgr.y (mgr.24389) 590 : cluster 0 pgmap v948: 172 pgs: 172 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:27.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:26 smithi113 bash[28910]: cluster 2024-04-19T23:00:26.249741+0000 mon.a (mon.0) 3169 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:27.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:26 smithi113 bash[21528]: cluster 2024-04-19T23:00:26.142311+0000 mgr.y (mgr.24389) 590 : cluster 0 pgmap v948: 172 pgs: 172 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:27.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:26 smithi113 bash[21528]: cluster 2024-04-19T23:00:26.249741+0000 mon.a (mon.0) 3169 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:27.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:26 smithi178 bash[23441]: cluster 2024-04-19T23:00:26.142311+0000 mgr.y (mgr.24389) 590 : cluster 0 pgmap v948: 172 pgs: 172 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:27.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:26 smithi178 bash[23441]: cluster 2024-04-19T23:00:26.249741+0000 mon.a (mon.0) 3169 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:27.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:28.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:27 smithi113 bash[28910]: cluster 2024-04-19T23:00:26.913161+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-04-19T23:00:28.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:27 smithi113 bash[28910]: audit 2024-04-19T23:00:26.916029+0000 mon.a (mon.0) 3171 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:28.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:27 smithi113 bash[21528]: cluster 2024-04-19T23:00:26.913161+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-04-19T23:00:28.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:27 smithi113 bash[21528]: audit 2024-04-19T23:00:26.916029+0000 mon.a (mon.0) 3171 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:27 smithi178 bash[23441]: cluster 2024-04-19T23:00:26.913161+0000 mon.a (mon.0) 3170 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-04-19T23:00:28.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:27 smithi178 bash[23441]: audit 2024-04-19T23:00:26.916029+0000 mon.a (mon.0) 3171 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:29.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[21528]: audit 2024-04-19T23:00:27.915780+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:29.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[21528]: cluster 2024-04-19T23:00:27.922684+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-04-19T23:00:29.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[21528]: audit 2024-04-19T23:00:27.924646+0000 mon.a (mon.0) 3174 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:29.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[21528]: cluster 2024-04-19T23:00:28.143181+0000 mgr.y (mgr.24389) 591 : cluster 0 pgmap v951: 164 pgs: 164 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:29.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[28910]: audit 2024-04-19T23:00:27.915780+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[28910]: cluster 2024-04-19T23:00:27.922684+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-04-19T23:00:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[28910]: audit 2024-04-19T23:00:27.924646+0000 mon.a (mon.0) 3174 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:28 smithi113 bash[28910]: cluster 2024-04-19T23:00:28.143181+0000 mgr.y (mgr.24389) 591 : cluster 0 pgmap v951: 164 pgs: 164 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:29.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:28 smithi178 bash[23441]: audit 2024-04-19T23:00:27.915780+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:28 smithi178 bash[23441]: cluster 2024-04-19T23:00:27.922684+0000 mon.a (mon.0) 3173 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-04-19T23:00:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:28 smithi178 bash[23441]: audit 2024-04-19T23:00:27.924646+0000 mon.a (mon.0) 3174 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]: dispatch 2024-04-19T23:00:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:28 smithi178 bash[23441]: cluster 2024-04-19T23:00:28.143181+0000 mgr.y (mgr.24389) 591 : cluster 0 pgmap v951: 164 pgs: 164 active+clean; 583 KiB data, 608 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.926943+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: cluster 2024-04-19T23:00:28.937523+0000 mon.a (mon.0) 3176 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-04-19T23:00:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.982236+0000 mon.c (mon.2) 821 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.982724+0000 mon.a (mon.0) 3177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.983547+0000 mon.c (mon.2) 822 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.983872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.984443+0000 mon.c (mon.2) 823 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[21528]: audit 2024-04-19T23:00:28.984744+0000 mon.a (mon.0) 3179 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.926943+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: cluster 2024-04-19T23:00:28.937523+0000 mon.a (mon.0) 3176 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.982236+0000 mon.c (mon.2) 821 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.982724+0000 mon.a (mon.0) 3177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.983547+0000 mon.c (mon.2) 822 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.983872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.984443+0000 mon.c (mon.2) 823 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:29 smithi113 bash[28910]: audit 2024-04-19T23:00:28.984744+0000 mon.a (mon.0) 3179 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.926943+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.113:0/362226896' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi113-63998-104"}]': finished 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: cluster 2024-04-19T23:00:28.937523+0000 mon.a (mon.0) 3176 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.982236+0000 mon.c (mon.2) 821 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.982724+0000 mon.a (mon.0) 3177 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.983547+0000 mon.c (mon.2) 822 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.983872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.984443+0000 mon.c (mon.2) 823 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:29 smithi178 bash[23441]: audit 2024-04-19T23:00:28.984744+0000 mon.a (mon.0) 3179 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-19T23:00:31.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[28910]: audit 2024-04-19T23:00:29.929586+0000 mon.a (mon.0) 3180 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:31.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[28910]: cluster 2024-04-19T23:00:29.936614+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[28910]: audit 2024-04-19T23:00:29.938941+0000 mon.c (mon.2) 824 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[28910]: audit 2024-04-19T23:00:29.947690+0000 mon.a (mon.0) 3182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[28910]: cluster 2024-04-19T23:00:30.143983+0000 mgr.y (mgr.24389) 592 : cluster 0 pgmap v954: 164 pgs: 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[21528]: audit 2024-04-19T23:00:29.929586+0000 mon.a (mon.0) 3180 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[21528]: cluster 2024-04-19T23:00:29.936614+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[21528]: audit 2024-04-19T23:00:29.938941+0000 mon.c (mon.2) 824 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[21528]: audit 2024-04-19T23:00:29.947690+0000 mon.a (mon.0) 3182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:31 smithi113 bash[21528]: cluster 2024-04-19T23:00:30.143983+0000 mgr.y (mgr.24389) 592 : cluster 0 pgmap v954: 164 pgs: 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:31 smithi178 bash[23441]: audit 2024-04-19T23:00:29.929586+0000 mon.a (mon.0) 3180 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi113-63998-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-04-19T23:00:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:31 smithi178 bash[23441]: cluster 2024-04-19T23:00:29.936614+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-04-19T23:00:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:31 smithi178 bash[23441]: audit 2024-04-19T23:00:29.938941+0000 mon.c (mon.2) 824 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:31 smithi178 bash[23441]: audit 2024-04-19T23:00:29.947690+0000 mon.a (mon.0) 3182 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:31 smithi178 bash[23441]: cluster 2024-04-19T23:00:30.143983+0000 mgr.y (mgr.24389) 592 : cluster 0 pgmap v954: 164 pgs: 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-19T23:00:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[28910]: cluster 2024-04-19T23:00:31.397386+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-04-19T23:00:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[28910]: cluster 2024-04-19T23:00:31.398442+0000 mon.a (mon.0) 3184 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[28910]: audit 2024-04-19T23:00:31.947144+0000 mon.a (mon.0) 3185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:32.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[28910]: cluster 2024-04-19T23:00:31.955212+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-04-19T23:00:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[21528]: cluster 2024-04-19T23:00:31.397386+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-04-19T23:00:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[21528]: cluster 2024-04-19T23:00:31.398442+0000 mon.a (mon.0) 3184 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[21528]: audit 2024-04-19T23:00:31.947144+0000 mon.a (mon.0) 3185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:32 smithi113 bash[21528]: cluster 2024-04-19T23:00:31.955212+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-04-19T23:00:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:32 smithi178 bash[23441]: cluster 2024-04-19T23:00:31.397386+0000 mon.a (mon.0) 3183 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-04-19T23:00:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:32 smithi178 bash[23441]: cluster 2024-04-19T23:00:31.398442+0000 mon.a (mon.0) 3184 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:32 smithi178 bash[23441]: audit 2024-04-19T23:00:31.947144+0000 mon.a (mon.0) 3185 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi113-63998-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:32 smithi178 bash[23441]: cluster 2024-04-19T23:00:31.955212+0000 mon.a (mon.0) 3186 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-04-19T23:00:33.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[28910]: cluster 2024-04-19T23:00:32.144858+0000 mgr.y (mgr.24389) 593 : cluster 0 pgmap v957: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:33.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[28910]: cluster 2024-04-19T23:00:32.964840+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-04-19T23:00:33.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[28910]: audit 2024-04-19T23:00:32.973534+0000 mon.c (mon.2) 825 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:33.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[28910]: audit 2024-04-19T23:00:32.981533+0000 mon.a (mon.0) 3188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[21528]: cluster 2024-04-19T23:00:32.144858+0000 mgr.y (mgr.24389) 593 : cluster 0 pgmap v957: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[21528]: cluster 2024-04-19T23:00:32.964840+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-04-19T23:00:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[21528]: audit 2024-04-19T23:00:32.973534+0000 mon.c (mon.2) 825 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:33 smithi113 bash[21528]: audit 2024-04-19T23:00:32.981533+0000 mon.a (mon.0) 3188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:33.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:33 smithi178 bash[23441]: cluster 2024-04-19T23:00:32.144858+0000 mgr.y (mgr.24389) 593 : cluster 0 pgmap v957: 172 pgs: 8 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:00:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:33 smithi178 bash[23441]: cluster 2024-04-19T23:00:32.964840+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-04-19T23:00:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:33 smithi178 bash[23441]: audit 2024-04-19T23:00:32.973534+0000 mon.c (mon.2) 825 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:33 smithi178 bash[23441]: audit 2024-04-19T23:00:32.981533+0000 mon.a (mon.0) 3188 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:35.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: audit 2024-04-19T23:00:33.960301+0000 mon.a (mon.0) 3189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:35.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: cluster 2024-04-19T23:00:33.968121+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-04-19T23:00:35.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: audit 2024-04-19T23:00:34.012852+0000 mon.c (mon.2) 826 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: audit 2024-04-19T23:00:34.013454+0000 mon.a (mon.0) 3191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: cluster 2024-04-19T23:00:34.145683+0000 mgr.y (mgr.24389) 594 : cluster 0 pgmap v960: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[28910]: audit 2024-04-19T23:00:34.562476+0000 mon.a (mon.0) 3192 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: audit 2024-04-19T23:00:33.960301+0000 mon.a (mon.0) 3189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: cluster 2024-04-19T23:00:33.968121+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: audit 2024-04-19T23:00:34.012852+0000 mon.c (mon.2) 826 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: audit 2024-04-19T23:00:34.013454+0000 mon.a (mon.0) 3191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: cluster 2024-04-19T23:00:34.145683+0000 mgr.y (mgr.24389) 594 : cluster 0 pgmap v960: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:35.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:34 smithi113 bash[21528]: audit 2024-04-19T23:00:34.562476+0000 mon.a (mon.0) 3192 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: audit 2024-04-19T23:00:33.960301+0000 mon.a (mon.0) 3189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: cluster 2024-04-19T23:00:33.968121+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: audit 2024-04-19T23:00:34.012852+0000 mon.c (mon.2) 826 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: audit 2024-04-19T23:00:34.013454+0000 mon.a (mon.0) 3191 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: cluster 2024-04-19T23:00:34.145683+0000 mgr.y (mgr.24389) 594 : cluster 0 pgmap v960: 204 pgs: 40 unknown, 164 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:35.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:34 smithi178 bash[23441]: audit 2024-04-19T23:00:34.562476+0000 mon.a (mon.0) 3192 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:35.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:36.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[28910]: audit 2024-04-19T23:00:34.971670+0000 mon.a (mon.0) 3193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:36.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[28910]: cluster 2024-04-19T23:00:34.983331+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-04-19T23:00:36.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[28910]: audit 2024-04-19T23:00:34.989320+0000 mon.c (mon.2) 827 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[28910]: audit 2024-04-19T23:00:34.990132+0000 mon.a (mon.0) 3195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[28910]: audit 2024-04-19T23:00:35.388829+0000 mgr.y (mgr.24389) 595 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:36.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[21528]: audit 2024-04-19T23:00:34.971670+0000 mon.a (mon.0) 3193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:36.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[21528]: cluster 2024-04-19T23:00:34.983331+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-04-19T23:00:36.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[21528]: audit 2024-04-19T23:00:34.989320+0000 mon.c (mon.2) 827 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[21528]: audit 2024-04-19T23:00:34.990132+0000 mon.a (mon.0) 3195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:35 smithi113 bash[21528]: audit 2024-04-19T23:00:35.388829+0000 mgr.y (mgr.24389) 595 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:36.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[23441]: audit 2024-04-19T23:00:34.971670+0000 mon.a (mon.0) 3193 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:36.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[23441]: cluster 2024-04-19T23:00:34.983331+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-04-19T23:00:36.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[23441]: audit 2024-04-19T23:00:34.989320+0000 mon.c (mon.2) 827 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[23441]: audit 2024-04-19T23:00:34.990132+0000 mon.a (mon.0) 3195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:36.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:35 smithi178 bash[23441]: audit 2024-04-19T23:00:35.388829+0000 mgr.y (mgr.24389) 595 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:37.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:36 smithi113 bash[21528]: audit 2024-04-19T23:00:35.985274+0000 mon.a (mon.0) 3196 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:37.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:36 smithi113 bash[21528]: cluster 2024-04-19T23:00:35.992730+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-04-19T23:00:37.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: audit 2024-04-19T23:00:36.055301+0000 mon.c (mon.2) 828 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: audit 2024-04-19T23:00:36.056105+0000 mon.a (mon.0) 3198 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: cluster 2024-04-19T23:00:36.146537+0000 mgr.y (mgr.24389) 596 : cluster 0 pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: cluster 2024-04-19T23:00:36.400094+0000 mon.a (mon.0) 3199 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:35.985274+0000 mon.a (mon.0) 3196 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: cluster 2024-04-19T23:00:35.992730+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:36.055301+0000 mon.c (mon.2) 828 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:36.056105+0000 mon.a (mon.0) 3198 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: cluster 2024-04-19T23:00:36.146537+0000 mgr.y (mgr.24389) 596 : cluster 0 pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:37.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: cluster 2024-04-19T23:00:36.400094+0000 mon.a (mon.0) 3199 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: audit 2024-04-19T23:00:35.985274+0000 mon.a (mon.0) 3196 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: cluster 2024-04-19T23:00:35.992730+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: audit 2024-04-19T23:00:36.055301+0000 mon.c (mon.2) 828 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: audit 2024-04-19T23:00:36.056105+0000 mon.a (mon.0) 3198 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: cluster 2024-04-19T23:00:36.146537+0000 mgr.y (mgr.24389) 596 : cluster 0 pgmap v963: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:37.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:36 smithi178 bash[23441]: cluster 2024-04-19T23:00:36.400094+0000 mon.a (mon.0) 3199 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:37.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:38.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: audit 2024-04-19T23:00:36.995565+0000 mon.a (mon.0) 3200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:38.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: cluster 2024-04-19T23:00:37.007283+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-04-19T23:00:38.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: audit 2024-04-19T23:00:37.010516+0000 mon.c (mon.2) 829 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:38.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[21528]: audit 2024-04-19T23:00:37.012126+0000 mon.a (mon.0) 3202 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:38.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:36.995565+0000 mon.a (mon.0) 3200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:38.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: cluster 2024-04-19T23:00:37.007283+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-04-19T23:00:38.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:37.010516+0000 mon.c (mon.2) 829 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:38.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:37 smithi113 bash[28910]: audit 2024-04-19T23:00:37.012126+0000 mon.a (mon.0) 3202 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:38.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:37 smithi178 bash[23441]: audit 2024-04-19T23:00:36.995565+0000 mon.a (mon.0) 3200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:38.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:37 smithi178 bash[23441]: cluster 2024-04-19T23:00:37.007283+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-04-19T23:00:38.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:37 smithi178 bash[23441]: audit 2024-04-19T23:00:37.010516+0000 mon.c (mon.2) 829 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:38.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:37 smithi178 bash[23441]: audit 2024-04-19T23:00:37.012126+0000 mon.a (mon.0) 3202 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]: dispatch 2024-04-19T23:00:39.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[21528]: audit 2024-04-19T23:00:38.006709+0000 mon.a (mon.0) 3203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:39.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[21528]: cluster 2024-04-19T23:00:38.014117+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-04-19T23:00:39.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[21528]: cluster 2024-04-19T23:00:38.147319+0000 mgr.y (mgr.24389) 597 : cluster 0 pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:39.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[28910]: audit 2024-04-19T23:00:38.006709+0000 mon.a (mon.0) 3203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:39.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[28910]: cluster 2024-04-19T23:00:38.014117+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-04-19T23:00:39.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:39 smithi113 bash[28910]: cluster 2024-04-19T23:00:38.147319+0000 mgr.y (mgr.24389) 597 : cluster 0 pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:39.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:39 smithi178 bash[23441]: audit 2024-04-19T23:00:38.006709+0000 mon.a (mon.0) 3203 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-112"}]': finished 2024-04-19T23:00:39.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:39 smithi178 bash[23441]: cluster 2024-04-19T23:00:38.014117+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-04-19T23:00:39.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:39 smithi178 bash[23441]: cluster 2024-04-19T23:00:38.147319+0000 mgr.y (mgr.24389) 597 : cluster 0 pgmap v966: 204 pgs: 204 active+clean; 583 KiB data, 609 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:00:40.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:40 smithi113 bash[21528]: cluster 2024-04-19T23:00:39.025488+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-04-19T23:00:40.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:40 smithi113 bash[28910]: cluster 2024-04-19T23:00:39.025488+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-04-19T23:00:40.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:40 smithi178 bash[23441]: cluster 2024-04-19T23:00:39.025488+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-04-19T23:00:41.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[28910]: cluster 2024-04-19T23:00:40.040386+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-04-19T23:00:41.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[28910]: audit 2024-04-19T23:00:40.046647+0000 mon.c (mon.2) 830 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[28910]: audit 2024-04-19T23:00:40.049831+0000 mon.a (mon.0) 3207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[28910]: cluster 2024-04-19T23:00:40.148223+0000 mgr.y (mgr.24389) 598 : cluster 0 pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:41.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[21528]: cluster 2024-04-19T23:00:40.040386+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-04-19T23:00:41.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[21528]: audit 2024-04-19T23:00:40.046647+0000 mon.c (mon.2) 830 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[21528]: audit 2024-04-19T23:00:40.049831+0000 mon.a (mon.0) 3207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:41 smithi113 bash[21528]: cluster 2024-04-19T23:00:40.148223+0000 mgr.y (mgr.24389) 598 : cluster 0 pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:41.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:41 smithi178 bash[23441]: cluster 2024-04-19T23:00:40.040386+0000 mon.a (mon.0) 3206 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-04-19T23:00:41.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:41 smithi178 bash[23441]: audit 2024-04-19T23:00:40.046647+0000 mon.c (mon.2) 830 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:41 smithi178 bash[23441]: audit 2024-04-19T23:00:40.049831+0000 mon.a (mon.0) 3207 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:41.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:41 smithi178 bash[23441]: cluster 2024-04-19T23:00:40.148223+0000 mgr.y (mgr.24389) 598 : cluster 0 pgmap v969: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:42.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[28910]: audit 2024-04-19T23:00:41.043329+0000 mon.a (mon.0) 3208 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:42.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[28910]: cluster 2024-04-19T23:00:41.055826+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-04-19T23:00:42.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[28910]: audit 2024-04-19T23:00:41.091310+0000 mon.c (mon.2) 831 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[28910]: audit 2024-04-19T23:00:41.096790+0000 mon.a (mon.0) 3210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[28910]: cluster 2024-04-19T23:00:41.401472+0000 mon.a (mon.0) 3211 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[21528]: audit 2024-04-19T23:00:41.043329+0000 mon.a (mon.0) 3208 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[21528]: cluster 2024-04-19T23:00:41.055826+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[21528]: audit 2024-04-19T23:00:41.091310+0000 mon.c (mon.2) 831 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[21528]: audit 2024-04-19T23:00:41.096790+0000 mon.a (mon.0) 3210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:42 smithi113 bash[21528]: cluster 2024-04-19T23:00:41.401472+0000 mon.a (mon.0) 3211 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:42.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:42 smithi178 bash[23441]: audit 2024-04-19T23:00:41.043329+0000 mon.a (mon.0) 3208 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:42.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:42 smithi178 bash[23441]: cluster 2024-04-19T23:00:41.055826+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-04-19T23:00:42.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:42 smithi178 bash[23441]: audit 2024-04-19T23:00:41.091310+0000 mon.c (mon.2) 831 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:42 smithi178 bash[23441]: audit 2024-04-19T23:00:41.096790+0000 mon.a (mon.0) 3210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:42.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:42 smithi178 bash[23441]: cluster 2024-04-19T23:00:41.401472+0000 mon.a (mon.0) 3211 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:43.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[28910]: audit 2024-04-19T23:00:42.054104+0000 mon.a (mon.0) 3212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:43.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[28910]: cluster 2024-04-19T23:00:42.061194+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[28910]: audit 2024-04-19T23:00:42.063074+0000 mon.c (mon.2) 832 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[28910]: audit 2024-04-19T23:00:42.064953+0000 mon.a (mon.0) 3214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[28910]: cluster 2024-04-19T23:00:42.149101+0000 mgr.y (mgr.24389) 599 : cluster 0 pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[21528]: audit 2024-04-19T23:00:42.054104+0000 mon.a (mon.0) 3212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[21528]: cluster 2024-04-19T23:00:42.061194+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[21528]: audit 2024-04-19T23:00:42.063074+0000 mon.c (mon.2) 832 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[21528]: audit 2024-04-19T23:00:42.064953+0000 mon.a (mon.0) 3214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:43 smithi113 bash[21528]: cluster 2024-04-19T23:00:42.149101+0000 mgr.y (mgr.24389) 599 : cluster 0 pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:43.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:43 smithi178 bash[23441]: audit 2024-04-19T23:00:42.054104+0000 mon.a (mon.0) 3212 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:43.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:43 smithi178 bash[23441]: cluster 2024-04-19T23:00:42.061194+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-04-19T23:00:43.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:43 smithi178 bash[23441]: audit 2024-04-19T23:00:42.063074+0000 mon.c (mon.2) 832 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:43 smithi178 bash[23441]: audit 2024-04-19T23:00:42.064953+0000 mon.a (mon.0) 3214 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:43.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:43 smithi178 bash[23441]: cluster 2024-04-19T23:00:42.149101+0000 mgr.y (mgr.24389) 599 : cluster 0 pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-04-19T23:00:44.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[21528]: audit 2024-04-19T23:00:43.063655+0000 mon.a (mon.0) 3215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:44.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[21528]: cluster 2024-04-19T23:00:43.073374+0000 mon.a (mon.0) 3216 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-04-19T23:00:44.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[21528]: audit 2024-04-19T23:00:43.074923+0000 mon.c (mon.2) 833 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:44.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[21528]: audit 2024-04-19T23:00:43.078717+0000 mon.a (mon.0) 3217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:44.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[28910]: audit 2024-04-19T23:00:43.063655+0000 mon.a (mon.0) 3215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:44.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[28910]: cluster 2024-04-19T23:00:43.073374+0000 mon.a (mon.0) 3216 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-04-19T23:00:44.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[28910]: audit 2024-04-19T23:00:43.074923+0000 mon.c (mon.2) 833 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:44.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:44 smithi113 bash[28910]: audit 2024-04-19T23:00:43.078717+0000 mon.a (mon.0) 3217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:44.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:44 smithi178 bash[23441]: audit 2024-04-19T23:00:43.063655+0000 mon.a (mon.0) 3215 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:44.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:44 smithi178 bash[23441]: cluster 2024-04-19T23:00:43.073374+0000 mon.a (mon.0) 3216 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-04-19T23:00:44.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:44 smithi178 bash[23441]: audit 2024-04-19T23:00:43.074923+0000 mon.c (mon.2) 833 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:44.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:44 smithi178 bash[23441]: audit 2024-04-19T23:00:43.078717+0000 mon.a (mon.0) 3217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]: dispatch 2024-04-19T23:00:45.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: cluster 2024-04-19T23:00:44.063987+0000 mon.a (mon.0) 3218 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:45.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: audit 2024-04-19T23:00:44.066296+0000 mon.a (mon.0) 3219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]': finished 2024-04-19T23:00:45.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: cluster 2024-04-19T23:00:44.076650+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-04-19T23:00:45.400 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: cluster 2024-04-19T23:00:44.149872+0000 mgr.y (mgr.24389) 600 : cluster 0 pgmap v975: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:45.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: audit 2024-04-19T23:00:44.179992+0000 mon.c (mon.2) 834 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.401 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[23441]: audit 2024-04-19T23:00:44.180700+0000 mon.a (mon.0) 3221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: cluster 2024-04-19T23:00:44.063987+0000 mon.a (mon.0) 3218 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:45.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: audit 2024-04-19T23:00:44.066296+0000 mon.a (mon.0) 3219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]': finished 2024-04-19T23:00:45.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: cluster 2024-04-19T23:00:44.076650+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: cluster 2024-04-19T23:00:44.149872+0000 mgr.y (mgr.24389) 600 : cluster 0 pgmap v975: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: audit 2024-04-19T23:00:44.179992+0000 mon.c (mon.2) 834 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[28910]: audit 2024-04-19T23:00:44.180700+0000 mon.a (mon.0) 3221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: cluster 2024-04-19T23:00:44.063987+0000 mon.a (mon.0) 3218 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: audit 2024-04-19T23:00:44.066296+0000 mon.a (mon.0) 3219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-114", "mode": "writeback"}]': finished 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: cluster 2024-04-19T23:00:44.076650+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: cluster 2024-04-19T23:00:44.149872+0000 mgr.y (mgr.24389) 600 : cluster 0 pgmap v975: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 610 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: audit 2024-04-19T23:00:44.179992+0000 mon.c (mon.2) 834 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:45 smithi113 bash[21528]: audit 2024-04-19T23:00:44.180700+0000 mon.a (mon.0) 3221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:00:45.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:46.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: audit 2024-04-19T23:00:45.083896+0000 mon.a (mon.0) 3222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:46.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: cluster 2024-04-19T23:00:45.092850+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: audit 2024-04-19T23:00:45.093591+0000 mon.c (mon.2) 835 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: audit 2024-04-19T23:00:45.095535+0000 mon.a (mon.0) 3224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: audit 2024-04-19T23:00:45.399238+0000 mgr.y (mgr.24389) 601 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: cluster 2024-04-19T23:00:46.084297+0000 mon.a (mon.0) 3225 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: audit 2024-04-19T23:00:46.086620+0000 mon.a (mon.0) 3226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[21528]: cluster 2024-04-19T23:00:46.095636+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: audit 2024-04-19T23:00:45.083896+0000 mon.a (mon.0) 3222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: cluster 2024-04-19T23:00:45.092850+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: audit 2024-04-19T23:00:45.093591+0000 mon.c (mon.2) 835 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: audit 2024-04-19T23:00:45.095535+0000 mon.a (mon.0) 3224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: audit 2024-04-19T23:00:45.399238+0000 mgr.y (mgr.24389) 601 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:46.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: cluster 2024-04-19T23:00:46.084297+0000 mon.a (mon.0) 3225 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:46.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: audit 2024-04-19T23:00:46.086620+0000 mon.a (mon.0) 3226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:46.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:46 smithi113 bash[28910]: cluster 2024-04-19T23:00:46.095636+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: audit 2024-04-19T23:00:45.083896+0000 mon.a (mon.0) 3222 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: cluster 2024-04-19T23:00:45.092850+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: audit 2024-04-19T23:00:45.093591+0000 mon.c (mon.2) 835 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: audit 2024-04-19T23:00:45.095535+0000 mon.a (mon.0) 3224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]: dispatch 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: audit 2024-04-19T23:00:45.399238+0000 mgr.y (mgr.24389) 601 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: cluster 2024-04-19T23:00:46.084297+0000 mon.a (mon.0) 3225 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: audit 2024-04-19T23:00:46.086620+0000 mon.a (mon.0) 3226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-114"}]': finished 2024-04-19T23:00:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:46 smithi178 bash[23441]: cluster 2024-04-19T23:00:46.095636+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-04-19T23:00:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:47 smithi113 bash[28910]: cluster 2024-04-19T23:00:46.150740+0000 mgr.y (mgr.24389) 602 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:00:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:47 smithi113 bash[28910]: cluster 2024-04-19T23:00:46.402868+0000 mon.a (mon.0) 3228 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:47 smithi113 bash[21528]: cluster 2024-04-19T23:00:46.150740+0000 mgr.y (mgr.24389) 602 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:00:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:47 smithi113 bash[21528]: cluster 2024-04-19T23:00:46.402868+0000 mon.a (mon.0) 3228 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:47 smithi178 bash[23441]: cluster 2024-04-19T23:00:46.150740+0000 mgr.y (mgr.24389) 602 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:00:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:47 smithi178 bash[23441]: cluster 2024-04-19T23:00:46.402868+0000 mon.a (mon.0) 3228 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:00:47.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:48.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:48 smithi113 bash[21528]: cluster 2024-04-19T23:00:47.120330+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-04-19T23:00:48.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:48 smithi113 bash[28910]: cluster 2024-04-19T23:00:47.120330+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-04-19T23:00:48.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:48 smithi178 bash[23441]: cluster 2024-04-19T23:00:47.120330+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-04-19T23:00:49.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: cluster 2024-04-19T23:00:48.128189+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: audit 2024-04-19T23:00:48.131223+0000 mon.c (mon.2) 836 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: audit 2024-04-19T23:00:48.135785+0000 mon.a (mon.0) 3231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: cluster 2024-04-19T23:00:48.151659+0000 mgr.y (mgr.24389) 603 : cluster 0 pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: audit 2024-04-19T23:00:49.119733+0000 mon.a (mon.0) 3232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[21528]: cluster 2024-04-19T23:00:49.128422+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: cluster 2024-04-19T23:00:48.128189+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-04-19T23:00:49.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: audit 2024-04-19T23:00:48.131223+0000 mon.c (mon.2) 836 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: audit 2024-04-19T23:00:48.135785+0000 mon.a (mon.0) 3231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: cluster 2024-04-19T23:00:48.151659+0000 mgr.y (mgr.24389) 603 : cluster 0 pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:00:49.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: audit 2024-04-19T23:00:49.119733+0000 mon.a (mon.0) 3232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:49.551 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:49 smithi113 bash[28910]: cluster 2024-04-19T23:00:49.128422+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: cluster 2024-04-19T23:00:48.128189+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: audit 2024-04-19T23:00:48.131223+0000 mon.c (mon.2) 836 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: audit 2024-04-19T23:00:48.135785+0000 mon.a (mon.0) 3231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: cluster 2024-04-19T23:00:48.151659+0000 mgr.y (mgr.24389) 603 : cluster 0 pgmap v981: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: audit 2024-04-19T23:00:49.119733+0000 mon.a (mon.0) 3232 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:00:49.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:49 smithi178 bash[23441]: cluster 2024-04-19T23:00:49.128422+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-04-19T23:00:50.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[28910]: audit 2024-04-19T23:00:49.595149+0000 mon.a (mon.0) 3234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:50.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[28910]: cluster 2024-04-19T23:00:50.131187+0000 mon.a (mon.0) 3235 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-04-19T23:00:50.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[28910]: audit 2024-04-19T23:00:50.156319+0000 mon.c (mon.2) 837 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:50.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[28910]: audit 2024-04-19T23:00:50.156922+0000 mon.a (mon.0) 3236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:50.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[21528]: audit 2024-04-19T23:00:49.595149+0000 mon.a (mon.0) 3234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:50.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[21528]: cluster 2024-04-19T23:00:50.131187+0000 mon.a (mon.0) 3235 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-04-19T23:00:50.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[21528]: audit 2024-04-19T23:00:50.156319+0000 mon.c (mon.2) 837 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:50.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:50 smithi113 bash[21528]: audit 2024-04-19T23:00:50.156922+0000 mon.a (mon.0) 3236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:50.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:50 smithi178 bash[23441]: audit 2024-04-19T23:00:49.595149+0000 mon.a (mon.0) 3234 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:00:50.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:50 smithi178 bash[23441]: cluster 2024-04-19T23:00:50.131187+0000 mon.a (mon.0) 3235 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-04-19T23:00:50.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:50 smithi178 bash[23441]: audit 2024-04-19T23:00:50.156319+0000 mon.c (mon.2) 837 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:50.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:50 smithi178 bash[23441]: audit 2024-04-19T23:00:50.156922+0000 mon.a (mon.0) 3236 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:00:51.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[28910]: cluster 2024-04-19T23:00:50.152251+0000 mgr.y (mgr.24389) 604 : cluster 0 pgmap v984: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-04-19T23:00:51.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[28910]: audit 2024-04-19T23:00:51.124778+0000 mon.a (mon.0) 3237 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[28910]: cluster 2024-04-19T23:00:51.132455+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[28910]: audit 2024-04-19T23:00:51.134169+0000 mon.c (mon.2) 838 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[28910]: audit 2024-04-19T23:00:51.137023+0000 mon.a (mon.0) 3239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[21528]: cluster 2024-04-19T23:00:50.152251+0000 mgr.y (mgr.24389) 604 : cluster 0 pgmap v984: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[21528]: audit 2024-04-19T23:00:51.124778+0000 mon.a (mon.0) 3237 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[21528]: cluster 2024-04-19T23:00:51.132455+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[21528]: audit 2024-04-19T23:00:51.134169+0000 mon.c (mon.2) 838 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:51.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:51 smithi113 bash[21528]: audit 2024-04-19T23:00:51.137023+0000 mon.a (mon.0) 3239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:51.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:51 smithi178 bash[23441]: cluster 2024-04-19T23:00:50.152251+0000 mgr.y (mgr.24389) 604 : cluster 0 pgmap v984: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1023 B/s wr, 1 op/s 2024-04-19T23:00:51.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:51 smithi178 bash[23441]: audit 2024-04-19T23:00:51.124778+0000 mon.a (mon.0) 3237 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:00:51.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:51 smithi178 bash[23441]: cluster 2024-04-19T23:00:51.132455+0000 mon.a (mon.0) 3238 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-04-19T23:00:51.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:51 smithi178 bash[23441]: audit 2024-04-19T23:00:51.134169+0000 mon.c (mon.2) 838 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:51.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:51 smithi178 bash[23441]: audit 2024-04-19T23:00:51.137023+0000 mon.a (mon.0) 3239 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:00:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[21528]: audit 2024-04-19T23:00:52.127368+0000 mon.a (mon.0) 3240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:00:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[21528]: audit 2024-04-19T23:00:52.138717+0000 mon.c (mon.2) 839 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[21528]: cluster 2024-04-19T23:00:52.138968+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[21528]: audit 2024-04-19T23:00:52.141462+0000 mon.a (mon.0) 3242 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[21528]: cluster 2024-04-19T23:00:52.152983+0000 mgr.y (mgr.24389) 605 : cluster 0 pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[28910]: audit 2024-04-19T23:00:52.127368+0000 mon.a (mon.0) 3240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[28910]: audit 2024-04-19T23:00:52.138717+0000 mon.c (mon.2) 839 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[28910]: cluster 2024-04-19T23:00:52.138968+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[28910]: audit 2024-04-19T23:00:52.141462+0000 mon.a (mon.0) 3242 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:53 smithi113 bash[28910]: cluster 2024-04-19T23:00:52.152983+0000 mgr.y (mgr.24389) 605 : cluster 0 pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:00:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:53 smithi178 bash[23441]: audit 2024-04-19T23:00:52.127368+0000 mon.a (mon.0) 3240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:00:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:53 smithi178 bash[23441]: audit 2024-04-19T23:00:52.138717+0000 mon.c (mon.2) 839 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:53 smithi178 bash[23441]: cluster 2024-04-19T23:00:52.138968+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-04-19T23:00:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:53 smithi178 bash[23441]: audit 2024-04-19T23:00:52.141462+0000 mon.a (mon.0) 3242 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]: dispatch 2024-04-19T23:00:53.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:53 smithi178 bash[23441]: cluster 2024-04-19T23:00:52.152983+0000 mgr.y (mgr.24389) 605 : cluster 0 pgmap v987: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:00:54.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[28910]: cluster 2024-04-19T23:00:53.128531+0000 mon.a (mon.0) 3243 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[28910]: audit 2024-04-19T23:00:53.136961+0000 mon.a (mon.0) 3244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]': finished 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[28910]: cluster 2024-04-19T23:00:53.147380+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[28910]: audit 2024-04-19T23:00:53.173636+0000 mon.c (mon.2) 840 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[28910]: audit 2024-04-19T23:00:53.174031+0000 mgr.y (mgr.24389) 606 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[21528]: cluster 2024-04-19T23:00:53.128531+0000 mon.a (mon.0) 3243 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[21528]: audit 2024-04-19T23:00:53.136961+0000 mon.a (mon.0) 3244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]': finished 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[21528]: cluster 2024-04-19T23:00:53.147380+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[21528]: audit 2024-04-19T23:00:53.173636+0000 mon.c (mon.2) 840 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:54.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:54 smithi113 bash[21528]: audit 2024-04-19T23:00:53.174031+0000 mgr.y (mgr.24389) 606 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:54.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:54 smithi178 bash[23441]: cluster 2024-04-19T23:00:53.128531+0000 mon.a (mon.0) 3243 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:00:54.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:54 smithi178 bash[23441]: audit 2024-04-19T23:00:53.136961+0000 mon.a (mon.0) 3244 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-116", "mode": "writeback"}]': finished 2024-04-19T23:00:54.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:54 smithi178 bash[23441]: cluster 2024-04-19T23:00:53.147380+0000 mon.a (mon.0) 3245 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-04-19T23:00:54.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:54 smithi178 bash[23441]: audit 2024-04-19T23:00:53.173636+0000 mon.c (mon.2) 840 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:54.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:54 smithi178 bash[23441]: audit 2024-04-19T23:00:53.174031+0000 mgr.y (mgr.24389) 606 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-04-19T23:00:55.411 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:55 smithi178 bash[23441]: cluster 2024-04-19T23:00:53.320358+0000 osd.4 (osd.4) 3 : cluster 0 326.0 scrub starts 2024-04-19T23:00:55.412 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:55 smithi178 bash[23441]: cluster 2024-04-19T23:00:53.323042+0000 osd.4 (osd.4) 4 : cluster 0 326.0 scrub ok 2024-04-19T23:00:55.412 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:55 smithi178 bash[23441]: cluster 2024-04-19T23:00:54.153759+0000 mgr.y (mgr.24389) 607 : cluster 0 pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[28910]: cluster 2024-04-19T23:00:53.320358+0000 osd.4 (osd.4) 3 : cluster 0 326.0 scrub starts 2024-04-19T23:00:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[28910]: cluster 2024-04-19T23:00:53.323042+0000 osd.4 (osd.4) 4 : cluster 0 326.0 scrub ok 2024-04-19T23:00:55.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[28910]: cluster 2024-04-19T23:00:54.153759+0000 mgr.y (mgr.24389) 607 : cluster 0 pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:55.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[21528]: cluster 2024-04-19T23:00:53.320358+0000 osd.4 (osd.4) 3 : cluster 0 326.0 scrub starts 2024-04-19T23:00:55.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[21528]: cluster 2024-04-19T23:00:53.323042+0000 osd.4 (osd.4) 4 : cluster 0 326.0 scrub ok 2024-04-19T23:00:55.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:55 smithi113 bash[21528]: cluster 2024-04-19T23:00:54.153759+0000 mgr.y (mgr.24389) 607 : cluster 0 pgmap v989: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:00:55.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:00:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:00:56.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:56 smithi113 bash[21528]: audit 2024-04-19T23:00:55.410672+0000 mgr.y (mgr.24389) 608 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:56.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:56 smithi113 bash[28910]: audit 2024-04-19T23:00:55.410672+0000 mgr.y (mgr.24389) 608 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:56.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:56 smithi178 bash[23441]: audit 2024-04-19T23:00:55.410672+0000 mgr.y (mgr.24389) 608 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:00:57.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:57 smithi113 bash[28910]: cluster 2024-04-19T23:00:56.156084+0000 mgr.y (mgr.24389) 609 : cluster 0 pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:00:57.480 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:57 smithi113 bash[21528]: cluster 2024-04-19T23:00:56.156084+0000 mgr.y (mgr.24389) 609 : cluster 0 pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:00:57.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:57 smithi178 bash[23441]: cluster 2024-04-19T23:00:56.156084+0000 mgr.y (mgr.24389) 609 : cluster 0 pgmap v990: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:00:57.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:00:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:00:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:00:59.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:00:59 smithi113 bash[28910]: cluster 2024-04-19T23:00:58.156981+0000 mgr.y (mgr.24389) 610 : cluster 0 pgmap v991: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 436 B/s wr, 1 op/s 2024-04-19T23:00:59.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:00:59 smithi113 bash[21528]: cluster 2024-04-19T23:00:58.156981+0000 mgr.y (mgr.24389) 610 : cluster 0 pgmap v991: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 436 B/s wr, 1 op/s 2024-04-19T23:00:59.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:00:59 smithi178 bash[23441]: cluster 2024-04-19T23:00:58.156981+0000 mgr.y (mgr.24389) 610 : cluster 0 pgmap v991: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 436 B/s wr, 1 op/s 2024-04-19T23:01:01.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:01 smithi113 bash[28910]: cluster 2024-04-19T23:01:00.159007+0000 mgr.y (mgr.24389) 611 : cluster 0 pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 382 B/s wr, 2 op/s 2024-04-19T23:01:01.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:01 smithi113 bash[21528]: cluster 2024-04-19T23:01:00.159007+0000 mgr.y (mgr.24389) 611 : cluster 0 pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 382 B/s wr, 2 op/s 2024-04-19T23:01:01.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:01 smithi178 bash[23441]: cluster 2024-04-19T23:01:00.159007+0000 mgr.y (mgr.24389) 611 : cluster 0 pgmap v992: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 382 B/s wr, 2 op/s 2024-04-19T23:01:03.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:03 smithi113 bash[28910]: cluster 2024-04-19T23:01:02.159992+0000 mgr.y (mgr.24389) 612 : cluster 0 pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 306 B/s wr, 1 op/s 2024-04-19T23:01:03.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:03 smithi113 bash[28910]: audit 2024-04-19T23:01:02.638179+0000 mon.a (mon.0) 3246 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:01:03.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:03 smithi113 bash[21528]: cluster 2024-04-19T23:01:02.159992+0000 mgr.y (mgr.24389) 612 : cluster 0 pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 306 B/s wr, 1 op/s 2024-04-19T23:01:03.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:03 smithi113 bash[21528]: audit 2024-04-19T23:01:02.638179+0000 mon.a (mon.0) 3246 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:01:03.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:03 smithi178 bash[23441]: cluster 2024-04-19T23:01:02.159992+0000 mgr.y (mgr.24389) 612 : cluster 0 pgmap v993: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 306 B/s wr, 1 op/s 2024-04-19T23:01:03.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:03 smithi178 bash[23441]: audit 2024-04-19T23:01:02.638179+0000 mon.a (mon.0) 3246 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:01:04.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[28910]: audit 2024-04-19T23:01:03.313558+0000 mon.a (mon.0) 3247 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:01:04.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[28910]: audit 2024-04-19T23:01:03.314843+0000 mon.a (mon.0) 3248 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:01:04.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[28910]: audit 2024-04-19T23:01:03.324095+0000 mon.a (mon.0) 3249 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:04.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[21528]: audit 2024-04-19T23:01:03.313558+0000 mon.a (mon.0) 3247 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:01:04.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[21528]: audit 2024-04-19T23:01:03.314843+0000 mon.a (mon.0) 3248 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:01:04.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:04 smithi113 bash[21528]: audit 2024-04-19T23:01:03.324095+0000 mon.a (mon.0) 3249 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:04.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:04 smithi178 bash[23441]: audit 2024-04-19T23:01:03.313558+0000 mon.a (mon.0) 3247 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:01:04.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:04 smithi178 bash[23441]: audit 2024-04-19T23:01:03.314843+0000 mon.a (mon.0) 3248 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:01:04.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:04 smithi178 bash[23441]: audit 2024-04-19T23:01:03.324095+0000 mon.a (mon.0) 3249 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:05.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:05.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:05 smithi178 bash[23441]: cluster 2024-04-19T23:01:04.160815+0000 mgr.y (mgr.24389) 613 : cluster 0 pgmap v994: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 278 B/s wr, 1 op/s 2024-04-19T23:01:05.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:05 smithi178 bash[23441]: audit 2024-04-19T23:01:04.634098+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:05.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:05 smithi178 bash[23441]: audit 2024-04-19T23:01:04.636451+0000 mon.a (mon.0) 3251 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:06.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[28910]: cluster 2024-04-19T23:01:04.160815+0000 mgr.y (mgr.24389) 613 : cluster 0 pgmap v994: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 278 B/s wr, 1 op/s 2024-04-19T23:01:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[28910]: audit 2024-04-19T23:01:04.634098+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[28910]: audit 2024-04-19T23:01:04.636451+0000 mon.a (mon.0) 3251 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[21528]: cluster 2024-04-19T23:01:04.160815+0000 mgr.y (mgr.24389) 613 : cluster 0 pgmap v994: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 278 B/s wr, 1 op/s 2024-04-19T23:01:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[21528]: audit 2024-04-19T23:01:04.634098+0000 mon.a (mon.0) 3250 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:05 smithi113 bash[21528]: audit 2024-04-19T23:01:04.636451+0000 mon.a (mon.0) 3251 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:06 smithi113 bash[28910]: audit 2024-04-19T23:01:05.421695+0000 mgr.y (mgr.24389) 614 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:07.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:06 smithi113 bash[21528]: audit 2024-04-19T23:01:05.421695+0000 mgr.y (mgr.24389) 614 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:07.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:06 smithi178 bash[23441]: audit 2024-04-19T23:01:05.421695+0000 mgr.y (mgr.24389) 614 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:07 smithi113 bash[21528]: cluster 2024-04-19T23:01:06.162894+0000 mgr.y (mgr.24389) 615 : cluster 0 pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:07.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:07 smithi113 bash[28910]: cluster 2024-04-19T23:01:06.162894+0000 mgr.y (mgr.24389) 615 : cluster 0 pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:07.800 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:08.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:07 smithi178 bash[23441]: cluster 2024-04-19T23:01:06.162894+0000 mgr.y (mgr.24389) 615 : cluster 0 pgmap v995: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[28910]: cluster 2024-04-19T23:01:08.163652+0000 mgr.y (mgr.24389) 616 : cluster 0 pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[28910]: cluster 2024-04-19T23:01:08.659834+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[28910]: audit 2024-04-19T23:01:08.721724+0000 mon.c (mon.2) 841 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[28910]: audit 2024-04-19T23:01:08.722314+0000 mon.a (mon.0) 3253 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[21528]: cluster 2024-04-19T23:01:08.163652+0000 mgr.y (mgr.24389) 616 : cluster 0 pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[21528]: cluster 2024-04-19T23:01:08.659834+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[21528]: audit 2024-04-19T23:01:08.721724+0000 mon.c (mon.2) 841 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:09 smithi113 bash[21528]: audit 2024-04-19T23:01:08.722314+0000 mon.a (mon.0) 3253 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:09 smithi178 bash[23441]: cluster 2024-04-19T23:01:08.163652+0000 mgr.y (mgr.24389) 616 : cluster 0 pgmap v996: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:01:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:09 smithi178 bash[23441]: cluster 2024-04-19T23:01:08.659834+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-04-19T23:01:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:09 smithi178 bash[23441]: audit 2024-04-19T23:01:08.721724+0000 mon.c (mon.2) 841 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:09 smithi178 bash[23441]: audit 2024-04-19T23:01:08.722314+0000 mon.a (mon.0) 3253 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:11.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[28910]: audit 2024-04-19T23:01:09.655686+0000 mon.a (mon.0) 3254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[28910]: audit 2024-04-19T23:01:09.665857+0000 mon.c (mon.2) 842 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[28910]: cluster 2024-04-19T23:01:09.667467+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[28910]: audit 2024-04-19T23:01:09.670176+0000 mon.a (mon.0) 3256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[28910]: cluster 2024-04-19T23:01:10.656001+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[21528]: audit 2024-04-19T23:01:09.655686+0000 mon.a (mon.0) 3254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[21528]: audit 2024-04-19T23:01:09.665857+0000 mon.c (mon.2) 842 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[21528]: cluster 2024-04-19T23:01:09.667467+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[21528]: audit 2024-04-19T23:01:09.670176+0000 mon.a (mon.0) 3256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:10 smithi113 bash[21528]: cluster 2024-04-19T23:01:10.656001+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:10 smithi178 bash[23441]: audit 2024-04-19T23:01:09.655686+0000 mon.a (mon.0) 3254 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:10 smithi178 bash[23441]: audit 2024-04-19T23:01:09.665857+0000 mon.c (mon.2) 842 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:10 smithi178 bash[23441]: cluster 2024-04-19T23:01:09.667467+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-04-19T23:01:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:10 smithi178 bash[23441]: audit 2024-04-19T23:01:09.670176+0000 mon.a (mon.0) 3256 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]: dispatch 2024-04-19T23:01:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:10 smithi178 bash[23441]: cluster 2024-04-19T23:01:10.656001+0000 mon.a (mon.0) 3257 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:12.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[28910]: cluster 2024-04-19T23:01:10.165775+0000 mgr.y (mgr.24389) 617 : cluster 0 pgmap v999: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[28910]: audit 2024-04-19T23:01:10.658488+0000 mon.a (mon.0) 3258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[28910]: cluster 2024-04-19T23:01:10.667907+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[28910]: cluster 2024-04-19T23:01:11.420469+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[21528]: cluster 2024-04-19T23:01:10.165775+0000 mgr.y (mgr.24389) 617 : cluster 0 pgmap v999: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[21528]: audit 2024-04-19T23:01:10.658488+0000 mon.a (mon.0) 3258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[21528]: cluster 2024-04-19T23:01:10.667907+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-04-19T23:01:12.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:11 smithi113 bash[21528]: cluster 2024-04-19T23:01:11.420469+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-04-19T23:01:12.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:11 smithi178 bash[23441]: cluster 2024-04-19T23:01:10.165775+0000 mgr.y (mgr.24389) 617 : cluster 0 pgmap v999: 204 pgs: 204 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-19T23:01:12.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:11 smithi178 bash[23441]: audit 2024-04-19T23:01:10.658488+0000 mon.a (mon.0) 3258 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-116"}]': finished 2024-04-19T23:01:12.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:11 smithi178 bash[23441]: cluster 2024-04-19T23:01:10.667907+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-04-19T23:01:12.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:11 smithi178 bash[23441]: cluster 2024-04-19T23:01:11.420469+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-04-19T23:01:13.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[21528]: cluster 2024-04-19T23:01:12.166615+0000 mgr.y (mgr.24389) 618 : cluster 0 pgmap v1002: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[21528]: cluster 2024-04-19T23:01:12.425048+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[21528]: audit 2024-04-19T23:01:12.431810+0000 mon.c (mon.2) 843 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[21528]: audit 2024-04-19T23:01:12.435156+0000 mon.a (mon.0) 3262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[28910]: cluster 2024-04-19T23:01:12.166615+0000 mgr.y (mgr.24389) 618 : cluster 0 pgmap v1002: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[28910]: cluster 2024-04-19T23:01:12.425048+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[28910]: audit 2024-04-19T23:01:12.431810+0000 mon.c (mon.2) 843 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:13.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:13 smithi113 bash[28910]: audit 2024-04-19T23:01:12.435156+0000 mon.a (mon.0) 3262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:13.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:13 smithi178 bash[23441]: cluster 2024-04-19T23:01:12.166615+0000 mgr.y (mgr.24389) 618 : cluster 0 pgmap v1002: 172 pgs: 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-04-19T23:01:13.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:13 smithi178 bash[23441]: cluster 2024-04-19T23:01:12.425048+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-04-19T23:01:13.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:13 smithi178 bash[23441]: audit 2024-04-19T23:01:12.431810+0000 mon.c (mon.2) 843 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:13.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:13 smithi178 bash[23441]: audit 2024-04-19T23:01:12.435156+0000 mon.a (mon.0) 3262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:14 smithi113 bash[28910]: audit 2024-04-19T23:01:13.419070+0000 mon.a (mon.0) 3263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:14.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:14 smithi113 bash[28910]: cluster 2024-04-19T23:01:13.427925+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-04-19T23:01:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:14 smithi113 bash[21528]: audit 2024-04-19T23:01:13.419070+0000 mon.a (mon.0) 3263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:14 smithi113 bash[21528]: cluster 2024-04-19T23:01:13.427925+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-04-19T23:01:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:14 smithi178 bash[23441]: audit 2024-04-19T23:01:13.419070+0000 mon.a (mon.0) 3263 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:14 smithi178 bash[23441]: cluster 2024-04-19T23:01:13.427925+0000 mon.a (mon.0) 3264 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[21528]: cluster 2024-04-19T23:01:14.167426+0000 mgr.y (mgr.24389) 619 : cluster 0 pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[21528]: cluster 2024-04-19T23:01:14.456437+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[21528]: audit 2024-04-19T23:01:14.469435+0000 mon.c (mon.2) 844 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[21528]: audit 2024-04-19T23:01:14.470608+0000 mon.a (mon.0) 3266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[28910]: cluster 2024-04-19T23:01:14.167426+0000 mgr.y (mgr.24389) 619 : cluster 0 pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[28910]: cluster 2024-04-19T23:01:14.456437+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-04-19T23:01:15.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[28910]: audit 2024-04-19T23:01:14.469435+0000 mon.c (mon.2) 844 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:15.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:15 smithi113 bash[28910]: audit 2024-04-19T23:01:14.470608+0000 mon.a (mon.0) 3266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:15.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:15.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:15 smithi178 bash[23441]: cluster 2024-04-19T23:01:14.167426+0000 mgr.y (mgr.24389) 619 : cluster 0 pgmap v1005: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:15 smithi178 bash[23441]: cluster 2024-04-19T23:01:14.456437+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-04-19T23:01:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:15 smithi178 bash[23441]: audit 2024-04-19T23:01:14.469435+0000 mon.c (mon.2) 844 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:15 smithi178 bash[23441]: audit 2024-04-19T23:01:14.470608+0000 mon.a (mon.0) 3266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:15.425421+0000 mgr.y (mgr.24389) 620 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:15.448142+0000 mon.a (mon.0) 3267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: cluster 2024-04-19T23:01:15.457933+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:15.459408+0000 mon.c (mon.2) 845 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:15.461231+0000 mon.a (mon.0) 3269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:16.450818+0000 mon.a (mon.0) 3270 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: cluster 2024-04-19T23:01:16.458115+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:16.459795+0000 mon.c (mon.2) 846 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[21528]: audit 2024-04-19T23:01:16.462932+0000 mon.a (mon.0) 3272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:15.425421+0000 mgr.y (mgr.24389) 620 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:15.448142+0000 mon.a (mon.0) 3267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: cluster 2024-04-19T23:01:15.457933+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:15.459408+0000 mon.c (mon.2) 845 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:15.461231+0000 mon.a (mon.0) 3269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:16.450818+0000 mon.a (mon.0) 3270 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: cluster 2024-04-19T23:01:16.458115+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:16.459795+0000 mon.c (mon.2) 846 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:16.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:16 smithi113 bash[28910]: audit 2024-04-19T23:01:16.462932+0000 mon.a (mon.0) 3272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:15.425421+0000 mgr.y (mgr.24389) 620 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:15.448142+0000 mon.a (mon.0) 3267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: cluster 2024-04-19T23:01:15.457933+0000 mon.a (mon.0) 3268 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-04-19T23:01:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:15.459408+0000 mon.c (mon.2) 845 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:15.461231+0000 mon.a (mon.0) 3269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:16.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:16.450818+0000 mon.a (mon.0) 3270 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:16.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: cluster 2024-04-19T23:01:16.458115+0000 mon.a (mon.0) 3271 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-04-19T23:01:16.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:16.459795+0000 mon.c (mon.2) 846 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:16.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:16 smithi178 bash[23441]: audit 2024-04-19T23:01:16.462932+0000 mon.a (mon.0) 3272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]: dispatch 2024-04-19T23:01:17.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[28910]: cluster 2024-04-19T23:01:16.168247+0000 mgr.y (mgr.24389) 621 : cluster 0 pgmap v1008: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[28910]: cluster 2024-04-19T23:01:17.451138+0000 mon.a (mon.0) 3273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[28910]: audit 2024-04-19T23:01:17.453457+0000 mon.a (mon.0) 3274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]': finished 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[28910]: cluster 2024-04-19T23:01:17.461618+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[21528]: cluster 2024-04-19T23:01:16.168247+0000 mgr.y (mgr.24389) 621 : cluster 0 pgmap v1008: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[21528]: cluster 2024-04-19T23:01:17.451138+0000 mon.a (mon.0) 3273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[21528]: audit 2024-04-19T23:01:17.453457+0000 mon.a (mon.0) 3274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]': finished 2024-04-19T23:01:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:17 smithi113 bash[21528]: cluster 2024-04-19T23:01:17.461618+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-04-19T23:01:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:17 smithi178 bash[23441]: cluster 2024-04-19T23:01:16.168247+0000 mgr.y (mgr.24389) 621 : cluster 0 pgmap v1008: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:17 smithi178 bash[23441]: cluster 2024-04-19T23:01:17.451138+0000 mon.a (mon.0) 3273 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:17 smithi178 bash[23441]: audit 2024-04-19T23:01:17.453457+0000 mon.a (mon.0) 3274 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-118", "mode": "writeback"}]': finished 2024-04-19T23:01:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:17 smithi178 bash[23441]: cluster 2024-04-19T23:01:17.461618+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[28910]: cluster 2024-04-19T23:01:18.169016+0000 mgr.y (mgr.24389) 622 : cluster 0 pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[28910]: cluster 2024-04-19T23:01:18.464463+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[28910]: audit 2024-04-19T23:01:18.540061+0000 mon.c (mon.2) 847 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[28910]: audit 2024-04-19T23:01:18.540857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[21528]: cluster 2024-04-19T23:01:18.169016+0000 mgr.y (mgr.24389) 622 : cluster 0 pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[21528]: cluster 2024-04-19T23:01:18.464463+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[21528]: audit 2024-04-19T23:01:18.540061+0000 mon.c (mon.2) 847 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:19 smithi113 bash[21528]: audit 2024-04-19T23:01:18.540857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:19 smithi178 bash[23441]: cluster 2024-04-19T23:01:18.169016+0000 mgr.y (mgr.24389) 622 : cluster 0 pgmap v1011: 204 pgs: 204 active+clean; 583 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:01:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:19 smithi178 bash[23441]: cluster 2024-04-19T23:01:18.464463+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-04-19T23:01:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:19 smithi178 bash[23441]: audit 2024-04-19T23:01:18.540061+0000 mon.c (mon.2) 847 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:19 smithi178 bash[23441]: audit 2024-04-19T23:01:18.540857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[28910]: audit 2024-04-19T23:01:19.489356+0000 mon.a (mon.0) 3278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[28910]: cluster 2024-04-19T23:01:19.496841+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[28910]: audit 2024-04-19T23:01:19.499339+0000 mon.c (mon.2) 848 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[28910]: audit 2024-04-19T23:01:19.503436+0000 mon.a (mon.0) 3280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[28910]: audit 2024-04-19T23:01:19.669714+0000 mon.a (mon.0) 3281 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[21528]: audit 2024-04-19T23:01:19.489356+0000 mon.a (mon.0) 3278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[21528]: cluster 2024-04-19T23:01:19.496841+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[21528]: audit 2024-04-19T23:01:19.499339+0000 mon.c (mon.2) 848 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[21528]: audit 2024-04-19T23:01:19.503436+0000 mon.a (mon.0) 3280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:20 smithi113 bash[21528]: audit 2024-04-19T23:01:19.669714+0000 mon.a (mon.0) 3281 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:20 smithi178 bash[23441]: audit 2024-04-19T23:01:19.489356+0000 mon.a (mon.0) 3278 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:20 smithi178 bash[23441]: cluster 2024-04-19T23:01:19.496841+0000 mon.a (mon.0) 3279 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-04-19T23:01:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:20 smithi178 bash[23441]: audit 2024-04-19T23:01:19.499339+0000 mon.c (mon.2) 848 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:20 smithi178 bash[23441]: audit 2024-04-19T23:01:19.503436+0000 mon.a (mon.0) 3280 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]: dispatch 2024-04-19T23:01:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:20 smithi178 bash[23441]: audit 2024-04-19T23:01:19.669714+0000 mon.a (mon.0) 3281 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:22.299 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[28910]: cluster 2024-04-19T23:01:20.171162+0000 mgr.y (mgr.24389) 623 : cluster 0 pgmap v1014: 204 pgs: 204 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[28910]: cluster 2024-04-19T23:01:20.489754+0000 mon.a (mon.0) 3282 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[28910]: audit 2024-04-19T23:01:20.492213+0000 mon.a (mon.0) 3283 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[28910]: cluster 2024-04-19T23:01:20.499944+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[28910]: cluster 2024-04-19T23:01:21.424925+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[21528]: cluster 2024-04-19T23:01:20.171162+0000 mgr.y (mgr.24389) 623 : cluster 0 pgmap v1014: 204 pgs: 204 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[21528]: cluster 2024-04-19T23:01:20.489754+0000 mon.a (mon.0) 3282 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[21528]: audit 2024-04-19T23:01:20.492213+0000 mon.a (mon.0) 3283 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[21528]: cluster 2024-04-19T23:01:20.499944+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-04-19T23:01:22.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:21 smithi113 bash[21528]: cluster 2024-04-19T23:01:21.424925+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-04-19T23:01:22.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:21 smithi178 bash[23441]: cluster 2024-04-19T23:01:20.171162+0000 mgr.y (mgr.24389) 623 : cluster 0 pgmap v1014: 204 pgs: 204 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:01:22.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:21 smithi178 bash[23441]: cluster 2024-04-19T23:01:20.489754+0000 mon.a (mon.0) 3282 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:22.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:21 smithi178 bash[23441]: audit 2024-04-19T23:01:20.492213+0000 mon.a (mon.0) 3283 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-118"}]': finished 2024-04-19T23:01:22.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:21 smithi178 bash[23441]: cluster 2024-04-19T23:01:20.499944+0000 mon.a (mon.0) 3284 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-04-19T23:01:22.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:21 smithi178 bash[23441]: cluster 2024-04-19T23:01:21.424925+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-04-19T23:01:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[21528]: cluster 2024-04-19T23:01:22.171998+0000 mgr.y (mgr.24389) 624 : cluster 0 pgmap v1017: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[21528]: cluster 2024-04-19T23:01:22.428886+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[21528]: audit 2024-04-19T23:01:22.445936+0000 mon.c (mon.2) 849 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[21528]: audit 2024-04-19T23:01:22.447331+0000 mon.a (mon.0) 3287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[28910]: cluster 2024-04-19T23:01:22.171998+0000 mgr.y (mgr.24389) 624 : cluster 0 pgmap v1017: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[28910]: cluster 2024-04-19T23:01:22.428886+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[28910]: audit 2024-04-19T23:01:22.445936+0000 mon.c (mon.2) 849 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:23 smithi113 bash[28910]: audit 2024-04-19T23:01:22.447331+0000 mon.a (mon.0) 3287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:23 smithi178 bash[23441]: cluster 2024-04-19T23:01:22.171998+0000 mgr.y (mgr.24389) 624 : cluster 0 pgmap v1017: 172 pgs: 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:23 smithi178 bash[23441]: cluster 2024-04-19T23:01:22.428886+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-04-19T23:01:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:23 smithi178 bash[23441]: audit 2024-04-19T23:01:22.445936+0000 mon.c (mon.2) 849 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:23 smithi178 bash[23441]: audit 2024-04-19T23:01:22.447331+0000 mon.a (mon.0) 3287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[28910]: audit 2024-04-19T23:01:23.430091+0000 mon.a (mon.0) 3288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[28910]: cluster 2024-04-19T23:01:23.438351+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[28910]: audit 2024-04-19T23:01:23.481887+0000 mon.c (mon.2) 850 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[28910]: audit 2024-04-19T23:01:23.482837+0000 mon.a (mon.0) 3290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[21528]: audit 2024-04-19T23:01:23.430091+0000 mon.a (mon.0) 3288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[21528]: cluster 2024-04-19T23:01:23.438351+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-04-19T23:01:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[21528]: audit 2024-04-19T23:01:23.481887+0000 mon.c (mon.2) 850 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:24.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:24 smithi113 bash[21528]: audit 2024-04-19T23:01:23.482837+0000 mon.a (mon.0) 3290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:24 smithi178 bash[23441]: audit 2024-04-19T23:01:23.430091+0000 mon.a (mon.0) 3288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:24 smithi178 bash[23441]: cluster 2024-04-19T23:01:23.438351+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-04-19T23:01:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:24 smithi178 bash[23441]: audit 2024-04-19T23:01:23.481887+0000 mon.c (mon.2) 850 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:24 smithi178 bash[23441]: audit 2024-04-19T23:01:23.482837+0000 mon.a (mon.0) 3290 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[28910]: cluster 2024-04-19T23:01:24.172804+0000 mgr.y (mgr.24389) 625 : cluster 0 pgmap v1020: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[28910]: audit 2024-04-19T23:01:24.439700+0000 mon.a (mon.0) 3291 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[28910]: cluster 2024-04-19T23:01:24.449759+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[28910]: audit 2024-04-19T23:01:24.451760+0000 mon.c (mon.2) 851 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[28910]: audit 2024-04-19T23:01:24.452901+0000 mon.a (mon.0) 3293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[21528]: cluster 2024-04-19T23:01:24.172804+0000 mgr.y (mgr.24389) 625 : cluster 0 pgmap v1020: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[21528]: audit 2024-04-19T23:01:24.439700+0000 mon.a (mon.0) 3291 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[21528]: cluster 2024-04-19T23:01:24.449759+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-04-19T23:01:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[21528]: audit 2024-04-19T23:01:24.451760+0000 mon.c (mon.2) 851 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:25.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:25 smithi113 bash[21528]: audit 2024-04-19T23:01:24.452901+0000 mon.a (mon.0) 3293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:25.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[23441]: cluster 2024-04-19T23:01:24.172804+0000 mgr.y (mgr.24389) 625 : cluster 0 pgmap v1020: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 639 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[23441]: audit 2024-04-19T23:01:24.439700+0000 mon.a (mon.0) 3291 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[23441]: cluster 2024-04-19T23:01:24.449759+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-04-19T23:01:25.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[23441]: audit 2024-04-19T23:01:24.451760+0000 mon.c (mon.2) 851 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:25.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:25 smithi178 bash[23441]: audit 2024-04-19T23:01:24.452901+0000 mon.a (mon.0) 3293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[21528]: audit 2024-04-19T23:01:25.436820+0000 mgr.y (mgr.24389) 626 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[21528]: audit 2024-04-19T23:01:25.442444+0000 mon.a (mon.0) 3294 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[21528]: cluster 2024-04-19T23:01:25.450948+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[21528]: audit 2024-04-19T23:01:25.455812+0000 mon.c (mon.2) 852 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[21528]: audit 2024-04-19T23:01:25.464758+0000 mon.a (mon.0) 3296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[28910]: audit 2024-04-19T23:01:25.436820+0000 mgr.y (mgr.24389) 626 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:26.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[28910]: audit 2024-04-19T23:01:25.442444+0000 mon.a (mon.0) 3294 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:26.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[28910]: cluster 2024-04-19T23:01:25.450948+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-04-19T23:01:26.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[28910]: audit 2024-04-19T23:01:25.455812+0000 mon.c (mon.2) 852 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:26.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:26 smithi113 bash[28910]: audit 2024-04-19T23:01:25.464758+0000 mon.a (mon.0) 3296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:26 smithi178 bash[23441]: audit 2024-04-19T23:01:25.436820+0000 mgr.y (mgr.24389) 626 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:26 smithi178 bash[23441]: audit 2024-04-19T23:01:25.442444+0000 mon.a (mon.0) 3294 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:26 smithi178 bash[23441]: cluster 2024-04-19T23:01:25.450948+0000 mon.a (mon.0) 3295 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-04-19T23:01:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:26 smithi178 bash[23441]: audit 2024-04-19T23:01:25.455812+0000 mon.c (mon.2) 852 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:26 smithi178 bash[23441]: audit 2024-04-19T23:01:25.464758+0000 mon.a (mon.0) 3296 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]: dispatch 2024-04-19T23:01:27.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: cluster 2024-04-19T23:01:26.173600+0000 mgr.y (mgr.24389) 627 : cluster 0 pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: cluster 2024-04-19T23:01:26.458040+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: audit 2024-04-19T23:01:26.468007+0000 mon.a (mon.0) 3298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]': finished 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: cluster 2024-04-19T23:01:26.476500+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: audit 2024-04-19T23:01:26.622079+0000 mon.c (mon.2) 853 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[21528]: audit 2024-04-19T23:01:26.622927+0000 mon.a (mon.0) 3300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: cluster 2024-04-19T23:01:26.173600+0000 mgr.y (mgr.24389) 627 : cluster 0 pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: cluster 2024-04-19T23:01:26.458040+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: audit 2024-04-19T23:01:26.468007+0000 mon.a (mon.0) 3298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]': finished 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: cluster 2024-04-19T23:01:26.476500+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: audit 2024-04-19T23:01:26.622079+0000 mon.c (mon.2) 853 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:27.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:27 smithi113 bash[28910]: audit 2024-04-19T23:01:26.622927+0000 mon.a (mon.0) 3300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: cluster 2024-04-19T23:01:26.173600+0000 mgr.y (mgr.24389) 627 : cluster 0 pgmap v1023: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: cluster 2024-04-19T23:01:26.458040+0000 mon.a (mon.0) 3297 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: audit 2024-04-19T23:01:26.468007+0000 mon.a (mon.0) 3298 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-120", "mode": "writeback"}]': finished 2024-04-19T23:01:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: cluster 2024-04-19T23:01:26.476500+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-04-19T23:01:27.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: audit 2024-04-19T23:01:26.622079+0000 mon.c (mon.2) 853 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:27.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:27 smithi178 bash[23441]: audit 2024-04-19T23:01:26.622927+0000 mon.a (mon.0) 3300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:28.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[28910]: audit 2024-04-19T23:01:27.472541+0000 mon.a (mon.0) 3301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[28910]: cluster 2024-04-19T23:01:27.479761+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[28910]: audit 2024-04-19T23:01:27.483047+0000 mon.c (mon.2) 854 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[28910]: audit 2024-04-19T23:01:27.484057+0000 mon.a (mon.0) 3303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[21528]: audit 2024-04-19T23:01:27.472541+0000 mon.a (mon.0) 3301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[21528]: cluster 2024-04-19T23:01:27.479761+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[21528]: audit 2024-04-19T23:01:27.483047+0000 mon.c (mon.2) 854 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:28 smithi113 bash[21528]: audit 2024-04-19T23:01:27.484057+0000 mon.a (mon.0) 3303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:28 smithi178 bash[23441]: audit 2024-04-19T23:01:27.472541+0000 mon.a (mon.0) 3301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:28 smithi178 bash[23441]: cluster 2024-04-19T23:01:27.479761+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-04-19T23:01:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:28 smithi178 bash[23441]: audit 2024-04-19T23:01:27.483047+0000 mon.c (mon.2) 854 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:28 smithi178 bash[23441]: audit 2024-04-19T23:01:27.484057+0000 mon.a (mon.0) 3303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]: dispatch 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[28910]: cluster 2024-04-19T23:01:28.174507+0000 mgr.y (mgr.24389) 628 : cluster 0 pgmap v1026: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[28910]: cluster 2024-04-19T23:01:28.473700+0000 mon.a (mon.0) 3304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[28910]: audit 2024-04-19T23:01:28.481589+0000 mon.a (mon.0) 3305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[28910]: cluster 2024-04-19T23:01:28.492184+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[21528]: cluster 2024-04-19T23:01:28.174507+0000 mgr.y (mgr.24389) 628 : cluster 0 pgmap v1026: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[21528]: cluster 2024-04-19T23:01:28.473700+0000 mon.a (mon.0) 3304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:29.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[21528]: audit 2024-04-19T23:01:28.481589+0000 mon.a (mon.0) 3305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:29.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:29 smithi113 bash[21528]: cluster 2024-04-19T23:01:28.492184+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-04-19T23:01:29.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:29 smithi178 bash[23441]: cluster 2024-04-19T23:01:28.174507+0000 mgr.y (mgr.24389) 628 : cluster 0 pgmap v1026: 204 pgs: 204 active+clean; 583 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:29.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:29 smithi178 bash[23441]: cluster 2024-04-19T23:01:28.473700+0000 mon.a (mon.0) 3304 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:29.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:29 smithi178 bash[23441]: audit 2024-04-19T23:01:28.481589+0000 mon.a (mon.0) 3305 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-120"}]': finished 2024-04-19T23:01:29.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:29 smithi178 bash[23441]: cluster 2024-04-19T23:01:28.492184+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-04-19T23:01:30.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:30 smithi113 bash[28910]: cluster 2024-04-19T23:01:29.490810+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-04-19T23:01:30.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:30 smithi113 bash[21528]: cluster 2024-04-19T23:01:29.490810+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-04-19T23:01:30.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:30 smithi178 bash[23441]: cluster 2024-04-19T23:01:29.490810+0000 mon.a (mon.0) 3307 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-04-19T23:01:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[21528]: cluster 2024-04-19T23:01:30.176487+0000 mgr.y (mgr.24389) 629 : cluster 0 pgmap v1029: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[21528]: cluster 2024-04-19T23:01:30.523409+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-04-19T23:01:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[21528]: audit 2024-04-19T23:01:30.526402+0000 mon.c (mon.2) 855 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:31.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[21528]: audit 2024-04-19T23:01:30.529080+0000 mon.a (mon.0) 3309 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:31.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[28910]: cluster 2024-04-19T23:01:30.176487+0000 mgr.y (mgr.24389) 629 : cluster 0 pgmap v1029: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:31.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[28910]: cluster 2024-04-19T23:01:30.523409+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-04-19T23:01:31.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[28910]: audit 2024-04-19T23:01:30.526402+0000 mon.c (mon.2) 855 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:31.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:31 smithi113 bash[28910]: audit 2024-04-19T23:01:30.529080+0000 mon.a (mon.0) 3309 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:31 smithi178 bash[23441]: cluster 2024-04-19T23:01:30.176487+0000 mgr.y (mgr.24389) 629 : cluster 0 pgmap v1029: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:31 smithi178 bash[23441]: cluster 2024-04-19T23:01:30.523409+0000 mon.a (mon.0) 3308 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-04-19T23:01:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:31 smithi178 bash[23441]: audit 2024-04-19T23:01:30.526402+0000 mon.c (mon.2) 855 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:31.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:31 smithi178 bash[23441]: audit 2024-04-19T23:01:30.529080+0000 mon.a (mon.0) 3309 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:33.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[21528]: audit 2024-04-19T23:01:31.516087+0000 mon.a (mon.0) 3310 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:33.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[21528]: cluster 2024-04-19T23:01:31.524223+0000 mon.a (mon.0) 3311 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-04-19T23:01:33.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[21528]: audit 2024-04-19T23:01:31.571121+0000 mon.c (mon.2) 856 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:33.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[21528]: audit 2024-04-19T23:01:31.573126+0000 mon.a (mon.0) 3312 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:33.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[28910]: audit 2024-04-19T23:01:31.516087+0000 mon.a (mon.0) 3310 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:33.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[28910]: cluster 2024-04-19T23:01:31.524223+0000 mon.a (mon.0) 3311 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-04-19T23:01:33.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[28910]: audit 2024-04-19T23:01:31.571121+0000 mon.c (mon.2) 856 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:33.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:32 smithi113 bash[28910]: audit 2024-04-19T23:01:31.573126+0000 mon.a (mon.0) 3312 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:33.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:32 smithi178 bash[23441]: audit 2024-04-19T23:01:31.516087+0000 mon.a (mon.0) 3310 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:33.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:32 smithi178 bash[23441]: cluster 2024-04-19T23:01:31.524223+0000 mon.a (mon.0) 3311 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-04-19T23:01:33.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:32 smithi178 bash[23441]: audit 2024-04-19T23:01:31.571121+0000 mon.c (mon.2) 856 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:33.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:32 smithi178 bash[23441]: audit 2024-04-19T23:01:31.573126+0000 mon.a (mon.0) 3312 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:34.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[21528]: cluster 2024-04-19T23:01:32.177345+0000 mgr.y (mgr.24389) 630 : cluster 0 pgmap v1032: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:34.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[21528]: audit 2024-04-19T23:01:32.555443+0000 mon.a (mon.0) 3313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:34.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[21528]: cluster 2024-04-19T23:01:32.565459+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-04-19T23:01:34.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[21528]: audit 2024-04-19T23:01:32.566768+0000 mon.c (mon.2) 857 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:34.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[21528]: audit 2024-04-19T23:01:32.570694+0000 mon.a (mon.0) 3315 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:34.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[28910]: cluster 2024-04-19T23:01:32.177345+0000 mgr.y (mgr.24389) 630 : cluster 0 pgmap v1032: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:34.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[28910]: audit 2024-04-19T23:01:32.555443+0000 mon.a (mon.0) 3313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:34.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[28910]: cluster 2024-04-19T23:01:32.565459+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-04-19T23:01:34.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[28910]: audit 2024-04-19T23:01:32.566768+0000 mon.c (mon.2) 857 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:34.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:33 smithi113 bash[28910]: audit 2024-04-19T23:01:32.570694+0000 mon.a (mon.0) 3315 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:34.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:33 smithi178 bash[23441]: cluster 2024-04-19T23:01:32.177345+0000 mgr.y (mgr.24389) 630 : cluster 0 pgmap v1032: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:34.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:33 smithi178 bash[23441]: audit 2024-04-19T23:01:32.555443+0000 mon.a (mon.0) 3313 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:34.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:33 smithi178 bash[23441]: cluster 2024-04-19T23:01:32.565459+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-04-19T23:01:34.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:33 smithi178 bash[23441]: audit 2024-04-19T23:01:32.566768+0000 mon.c (mon.2) 857 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:34.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:33 smithi178 bash[23441]: audit 2024-04-19T23:01:32.570694+0000 mon.a (mon.0) 3315 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:35.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: audit 2024-04-19T23:01:33.558331+0000 mon.a (mon.0) 3316 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:35.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: cluster 2024-04-19T23:01:33.566485+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: audit 2024-04-19T23:01:33.567709+0000 mon.c (mon.2) 858 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: audit 2024-04-19T23:01:33.569765+0000 mon.a (mon.0) 3318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: cluster 2024-04-19T23:01:34.558773+0000 mon.a (mon.0) 3319 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[21528]: audit 2024-04-19T23:01:34.561422+0000 mon.a (mon.0) 3320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]': finished 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: audit 2024-04-19T23:01:33.558331+0000 mon.a (mon.0) 3316 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: cluster 2024-04-19T23:01:33.566485+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: audit 2024-04-19T23:01:33.567709+0000 mon.c (mon.2) 858 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: audit 2024-04-19T23:01:33.569765+0000 mon.a (mon.0) 3318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: cluster 2024-04-19T23:01:34.558773+0000 mon.a (mon.0) 3319 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:35.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:34 smithi113 bash[28910]: audit 2024-04-19T23:01:34.561422+0000 mon.a (mon.0) 3320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]': finished 2024-04-19T23:01:35.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: audit 2024-04-19T23:01:33.558331+0000 mon.a (mon.0) 3316 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:35.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: cluster 2024-04-19T23:01:33.566485+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-04-19T23:01:35.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: audit 2024-04-19T23:01:33.567709+0000 mon.c (mon.2) 858 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: audit 2024-04-19T23:01:33.569765+0000 mon.a (mon.0) 3318 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]: dispatch 2024-04-19T23:01:35.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: cluster 2024-04-19T23:01:34.558773+0000 mon.a (mon.0) 3319 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:35.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:34 smithi178 bash[23441]: audit 2024-04-19T23:01:34.561422+0000 mon.a (mon.0) 3320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-122", "mode": "writeback"}]': finished 2024-04-19T23:01:35.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[23441]: cluster 2024-04-19T23:01:34.178385+0000 mgr.y (mgr.24389) 631 : cluster 0 pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[23441]: cluster 2024-04-19T23:01:34.569303+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-04-19T23:01:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[23441]: audit 2024-04-19T23:01:34.694002+0000 mon.c (mon.2) 859 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[23441]: audit 2024-04-19T23:01:34.694861+0000 mon.a (mon.0) 3322 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:35 smithi178 bash[23441]: audit 2024-04-19T23:01:34.702357+0000 mon.a (mon.0) 3323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[21528]: cluster 2024-04-19T23:01:34.178385+0000 mgr.y (mgr.24389) 631 : cluster 0 pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[21528]: cluster 2024-04-19T23:01:34.569303+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[21528]: audit 2024-04-19T23:01:34.694002+0000 mon.c (mon.2) 859 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[21528]: audit 2024-04-19T23:01:34.694861+0000 mon.a (mon.0) 3322 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[21528]: audit 2024-04-19T23:01:34.702357+0000 mon.a (mon.0) 3323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:36.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[28910]: cluster 2024-04-19T23:01:34.178385+0000 mgr.y (mgr.24389) 631 : cluster 0 pgmap v1035: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:36.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[28910]: cluster 2024-04-19T23:01:34.569303+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-04-19T23:01:36.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[28910]: audit 2024-04-19T23:01:34.694002+0000 mon.c (mon.2) 859 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:36.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[28910]: audit 2024-04-19T23:01:34.694861+0000 mon.a (mon.0) 3322 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:36.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:35 smithi113 bash[28910]: audit 2024-04-19T23:01:34.702357+0000 mon.a (mon.0) 3323 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[28910]: audit 2024-04-19T23:01:35.447537+0000 mgr.y (mgr.24389) 632 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[28910]: audit 2024-04-19T23:01:35.589356+0000 mon.a (mon.0) 3324 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[28910]: cluster 2024-04-19T23:01:35.597235+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[28910]: audit 2024-04-19T23:01:35.598246+0000 mon.c (mon.2) 860 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[28910]: audit 2024-04-19T23:01:35.599285+0000 mon.a (mon.0) 3326 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[21528]: audit 2024-04-19T23:01:35.447537+0000 mgr.y (mgr.24389) 632 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:37.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[21528]: audit 2024-04-19T23:01:35.589356+0000 mon.a (mon.0) 3324 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:37.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[21528]: cluster 2024-04-19T23:01:35.597235+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-04-19T23:01:37.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[21528]: audit 2024-04-19T23:01:35.598246+0000 mon.c (mon.2) 860 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:36 smithi113 bash[21528]: audit 2024-04-19T23:01:35.599285+0000 mon.a (mon.0) 3326 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:36 smithi178 bash[23441]: audit 2024-04-19T23:01:35.447537+0000 mgr.y (mgr.24389) 632 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:37.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:36 smithi178 bash[23441]: audit 2024-04-19T23:01:35.589356+0000 mon.a (mon.0) 3324 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:37.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:36 smithi178 bash[23441]: cluster 2024-04-19T23:01:35.597235+0000 mon.a (mon.0) 3325 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-04-19T23:01:37.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:36 smithi178 bash[23441]: audit 2024-04-19T23:01:35.598246+0000 mon.c (mon.2) 860 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:36 smithi178 bash[23441]: audit 2024-04-19T23:01:35.599285+0000 mon.a (mon.0) 3326 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]: dispatch 2024-04-19T23:01:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[28910]: cluster 2024-04-19T23:01:36.179232+0000 mgr.y (mgr.24389) 633 : cluster 0 pgmap v1038: 204 pgs: 204 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[28910]: cluster 2024-04-19T23:01:36.590544+0000 mon.a (mon.0) 3327 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[28910]: audit 2024-04-19T23:01:36.602478+0000 mon.a (mon.0) 3328 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[28910]: cluster 2024-04-19T23:01:36.615588+0000 mon.a (mon.0) 3329 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[21528]: cluster 2024-04-19T23:01:36.179232+0000 mgr.y (mgr.24389) 633 : cluster 0 pgmap v1038: 204 pgs: 204 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[21528]: cluster 2024-04-19T23:01:36.590544+0000 mon.a (mon.0) 3327 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[21528]: audit 2024-04-19T23:01:36.602478+0000 mon.a (mon.0) 3328 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[21528]: cluster 2024-04-19T23:01:36.615588+0000 mon.a (mon.0) 3329 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-04-19T23:01:37.802 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:38.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:37 smithi178 bash[23441]: cluster 2024-04-19T23:01:36.179232+0000 mgr.y (mgr.24389) 633 : cluster 0 pgmap v1038: 204 pgs: 204 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-19T23:01:38.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:37 smithi178 bash[23441]: cluster 2024-04-19T23:01:36.590544+0000 mon.a (mon.0) 3327 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:38.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:37 smithi178 bash[23441]: audit 2024-04-19T23:01:36.602478+0000 mon.a (mon.0) 3328 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-122"}]': finished 2024-04-19T23:01:38.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:37 smithi178 bash[23441]: cluster 2024-04-19T23:01:36.615588+0000 mon.a (mon.0) 3329 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-04-19T23:01:39.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:38 smithi113 bash[28910]: cluster 2024-04-19T23:01:37.626653+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-04-19T23:01:39.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:38 smithi113 bash[21528]: cluster 2024-04-19T23:01:37.626653+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-04-19T23:01:39.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:38 smithi178 bash[23441]: cluster 2024-04-19T23:01:37.626653+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[21528]: cluster 2024-04-19T23:01:38.180013+0000 mgr.y (mgr.24389) 634 : cluster 0 pgmap v1041: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[21528]: cluster 2024-04-19T23:01:38.640352+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[21528]: audit 2024-04-19T23:01:38.647804+0000 mon.c (mon.2) 861 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[21528]: audit 2024-04-19T23:01:38.651634+0000 mon.a (mon.0) 3332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[28910]: cluster 2024-04-19T23:01:38.180013+0000 mgr.y (mgr.24389) 634 : cluster 0 pgmap v1041: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:01:40.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[28910]: cluster 2024-04-19T23:01:38.640352+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-04-19T23:01:40.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[28910]: audit 2024-04-19T23:01:38.647804+0000 mon.c (mon.2) 861 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:40.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:39 smithi113 bash[28910]: audit 2024-04-19T23:01:38.651634+0000 mon.a (mon.0) 3332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:40.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:39 smithi178 bash[23441]: cluster 2024-04-19T23:01:38.180013+0000 mgr.y (mgr.24389) 634 : cluster 0 pgmap v1041: 172 pgs: 172 active+clean; 583 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-19T23:01:40.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:39 smithi178 bash[23441]: cluster 2024-04-19T23:01:38.640352+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-04-19T23:01:40.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:39 smithi178 bash[23441]: audit 2024-04-19T23:01:38.647804+0000 mon.c (mon.2) 861 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:40.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:39 smithi178 bash[23441]: audit 2024-04-19T23:01:38.651634+0000 mon.a (mon.0) 3332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:41.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:40 smithi113 bash[21528]: audit 2024-04-19T23:01:39.641480+0000 mon.a (mon.0) 3333 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:41.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:40 smithi113 bash[21528]: cluster 2024-04-19T23:01:39.649116+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-04-19T23:01:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:40 smithi113 bash[28910]: audit 2024-04-19T23:01:39.641480+0000 mon.a (mon.0) 3333 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:40 smithi113 bash[28910]: cluster 2024-04-19T23:01:39.649116+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-04-19T23:01:41.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:40 smithi178 bash[23441]: audit 2024-04-19T23:01:39.641480+0000 mon.a (mon.0) 3333 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:41.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:40 smithi178 bash[23441]: cluster 2024-04-19T23:01:39.649116+0000 mon.a (mon.0) 3334 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-04-19T23:01:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[21528]: cluster 2024-04-19T23:01:40.181960+0000 mgr.y (mgr.24389) 635 : cluster 0 pgmap v1044: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:01:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[21528]: cluster 2024-04-19T23:01:40.661933+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-04-19T23:01:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[21528]: audit 2024-04-19T23:01:40.687721+0000 mon.c (mon.2) 862 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[21528]: audit 2024-04-19T23:01:40.688569+0000 mon.a (mon.0) 3336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:42.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[28910]: cluster 2024-04-19T23:01:40.181960+0000 mgr.y (mgr.24389) 635 : cluster 0 pgmap v1044: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:01:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[28910]: cluster 2024-04-19T23:01:40.661933+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-04-19T23:01:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[28910]: audit 2024-04-19T23:01:40.687721+0000 mon.c (mon.2) 862 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:41 smithi113 bash[28910]: audit 2024-04-19T23:01:40.688569+0000 mon.a (mon.0) 3336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:41 smithi178 bash[23441]: cluster 2024-04-19T23:01:40.181960+0000 mgr.y (mgr.24389) 635 : cluster 0 pgmap v1044: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:01:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:41 smithi178 bash[23441]: cluster 2024-04-19T23:01:40.661933+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-04-19T23:01:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:41 smithi178 bash[23441]: audit 2024-04-19T23:01:40.687721+0000 mon.c (mon.2) 862 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:41 smithi178 bash[23441]: audit 2024-04-19T23:01:40.688569+0000 mon.a (mon.0) 3336 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:41.655898+0000 mon.a (mon.0) 3337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:41.667872+0000 mon.c (mon.2) 863 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: cluster 2024-04-19T23:01:41.668040+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:41.671452+0000 mon.a (mon.0) 3339 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:42.658379+0000 mon.a (mon.0) 3340 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: cluster 2024-04-19T23:01:42.667851+0000 mon.a (mon.0) 3341 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:42.669042+0000 mon.c (mon.2) 864 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[21528]: audit 2024-04-19T23:01:42.670321+0000 mon.a (mon.0) 3342 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:41.655898+0000 mon.a (mon.0) 3337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:41.667872+0000 mon.c (mon.2) 863 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: cluster 2024-04-19T23:01:41.668040+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:41.671452+0000 mon.a (mon.0) 3339 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:42.658379+0000 mon.a (mon.0) 3340 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: cluster 2024-04-19T23:01:42.667851+0000 mon.a (mon.0) 3341 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:42.669042+0000 mon.c (mon.2) 864 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:42 smithi113 bash[28910]: audit 2024-04-19T23:01:42.670321+0000 mon.a (mon.0) 3342 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:41.655898+0000 mon.a (mon.0) 3337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:41.667872+0000 mon.c (mon.2) 863 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: cluster 2024-04-19T23:01:41.668040+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-04-19T23:01:43.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:41.671452+0000 mon.a (mon.0) 3339 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:43.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:42.658379+0000 mon.a (mon.0) 3340 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:43.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: cluster 2024-04-19T23:01:42.667851+0000 mon.a (mon.0) 3341 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-04-19T23:01:43.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:42.669042+0000 mon.c (mon.2) 864 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:43.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:42 smithi178 bash[23441]: audit 2024-04-19T23:01:42.670321+0000 mon.a (mon.0) 3342 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]: dispatch 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[28910]: cluster 2024-04-19T23:01:42.182964+0000 mgr.y (mgr.24389) 636 : cluster 0 pgmap v1047: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[28910]: cluster 2024-04-19T23:01:43.658659+0000 mon.a (mon.0) 3343 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[28910]: audit 2024-04-19T23:01:43.660937+0000 mon.a (mon.0) 3344 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]': finished 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[28910]: cluster 2024-04-19T23:01:43.668909+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[21528]: cluster 2024-04-19T23:01:42.182964+0000 mgr.y (mgr.24389) 636 : cluster 0 pgmap v1047: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[21528]: cluster 2024-04-19T23:01:43.658659+0000 mon.a (mon.0) 3343 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[21528]: audit 2024-04-19T23:01:43.660937+0000 mon.a (mon.0) 3344 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]': finished 2024-04-19T23:01:44.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:43 smithi113 bash[21528]: cluster 2024-04-19T23:01:43.668909+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-04-19T23:01:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:43 smithi178 bash[23441]: cluster 2024-04-19T23:01:42.182964+0000 mgr.y (mgr.24389) 636 : cluster 0 pgmap v1047: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:01:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:43 smithi178 bash[23441]: cluster 2024-04-19T23:01:43.658659+0000 mon.a (mon.0) 3343 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:43 smithi178 bash[23441]: audit 2024-04-19T23:01:43.660937+0000 mon.a (mon.0) 3344 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-124", "mode": "writeback"}]': finished 2024-04-19T23:01:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:43 smithi178 bash[23441]: cluster 2024-04-19T23:01:43.668909+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-04-19T23:01:45.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[28910]: cluster 2024-04-19T23:01:44.183867+0000 mgr.y (mgr.24389) 637 : cluster 0 pgmap v1050: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[28910]: cluster 2024-04-19T23:01:44.704035+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[28910]: audit 2024-04-19T23:01:44.772511+0000 mon.c (mon.2) 865 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[28910]: audit 2024-04-19T23:01:44.773262+0000 mon.a (mon.0) 3347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[21528]: cluster 2024-04-19T23:01:44.183867+0000 mgr.y (mgr.24389) 637 : cluster 0 pgmap v1050: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:46.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[21528]: cluster 2024-04-19T23:01:44.704035+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-04-19T23:01:46.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[21528]: audit 2024-04-19T23:01:44.772511+0000 mon.c (mon.2) 865 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:46.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:45 smithi113 bash[21528]: audit 2024-04-19T23:01:44.773262+0000 mon.a (mon.0) 3347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:45 smithi178 bash[23441]: cluster 2024-04-19T23:01:44.183867+0000 mgr.y (mgr.24389) 637 : cluster 0 pgmap v1050: 204 pgs: 204 active+clean; 583 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:45 smithi178 bash[23441]: cluster 2024-04-19T23:01:44.704035+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-04-19T23:01:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:45 smithi178 bash[23441]: audit 2024-04-19T23:01:44.772511+0000 mon.c (mon.2) 865 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:45 smithi178 bash[23441]: audit 2024-04-19T23:01:44.773262+0000 mon.a (mon.0) 3347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: audit 2024-04-19T23:01:45.454375+0000 mgr.y (mgr.24389) 638 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: audit 2024-04-19T23:01:45.700052+0000 mon.a (mon.0) 3348 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: cluster 2024-04-19T23:01:45.707286+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: audit 2024-04-19T23:01:45.708677+0000 mon.c (mon.2) 866 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: audit 2024-04-19T23:01:45.711289+0000 mon.a (mon.0) 3350 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: cluster 2024-04-19T23:01:46.700279+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: audit 2024-04-19T23:01:46.702471+0000 mon.a (mon.0) 3352 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[21528]: cluster 2024-04-19T23:01:46.710033+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: audit 2024-04-19T23:01:45.454375+0000 mgr.y (mgr.24389) 638 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: audit 2024-04-19T23:01:45.700052+0000 mon.a (mon.0) 3348 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: cluster 2024-04-19T23:01:45.707286+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: audit 2024-04-19T23:01:45.708677+0000 mon.c (mon.2) 866 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: audit 2024-04-19T23:01:45.711289+0000 mon.a (mon.0) 3350 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: cluster 2024-04-19T23:01:46.700279+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:47.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: audit 2024-04-19T23:01:46.702471+0000 mon.a (mon.0) 3352 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:47.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:46 smithi113 bash[28910]: cluster 2024-04-19T23:01:46.710033+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-04-19T23:01:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: audit 2024-04-19T23:01:45.454375+0000 mgr.y (mgr.24389) 638 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: audit 2024-04-19T23:01:45.700052+0000 mon.a (mon.0) 3348 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: cluster 2024-04-19T23:01:45.707286+0000 mon.a (mon.0) 3349 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: audit 2024-04-19T23:01:45.708677+0000 mon.c (mon.2) 866 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: audit 2024-04-19T23:01:45.711289+0000 mon.a (mon.0) 3350 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]: dispatch 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: cluster 2024-04-19T23:01:46.700279+0000 mon.a (mon.0) 3351 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: audit 2024-04-19T23:01:46.702471+0000 mon.a (mon.0) 3352 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-124"}]': finished 2024-04-19T23:01:47.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:46 smithi178 bash[23441]: cluster 2024-04-19T23:01:46.710033+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-04-19T23:01:47.731 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:48.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:47 smithi113 bash[21528]: cluster 2024-04-19T23:01:46.184747+0000 mgr.y (mgr.24389) 639 : cluster 0 pgmap v1053: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-19T23:01:48.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:47 smithi113 bash[28910]: cluster 2024-04-19T23:01:46.184747+0000 mgr.y (mgr.24389) 639 : cluster 0 pgmap v1053: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-19T23:01:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:47 smithi178 bash[23441]: cluster 2024-04-19T23:01:46.184747+0000 mgr.y (mgr.24389) 639 : cluster 0 pgmap v1053: 204 pgs: 204 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-19T23:01:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:48 smithi113 bash[28910]: cluster 2024-04-19T23:01:47.745713+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-04-19T23:01:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:48 smithi113 bash[28910]: cluster 2024-04-19T23:01:48.185518+0000 mgr.y (mgr.24389) 640 : cluster 0 pgmap v1056: 172 pgs: 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T23:01:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:48 smithi113 bash[21528]: cluster 2024-04-19T23:01:47.745713+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-04-19T23:01:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:48 smithi113 bash[21528]: cluster 2024-04-19T23:01:48.185518+0000 mgr.y (mgr.24389) 640 : cluster 0 pgmap v1056: 172 pgs: 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T23:01:49.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:48 smithi178 bash[23441]: cluster 2024-04-19T23:01:47.745713+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-04-19T23:01:49.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:48 smithi178 bash[23441]: cluster 2024-04-19T23:01:48.185518+0000 mgr.y (mgr.24389) 640 : cluster 0 pgmap v1056: 172 pgs: 172 active+clean; 583 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[21528]: cluster 2024-04-19T23:01:48.761624+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[21528]: audit 2024-04-19T23:01:48.764619+0000 mon.c (mon.2) 867 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[21528]: audit 2024-04-19T23:01:48.766611+0000 mon.a (mon.0) 3356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[21528]: audit 2024-04-19T23:01:49.743244+0000 mon.a (mon.0) 3357 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[21528]: audit 2024-04-19T23:01:49.745822+0000 mon.a (mon.0) 3358 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[28910]: cluster 2024-04-19T23:01:48.761624+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-04-19T23:01:50.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[28910]: audit 2024-04-19T23:01:48.764619+0000 mon.c (mon.2) 867 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[28910]: audit 2024-04-19T23:01:48.766611+0000 mon.a (mon.0) 3356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[28910]: audit 2024-04-19T23:01:49.743244+0000 mon.a (mon.0) 3357 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:50.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:49 smithi113 bash[28910]: audit 2024-04-19T23:01:49.745822+0000 mon.a (mon.0) 3358 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:49 smithi178 bash[23441]: cluster 2024-04-19T23:01:48.761624+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-04-19T23:01:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:49 smithi178 bash[23441]: audit 2024-04-19T23:01:48.764619+0000 mon.c (mon.2) 867 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:49 smithi178 bash[23441]: audit 2024-04-19T23:01:48.766611+0000 mon.a (mon.0) 3356 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:50.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:49 smithi178 bash[23441]: audit 2024-04-19T23:01:49.743244+0000 mon.a (mon.0) 3357 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:01:50.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:49 smithi178 bash[23441]: audit 2024-04-19T23:01:49.745822+0000 mon.a (mon.0) 3358 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[28910]: audit 2024-04-19T23:01:49.753651+0000 mon.a (mon.0) 3359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[28910]: cluster 2024-04-19T23:01:49.761689+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[28910]: audit 2024-04-19T23:01:49.789122+0000 mon.c (mon.2) 868 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[28910]: audit 2024-04-19T23:01:49.796719+0000 mon.a (mon.0) 3361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[28910]: cluster 2024-04-19T23:01:50.187484+0000 mgr.y (mgr.24389) 641 : cluster 0 pgmap v1059: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[21528]: audit 2024-04-19T23:01:49.753651+0000 mon.a (mon.0) 3359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[21528]: cluster 2024-04-19T23:01:49.761689+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-04-19T23:01:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[21528]: audit 2024-04-19T23:01:49.789122+0000 mon.c (mon.2) 868 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[21528]: audit 2024-04-19T23:01:49.796719+0000 mon.a (mon.0) 3361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:50 smithi113 bash[21528]: cluster 2024-04-19T23:01:50.187484+0000 mgr.y (mgr.24389) 641 : cluster 0 pgmap v1059: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:50 smithi178 bash[23441]: audit 2024-04-19T23:01:49.753651+0000 mon.a (mon.0) 3359 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:50 smithi178 bash[23441]: cluster 2024-04-19T23:01:49.761689+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-04-19T23:01:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:50 smithi178 bash[23441]: audit 2024-04-19T23:01:49.789122+0000 mon.c (mon.2) 868 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:50 smithi178 bash[23441]: audit 2024-04-19T23:01:49.796719+0000 mon.a (mon.0) 3361 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:51.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:50 smithi178 bash[23441]: cluster 2024-04-19T23:01:50.187484+0000 mgr.y (mgr.24389) 641 : cluster 0 pgmap v1059: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:50.778971+0000 mon.a (mon.0) 3362 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: cluster 2024-04-19T23:01:50.787784+0000 mon.a (mon.0) 3363 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:50.789102+0000 mon.c (mon.2) 869 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:50.790282+0000 mon.a (mon.0) 3364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:51.430118+0000 mon.a (mon.0) 3365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: cluster 2024-04-19T23:01:51.439769+0000 mon.a (mon.0) 3366 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-04-19T23:01:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:51.445141+0000 mon.c (mon.2) 870 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[28910]: audit 2024-04-19T23:01:51.446967+0000 mon.a (mon.0) 3367 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:50.778971+0000 mon.a (mon.0) 3362 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: cluster 2024-04-19T23:01:50.787784+0000 mon.a (mon.0) 3363 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:50.789102+0000 mon.c (mon.2) 869 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:50.790282+0000 mon.a (mon.0) 3364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:51.430118+0000 mon.a (mon.0) 3365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: cluster 2024-04-19T23:01:51.439769+0000 mon.a (mon.0) 3366 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:51.445141+0000 mon.c (mon.2) 870 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:52.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:51 smithi113 bash[21528]: audit 2024-04-19T23:01:51.446967+0000 mon.a (mon.0) 3367 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:50.778971+0000 mon.a (mon.0) 3362 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: cluster 2024-04-19T23:01:50.787784+0000 mon.a (mon.0) 3363 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:50.789102+0000 mon.c (mon.2) 869 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:50.790282+0000 mon.a (mon.0) 3364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:51.430118+0000 mon.a (mon.0) 3365 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: cluster 2024-04-19T23:01:51.439769+0000 mon.a (mon.0) 3366 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:51.445141+0000 mon.c (mon.2) 870 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:51 smithi178 bash[23441]: audit 2024-04-19T23:01:51.446967+0000 mon.a (mon.0) 3367 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]: dispatch 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: cluster 2024-04-19T23:01:52.188334+0000 mgr.y (mgr.24389) 642 : cluster 0 pgmap v1062: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: cluster 2024-04-19T23:01:52.430595+0000 mon.a (mon.0) 3368 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: audit 2024-04-19T23:01:52.433107+0000 mon.a (mon.0) 3369 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]': finished 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: cluster 2024-04-19T23:01:52.441873+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: audit 2024-04-19T23:01:52.581609+0000 mon.c (mon.2) 871 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[21528]: audit 2024-04-19T23:01:52.582442+0000 mon.a (mon.0) 3371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: cluster 2024-04-19T23:01:52.188334+0000 mgr.y (mgr.24389) 642 : cluster 0 pgmap v1062: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: cluster 2024-04-19T23:01:52.430595+0000 mon.a (mon.0) 3368 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: audit 2024-04-19T23:01:52.433107+0000 mon.a (mon.0) 3369 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]': finished 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: cluster 2024-04-19T23:01:52.441873+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: audit 2024-04-19T23:01:52.581609+0000 mon.c (mon.2) 871 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:53.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:52 smithi113 bash[28910]: audit 2024-04-19T23:01:52.582442+0000 mon.a (mon.0) 3371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:53.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: cluster 2024-04-19T23:01:52.188334+0000 mgr.y (mgr.24389) 642 : cluster 0 pgmap v1062: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:01:53.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: cluster 2024-04-19T23:01:52.430595+0000 mon.a (mon.0) 3368 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:01:53.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: audit 2024-04-19T23:01:52.433107+0000 mon.a (mon.0) 3369 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-126", "mode": "writeback"}]': finished 2024-04-19T23:01:53.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: cluster 2024-04-19T23:01:52.441873+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-04-19T23:01:53.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: audit 2024-04-19T23:01:52.581609+0000 mon.c (mon.2) 871 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:53.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:52 smithi178 bash[23441]: audit 2024-04-19T23:01:52.582442+0000 mon.a (mon.0) 3371 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[21528]: audit 2024-04-19T23:01:53.435820+0000 mon.a (mon.0) 3372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[21528]: cluster 2024-04-19T23:01:53.445289+0000 mon.a (mon.0) 3373 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[21528]: audit 2024-04-19T23:01:53.447771+0000 mon.c (mon.2) 872 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[21528]: audit 2024-04-19T23:01:53.449120+0000 mon.a (mon.0) 3374 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[28910]: audit 2024-04-19T23:01:53.435820+0000 mon.a (mon.0) 3372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[28910]: cluster 2024-04-19T23:01:53.445289+0000 mon.a (mon.0) 3373 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-04-19T23:01:54.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[28910]: audit 2024-04-19T23:01:53.447771+0000 mon.c (mon.2) 872 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:54.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:54 smithi113 bash[28910]: audit 2024-04-19T23:01:53.449120+0000 mon.a (mon.0) 3374 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:54 smithi178 bash[23441]: audit 2024-04-19T23:01:53.435820+0000 mon.a (mon.0) 3372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:01:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:54 smithi178 bash[23441]: cluster 2024-04-19T23:01:53.445289+0000 mon.a (mon.0) 3373 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-04-19T23:01:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:54 smithi178 bash[23441]: audit 2024-04-19T23:01:53.447771+0000 mon.c (mon.2) 872 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:54.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:54 smithi178 bash[23441]: audit 2024-04-19T23:01:53.449120+0000 mon.a (mon.0) 3374 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]: dispatch 2024-04-19T23:01:55.464 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.464 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9104 ms) 2024-04-19T23:01:55.464 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6081 ms) 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5050 ms) 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25565 ms) 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14069 ms) 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12134 ms) 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-19T23:01:55.465 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 00000010 69 73 |is| 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 00000012 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12094 ms) 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: require_osd_release = squid 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6084 ms) 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (564544 ms total) 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1031 ms) 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-19T23:01:55.466 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11105 ms) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18120 ms) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (4 ms) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30260 ms total) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7061 ms) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8100 ms) 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: waiting for scrub... 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: done waiting 2024-04-19T23:01:55.467 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24296 ms) 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10005 ms) 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8066 ms) 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8134 ms) 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10119 ms) 2024-04-19T23:01:55.468 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[21528]: cluster 2024-04-19T23:01:54.189103+0000 mgr.y (mgr.24389) 643 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[21528]: cluster 2024-04-19T23:01:54.436134+0000 mon.a (mon.0) 3375 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[21528]: audit 2024-04-19T23:01:54.438249+0000 mon.a (mon.0) 3376 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[21528]: cluster 2024-04-19T23:01:54.446105+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[28910]: cluster 2024-04-19T23:01:54.189103+0000 mgr.y (mgr.24389) 643 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[28910]: cluster 2024-04-19T23:01:54.436134+0000 mon.a (mon.0) 3375 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[28910]: audit 2024-04-19T23:01:54.438249+0000 mon.a (mon.0) 3376 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:55.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:55 smithi113 bash[28910]: cluster 2024-04-19T23:01:54.446105+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-04-19T23:01:55.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:01:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:01:55.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:55 smithi178 bash[23441]: cluster 2024-04-19T23:01:54.189103+0000 mgr.y (mgr.24389) 643 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 583 KiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:01:55.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:55 smithi178 bash[23441]: cluster 2024-04-19T23:01:54.436134+0000 mon.a (mon.0) 3375 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:01:55.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:55 smithi178 bash[23441]: audit 2024-04-19T23:01:54.438249+0000 mon.a (mon.0) 3376 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-126"}]': finished 2024-04-19T23:01:55.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:55 smithi178 bash[23441]: cluster 2024-04-19T23:01:54.446105+0000 mon.a (mon.0) 3377 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-04-19T23:01:56.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:56 smithi113 bash[28910]: cluster 2024-04-19T23:01:55.460321+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-04-19T23:01:56.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:56 smithi113 bash[28910]: audit 2024-04-19T23:01:55.465987+0000 mgr.y (mgr.24389) 644 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:56.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:56 smithi113 bash[21528]: cluster 2024-04-19T23:01:55.460321+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-04-19T23:01:56.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:56 smithi113 bash[21528]: audit 2024-04-19T23:01:55.465987+0000 mgr.y (mgr.24389) 644 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:56.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:56 smithi178 bash[23441]: cluster 2024-04-19T23:01:55.460321+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-04-19T23:01:56.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:56 smithi178 bash[23441]: audit 2024-04-19T23:01:55.465987+0000 mgr.y (mgr.24389) 644 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:01:57.800 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:01:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:01:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[21528]: cluster 2024-04-19T23:01:56.190024+0000 mgr.y (mgr.24389) 645 : cluster 0 pgmap v1068: 172 pgs: 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[21528]: cluster 2024-04-19T23:01:56.485520+0000 mon.a (mon.0) 3379 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-04-19T23:01:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[21528]: audit 2024-04-19T23:01:56.491528+0000 mon.c (mon.2) 873 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[21528]: audit 2024-04-19T23:01:56.503459+0000 mon.a (mon.0) 3380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:57.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[28910]: cluster 2024-04-19T23:01:56.190024+0000 mgr.y (mgr.24389) 645 : cluster 0 pgmap v1068: 172 pgs: 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:57.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[28910]: cluster 2024-04-19T23:01:56.485520+0000 mon.a (mon.0) 3379 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-04-19T23:01:57.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[28910]: audit 2024-04-19T23:01:56.491528+0000 mon.c (mon.2) 873 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:57.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:57 smithi113 bash[28910]: audit 2024-04-19T23:01:56.503459+0000 mon.a (mon.0) 3380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:57.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:57 smithi178 bash[23441]: cluster 2024-04-19T23:01:56.190024+0000 mgr.y (mgr.24389) 645 : cluster 0 pgmap v1068: 172 pgs: 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:57.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:57 smithi178 bash[23441]: cluster 2024-04-19T23:01:56.485520+0000 mon.a (mon.0) 3379 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-04-19T23:01:57.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:57 smithi178 bash[23441]: audit 2024-04-19T23:01:56.491528+0000 mon.c (mon.2) 873 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:57.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:57 smithi178 bash[23441]: audit 2024-04-19T23:01:56.503459+0000 mon.a (mon.0) 3380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[21528]: audit 2024-04-19T23:01:57.489603+0000 mon.a (mon.0) 3381 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[21528]: cluster 2024-04-19T23:01:57.497781+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[21528]: audit 2024-04-19T23:01:57.504509+0000 mon.c (mon.2) 874 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[21528]: audit 2024-04-19T23:01:57.505880+0000 mon.a (mon.0) 3383 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[28910]: audit 2024-04-19T23:01:57.489603+0000 mon.a (mon.0) 3381 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[28910]: cluster 2024-04-19T23:01:57.497781+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-04-19T23:01:58.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[28910]: audit 2024-04-19T23:01:57.504509+0000 mon.c (mon.2) 874 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:58.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:58 smithi113 bash[28910]: audit 2024-04-19T23:01:57.505880+0000 mon.a (mon.0) 3383 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:58.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:58 smithi178 bash[23441]: audit 2024-04-19T23:01:57.489603+0000 mon.a (mon.0) 3381 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:01:58.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:58 smithi178 bash[23441]: cluster 2024-04-19T23:01:57.497781+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-04-19T23:01:58.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:58 smithi178 bash[23441]: audit 2024-04-19T23:01:57.504509+0000 mon.c (mon.2) 874 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:58.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:58 smithi178 bash[23441]: audit 2024-04-19T23:01:57.505880+0000 mon.a (mon.0) 3383 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[28910]: cluster 2024-04-19T23:01:58.190858+0000 mgr.y (mgr.24389) 646 : cluster 0 pgmap v1071: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[28910]: audit 2024-04-19T23:01:58.498100+0000 mon.a (mon.0) 3384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[28910]: cluster 2024-04-19T23:01:58.507195+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[28910]: audit 2024-04-19T23:01:58.507786+0000 mon.c (mon.2) 875 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[28910]: audit 2024-04-19T23:01:58.510638+0000 mon.a (mon.0) 3386 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[21528]: cluster 2024-04-19T23:01:58.190858+0000 mgr.y (mgr.24389) 646 : cluster 0 pgmap v1071: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:59.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[21528]: audit 2024-04-19T23:01:58.498100+0000 mon.a (mon.0) 3384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:59.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[21528]: cluster 2024-04-19T23:01:58.507195+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-04-19T23:01:59.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[21528]: audit 2024-04-19T23:01:58.507786+0000 mon.c (mon.2) 875 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:01:59.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:01:59 smithi113 bash[21528]: audit 2024-04-19T23:01:58.510638+0000 mon.a (mon.0) 3386 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:01:59.808 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:59 smithi178 bash[23441]: cluster 2024-04-19T23:01:58.190858+0000 mgr.y (mgr.24389) 646 : cluster 0 pgmap v1071: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:01:59.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:59 smithi178 bash[23441]: audit 2024-04-19T23:01:58.498100+0000 mon.a (mon.0) 3384 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:01:59.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:59 smithi178 bash[23441]: cluster 2024-04-19T23:01:58.507195+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-04-19T23:01:59.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:59 smithi178 bash[23441]: audit 2024-04-19T23:01:58.507786+0000 mon.c (mon.2) 875 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:01:59.809 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:01:59 smithi178 bash[23441]: audit 2024-04-19T23:01:58.510638+0000 mon.a (mon.0) 3386 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:00.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[21528]: audit 2024-04-19T23:01:59.510213+0000 mon.a (mon.0) 3387 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:00.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[21528]: cluster 2024-04-19T23:01:59.518386+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-04-19T23:02:00.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[21528]: audit 2024-04-19T23:01:59.520449+0000 mon.c (mon.2) 876 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:00.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[21528]: audit 2024-04-19T23:01:59.522364+0000 mon.a (mon.0) 3389 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:00.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[28910]: audit 2024-04-19T23:01:59.510213+0000 mon.a (mon.0) 3387 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:00.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[28910]: cluster 2024-04-19T23:01:59.518386+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-04-19T23:02:00.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[28910]: audit 2024-04-19T23:01:59.520449+0000 mon.c (mon.2) 876 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:00.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:00 smithi113 bash[28910]: audit 2024-04-19T23:01:59.522364+0000 mon.a (mon.0) 3389 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:00.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:00 smithi178 bash[23441]: audit 2024-04-19T23:01:59.510213+0000 mon.a (mon.0) 3387 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:00.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:00 smithi178 bash[23441]: cluster 2024-04-19T23:01:59.518386+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-04-19T23:02:00.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:00 smithi178 bash[23441]: audit 2024-04-19T23:01:59.520449+0000 mon.c (mon.2) 876 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:00.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:00 smithi178 bash[23441]: audit 2024-04-19T23:01:59.522364+0000 mon.a (mon.0) 3389 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]: dispatch 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[28910]: cluster 2024-04-19T23:02:00.192849+0000 mgr.y (mgr.24389) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[28910]: cluster 2024-04-19T23:02:00.511185+0000 mon.a (mon.0) 3390 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[28910]: audit 2024-04-19T23:02:00.521618+0000 mon.a (mon.0) 3391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]': finished 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[28910]: cluster 2024-04-19T23:02:00.532048+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[21528]: cluster 2024-04-19T23:02:00.192849+0000 mgr.y (mgr.24389) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[21528]: cluster 2024-04-19T23:02:00.511185+0000 mon.a (mon.0) 3390 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[21528]: audit 2024-04-19T23:02:00.521618+0000 mon.a (mon.0) 3391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]': finished 2024-04-19T23:02:01.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:01 smithi113 bash[21528]: cluster 2024-04-19T23:02:00.532048+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-04-19T23:02:01.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:01 smithi178 bash[23441]: cluster 2024-04-19T23:02:00.192849+0000 mgr.y (mgr.24389) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:01.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:01 smithi178 bash[23441]: cluster 2024-04-19T23:02:00.511185+0000 mon.a (mon.0) 3390 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:01.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:01 smithi178 bash[23441]: audit 2024-04-19T23:02:00.521618+0000 mon.a (mon.0) 3391 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-128", "mode": "writeback"}]': finished 2024-04-19T23:02:01.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:01 smithi178 bash[23441]: cluster 2024-04-19T23:02:00.532048+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-04-19T23:02:03.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:03 smithi113 bash[21528]: cluster 2024-04-19T23:02:02.193758+0000 mgr.y (mgr.24389) 648 : cluster 0 pgmap v1076: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-04-19T23:02:03.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:03 smithi113 bash[21528]: audit 2024-04-19T23:02:03.400541+0000 mon.a (mon.0) 3393 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:02:03.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:03 smithi113 bash[28910]: cluster 2024-04-19T23:02:02.193758+0000 mgr.y (mgr.24389) 648 : cluster 0 pgmap v1076: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-04-19T23:02:03.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:03 smithi113 bash[28910]: audit 2024-04-19T23:02:03.400541+0000 mon.a (mon.0) 3393 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:02:03.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:03 smithi178 bash[23441]: cluster 2024-04-19T23:02:02.193758+0000 mgr.y (mgr.24389) 648 : cluster 0 pgmap v1076: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-04-19T23:02:03.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:03 smithi178 bash[23441]: audit 2024-04-19T23:02:03.400541+0000 mon.a (mon.0) 3393 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:02:04.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[21528]: audit 2024-04-19T23:02:04.187261+0000 mon.a (mon.0) 3394 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:02:04.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[21528]: audit 2024-04-19T23:02:04.189027+0000 mon.a (mon.0) 3395 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:02:04.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[21528]: audit 2024-04-19T23:02:04.195820+0000 mon.a (mon.0) 3396 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:04.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[28910]: audit 2024-04-19T23:02:04.187261+0000 mon.a (mon.0) 3394 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:02:04.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[28910]: audit 2024-04-19T23:02:04.189027+0000 mon.a (mon.0) 3395 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:02:04.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:04 smithi113 bash[28910]: audit 2024-04-19T23:02:04.195820+0000 mon.a (mon.0) 3396 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:04.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:04 smithi178 bash[23441]: audit 2024-04-19T23:02:04.187261+0000 mon.a (mon.0) 3394 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:02:04.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:04 smithi178 bash[23441]: audit 2024-04-19T23:02:04.189027+0000 mon.a (mon.0) 3395 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:02:04.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:04 smithi178 bash[23441]: audit 2024-04-19T23:02:04.195820+0000 mon.a (mon.0) 3396 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[28910]: cluster 2024-04-19T23:02:04.194582+0000 mgr.y (mgr.24389) 649 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[28910]: audit 2024-04-19T23:02:04.813317+0000 mon.a (mon.0) 3397 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[28910]: audit 2024-04-19T23:02:04.815829+0000 mon.a (mon.0) 3398 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[21528]: cluster 2024-04-19T23:02:04.194582+0000 mgr.y (mgr.24389) 649 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[21528]: audit 2024-04-19T23:02:04.813317+0000 mon.a (mon.0) 3397 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:05.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:05 smithi113 bash[21528]: audit 2024-04-19T23:02:04.815829+0000 mon.a (mon.0) 3398 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:05 smithi178 bash[23441]: cluster 2024-04-19T23:02:04.194582+0000 mgr.y (mgr.24389) 649 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-04-19T23:02:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:05 smithi178 bash[23441]: audit 2024-04-19T23:02:04.813317+0000 mon.a (mon.0) 3397 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:05 smithi178 bash[23441]: audit 2024-04-19T23:02:04.815829+0000 mon.a (mon.0) 3398 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:05.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:06.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[21528]: audit 2024-04-19T23:02:05.480704+0000 mgr.y (mgr.24389) 650 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:06.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[21528]: audit 2024-04-19T23:02:05.682079+0000 mon.c (mon.2) 877 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:06.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[21528]: audit 2024-04-19T23:02:05.682831+0000 mon.a (mon.0) 3399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:06.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[28910]: audit 2024-04-19T23:02:05.480704+0000 mgr.y (mgr.24389) 650 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:06.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[28910]: audit 2024-04-19T23:02:05.682079+0000 mon.c (mon.2) 877 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:06.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:06 smithi113 bash[28910]: audit 2024-04-19T23:02:05.682831+0000 mon.a (mon.0) 3399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:06.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:06 smithi178 bash[23441]: audit 2024-04-19T23:02:05.480704+0000 mgr.y (mgr.24389) 650 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:06.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:06 smithi178 bash[23441]: audit 2024-04-19T23:02:05.682079+0000 mon.c (mon.2) 877 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:06.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:06 smithi178 bash[23441]: audit 2024-04-19T23:02:05.682831+0000 mon.a (mon.0) 3399 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21528]: cluster 2024-04-19T23:02:06.196650+0000 mgr.y (mgr.24389) 651 : cluster 0 pgmap v1078: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21528]: audit 2024-04-19T23:02:06.546467+0000 mon.a (mon.0) 3400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21528]: cluster 2024-04-19T23:02:06.553504+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21528]: audit 2024-04-19T23:02:06.555234+0000 mon.c (mon.2) 878 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[21528]: audit 2024-04-19T23:02:06.556790+0000 mon.a (mon.0) 3402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:07.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[28910]: cluster 2024-04-19T23:02:06.196650+0000 mgr.y (mgr.24389) 651 : cluster 0 pgmap v1078: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:07.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[28910]: audit 2024-04-19T23:02:06.546467+0000 mon.a (mon.0) 3400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:07.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[28910]: cluster 2024-04-19T23:02:06.553504+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-04-19T23:02:07.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[28910]: audit 2024-04-19T23:02:06.555234+0000 mon.c (mon.2) 878 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:07.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:07 smithi113 bash[28910]: audit 2024-04-19T23:02:06.556790+0000 mon.a (mon.0) 3402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:08.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:07 smithi178 bash[23441]: cluster 2024-04-19T23:02:06.196650+0000 mgr.y (mgr.24389) 651 : cluster 0 pgmap v1078: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:08.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:07 smithi178 bash[23441]: audit 2024-04-19T23:02:06.546467+0000 mon.a (mon.0) 3400 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:08.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:07 smithi178 bash[23441]: cluster 2024-04-19T23:02:06.553504+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-04-19T23:02:08.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:07 smithi178 bash[23441]: audit 2024-04-19T23:02:06.555234+0000 mon.c (mon.2) 878 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:08.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:07 smithi178 bash[23441]: audit 2024-04-19T23:02:06.556790+0000 mon.a (mon.0) 3402 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]: dispatch 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[28910]: cluster 2024-04-19T23:02:07.547034+0000 mon.a (mon.0) 3403 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[28910]: audit 2024-04-19T23:02:07.549645+0000 mon.a (mon.0) 3404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[28910]: cluster 2024-04-19T23:02:07.559610+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[21528]: cluster 2024-04-19T23:02:07.547034+0000 mon.a (mon.0) 3403 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[21528]: audit 2024-04-19T23:02:07.549645+0000 mon.a (mon.0) 3404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:09.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:08 smithi113 bash[21528]: cluster 2024-04-19T23:02:07.559610+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-04-19T23:02:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:08 smithi178 bash[23441]: cluster 2024-04-19T23:02:07.547034+0000 mon.a (mon.0) 3403 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:08 smithi178 bash[23441]: audit 2024-04-19T23:02:07.549645+0000 mon.a (mon.0) 3404 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-128"}]': finished 2024-04-19T23:02:09.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:08 smithi178 bash[23441]: cluster 2024-04-19T23:02:07.559610+0000 mon.a (mon.0) 3405 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-04-19T23:02:10.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[21528]: cluster 2024-04-19T23:02:08.197440+0000 mgr.y (mgr.24389) 652 : cluster 0 pgmap v1081: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 800 B/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[21528]: cluster 2024-04-19T23:02:08.566286+0000 mon.a (mon.0) 3406 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:10.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[21528]: cluster 2024-04-19T23:02:08.584164+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-04-19T23:02:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[28910]: cluster 2024-04-19T23:02:08.197440+0000 mgr.y (mgr.24389) 652 : cluster 0 pgmap v1081: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 800 B/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[28910]: cluster 2024-04-19T23:02:08.566286+0000 mon.a (mon.0) 3406 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:10.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:09 smithi113 bash[28910]: cluster 2024-04-19T23:02:08.584164+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-04-19T23:02:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:09 smithi178 bash[23441]: cluster 2024-04-19T23:02:08.197440+0000 mgr.y (mgr.24389) 652 : cluster 0 pgmap v1081: 204 pgs: 204 active+clean; 583 KiB data, 683 MiB used, 715 GiB / 715 GiB avail; 800 B/s rd, 266 B/s wr, 1 op/s 2024-04-19T23:02:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:09 smithi178 bash[23441]: cluster 2024-04-19T23:02:08.566286+0000 mon.a (mon.0) 3406 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:10.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:09 smithi178 bash[23441]: cluster 2024-04-19T23:02:08.584164+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-04-19T23:02:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[28910]: cluster 2024-04-19T23:02:09.592220+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-04-19T23:02:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[28910]: audit 2024-04-19T23:02:09.602041+0000 mon.c (mon.2) 879 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:11.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[28910]: audit 2024-04-19T23:02:09.605147+0000 mon.a (mon.0) 3409 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[21528]: cluster 2024-04-19T23:02:09.592220+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-04-19T23:02:11.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[21528]: audit 2024-04-19T23:02:09.602041+0000 mon.c (mon.2) 879 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:11.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:10 smithi113 bash[21528]: audit 2024-04-19T23:02:09.605147+0000 mon.a (mon.0) 3409 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:10 smithi178 bash[23441]: cluster 2024-04-19T23:02:09.592220+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-04-19T23:02:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:10 smithi178 bash[23441]: audit 2024-04-19T23:02:09.602041+0000 mon.c (mon.2) 879 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:11.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:10 smithi178 bash[23441]: audit 2024-04-19T23:02:09.605147+0000 mon.a (mon.0) 3409 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[21528]: cluster 2024-04-19T23:02:10.199501+0000 mgr.y (mgr.24389) 653 : cluster 0 pgmap v1084: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[21528]: audit 2024-04-19T23:02:10.596545+0000 mon.a (mon.0) 3410 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[21528]: cluster 2024-04-19T23:02:10.605867+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-04-19T23:02:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[21528]: audit 2024-04-19T23:02:10.609831+0000 mon.c (mon.2) 880 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[21528]: audit 2024-04-19T23:02:10.613834+0000 mon.a (mon.0) 3412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[28910]: cluster 2024-04-19T23:02:10.199501+0000 mgr.y (mgr.24389) 653 : cluster 0 pgmap v1084: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[28910]: audit 2024-04-19T23:02:10.596545+0000 mon.a (mon.0) 3410 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[28910]: cluster 2024-04-19T23:02:10.605867+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-04-19T23:02:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[28910]: audit 2024-04-19T23:02:10.609831+0000 mon.c (mon.2) 880 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:11 smithi113 bash[28910]: audit 2024-04-19T23:02:10.613834+0000 mon.a (mon.0) 3412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:11 smithi178 bash[23441]: cluster 2024-04-19T23:02:10.199501+0000 mgr.y (mgr.24389) 653 : cluster 0 pgmap v1084: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:12.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:11 smithi178 bash[23441]: audit 2024-04-19T23:02:10.596545+0000 mon.a (mon.0) 3410 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:12.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:11 smithi178 bash[23441]: cluster 2024-04-19T23:02:10.605867+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-04-19T23:02:12.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:11 smithi178 bash[23441]: audit 2024-04-19T23:02:10.609831+0000 mon.c (mon.2) 880 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:11 smithi178 bash[23441]: audit 2024-04-19T23:02:10.613834+0000 mon.a (mon.0) 3412 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:12.556 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[50863]: logger=sqlstore.transactions t=2024-04-19T23:02:12.288607629Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-04-19T23:02:13.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: audit 2024-04-19T23:02:11.599372+0000 mon.a (mon.0) 3413 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:13.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: cluster 2024-04-19T23:02:11.607489+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-04-19T23:02:13.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: audit 2024-04-19T23:02:11.609399+0000 mon.c (mon.2) 881 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: audit 2024-04-19T23:02:11.612311+0000 mon.a (mon.0) 3415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: audit 2024-04-19T23:02:12.601913+0000 mon.a (mon.0) 3416 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[28910]: cluster 2024-04-19T23:02:12.609567+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: audit 2024-04-19T23:02:11.599372+0000 mon.a (mon.0) 3413 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: cluster 2024-04-19T23:02:11.607489+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: audit 2024-04-19T23:02:11.609399+0000 mon.c (mon.2) 881 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: audit 2024-04-19T23:02:11.612311+0000 mon.a (mon.0) 3415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: audit 2024-04-19T23:02:12.601913+0000 mon.a (mon.0) 3416 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:13.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:12 smithi113 bash[21528]: cluster 2024-04-19T23:02:12.609567+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-04-19T23:02:13.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: audit 2024-04-19T23:02:11.599372+0000 mon.a (mon.0) 3413 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:13.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: cluster 2024-04-19T23:02:11.607489+0000 mon.a (mon.0) 3414 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-04-19T23:02:13.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: audit 2024-04-19T23:02:11.609399+0000 mon.c (mon.2) 881 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: audit 2024-04-19T23:02:11.612311+0000 mon.a (mon.0) 3415 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:13.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: audit 2024-04-19T23:02:12.601913+0000 mon.a (mon.0) 3416 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:13.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:12 smithi178 bash[23441]: cluster 2024-04-19T23:02:12.609567+0000 mon.a (mon.0) 3417 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-04-19T23:02:14.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: cluster 2024-04-19T23:02:12.200427+0000 mgr.y (mgr.24389) 654 : cluster 0 pgmap v1087: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:14.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: audit 2024-04-19T23:02:12.611562+0000 mon.c (mon.2) 882 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: audit 2024-04-19T23:02:12.612829+0000 mon.a (mon.0) 3418 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: cluster 2024-04-19T23:02:13.602195+0000 mon.a (mon.0) 3419 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: audit 2024-04-19T23:02:13.604657+0000 mon.a (mon.0) 3420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]': finished 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[21528]: cluster 2024-04-19T23:02:13.612735+0000 mon.a (mon.0) 3421 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: cluster 2024-04-19T23:02:12.200427+0000 mgr.y (mgr.24389) 654 : cluster 0 pgmap v1087: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: audit 2024-04-19T23:02:12.611562+0000 mon.c (mon.2) 882 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: audit 2024-04-19T23:02:12.612829+0000 mon.a (mon.0) 3418 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: cluster 2024-04-19T23:02:13.602195+0000 mon.a (mon.0) 3419 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: audit 2024-04-19T23:02:13.604657+0000 mon.a (mon.0) 3420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]': finished 2024-04-19T23:02:14.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:13 smithi113 bash[28910]: cluster 2024-04-19T23:02:13.612735+0000 mon.a (mon.0) 3421 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-04-19T23:02:14.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: cluster 2024-04-19T23:02:12.200427+0000 mgr.y (mgr.24389) 654 : cluster 0 pgmap v1087: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:14.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: audit 2024-04-19T23:02:12.611562+0000 mon.c (mon.2) 882 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: audit 2024-04-19T23:02:12.612829+0000 mon.a (mon.0) 3418 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]: dispatch 2024-04-19T23:02:14.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: cluster 2024-04-19T23:02:13.602195+0000 mon.a (mon.0) 3419 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:14.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: audit 2024-04-19T23:02:13.604657+0000 mon.a (mon.0) 3420 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-130", "mode": "writeback"}]': finished 2024-04-19T23:02:14.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:13 smithi178 bash[23441]: cluster 2024-04-19T23:02:13.612735+0000 mon.a (mon.0) 3421 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-04-19T23:02:15.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:14 smithi113 bash[21528]: audit 2024-04-19T23:02:13.803152+0000 mon.c (mon.2) 883 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:14 smithi113 bash[21528]: audit 2024-04-19T23:02:13.803925+0000 mon.a (mon.0) 3422 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:14 smithi113 bash[28910]: audit 2024-04-19T23:02:13.803152+0000 mon.c (mon.2) 883 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:14 smithi113 bash[28910]: audit 2024-04-19T23:02:13.803925+0000 mon.a (mon.0) 3422 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:14 smithi178 bash[23441]: audit 2024-04-19T23:02:13.803152+0000 mon.c (mon.2) 883 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:14 smithi178 bash[23441]: audit 2024-04-19T23:02:13.803925+0000 mon.a (mon.0) 3422 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:15.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[23441]: cluster 2024-04-19T23:02:14.201261+0000 mgr.y (mgr.24389) 655 : cluster 0 pgmap v1090: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[23441]: audit 2024-04-19T23:02:14.632688+0000 mon.a (mon.0) 3423 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[23441]: cluster 2024-04-19T23:02:14.639559+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-04-19T23:02:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[23441]: audit 2024-04-19T23:02:14.643191+0000 mon.c (mon.2) 884 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:15.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:15 smithi178 bash[23441]: audit 2024-04-19T23:02:14.644328+0000 mon.a (mon.0) 3425 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:16.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[28910]: cluster 2024-04-19T23:02:14.201261+0000 mgr.y (mgr.24389) 655 : cluster 0 pgmap v1090: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:16.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[28910]: audit 2024-04-19T23:02:14.632688+0000 mon.a (mon.0) 3423 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:16.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[28910]: cluster 2024-04-19T23:02:14.639559+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-04-19T23:02:16.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[28910]: audit 2024-04-19T23:02:14.643191+0000 mon.c (mon.2) 884 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:16.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[28910]: audit 2024-04-19T23:02:14.644328+0000 mon.a (mon.0) 3425 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:16.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[21528]: cluster 2024-04-19T23:02:14.201261+0000 mgr.y (mgr.24389) 655 : cluster 0 pgmap v1090: 204 pgs: 32 creating+peering, 172 active+clean; 583 KiB data, 684 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:16.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[21528]: audit 2024-04-19T23:02:14.632688+0000 mon.a (mon.0) 3423 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:16.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[21528]: cluster 2024-04-19T23:02:14.639559+0000 mon.a (mon.0) 3424 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-04-19T23:02:16.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[21528]: audit 2024-04-19T23:02:14.643191+0000 mon.c (mon.2) 884 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:16.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:15 smithi113 bash[21528]: audit 2024-04-19T23:02:14.644328+0000 mon.a (mon.0) 3425 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]: dispatch 2024-04-19T23:02:17.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[28910]: audit 2024-04-19T23:02:15.492200+0000 mgr.y (mgr.24389) 656 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[28910]: cluster 2024-04-19T23:02:15.632959+0000 mon.a (mon.0) 3426 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[28910]: audit 2024-04-19T23:02:15.635345+0000 mon.a (mon.0) 3427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[28910]: cluster 2024-04-19T23:02:15.645540+0000 mon.a (mon.0) 3428 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[28910]: cluster 2024-04-19T23:02:16.434713+0000 mon.a (mon.0) 3429 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[21528]: audit 2024-04-19T23:02:15.492200+0000 mgr.y (mgr.24389) 656 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:17.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[21528]: cluster 2024-04-19T23:02:15.632959+0000 mon.a (mon.0) 3426 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:17.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[21528]: audit 2024-04-19T23:02:15.635345+0000 mon.a (mon.0) 3427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:17.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[21528]: cluster 2024-04-19T23:02:15.645540+0000 mon.a (mon.0) 3428 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-04-19T23:02:17.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:16 smithi113 bash[21528]: cluster 2024-04-19T23:02:16.434713+0000 mon.a (mon.0) 3429 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:17.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:16 smithi178 bash[23441]: audit 2024-04-19T23:02:15.492200+0000 mgr.y (mgr.24389) 656 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:17.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:16 smithi178 bash[23441]: cluster 2024-04-19T23:02:15.632959+0000 mon.a (mon.0) 3426 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:17.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:16 smithi178 bash[23441]: audit 2024-04-19T23:02:15.635345+0000 mon.a (mon.0) 3427 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-130"}]': finished 2024-04-19T23:02:17.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:16 smithi178 bash[23441]: cluster 2024-04-19T23:02:15.645540+0000 mon.a (mon.0) 3428 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-04-19T23:02:17.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:16 smithi178 bash[23441]: cluster 2024-04-19T23:02:16.434713+0000 mon.a (mon.0) 3429 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:17.800 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:17 smithi113 bash[21528]: cluster 2024-04-19T23:02:16.202163+0000 mgr.y (mgr.24389) 657 : cluster 0 pgmap v1093: 204 pgs: 204 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-19T23:02:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:17 smithi113 bash[21528]: cluster 2024-04-19T23:02:16.670884+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-04-19T23:02:17.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:17 smithi113 bash[28910]: cluster 2024-04-19T23:02:16.202163+0000 mgr.y (mgr.24389) 657 : cluster 0 pgmap v1093: 204 pgs: 204 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-19T23:02:17.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:17 smithi113 bash[28910]: cluster 2024-04-19T23:02:16.670884+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-04-19T23:02:18.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:17 smithi178 bash[23441]: cluster 2024-04-19T23:02:16.202163+0000 mgr.y (mgr.24389) 657 : cluster 0 pgmap v1093: 204 pgs: 204 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-19T23:02:18.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:17 smithi178 bash[23441]: cluster 2024-04-19T23:02:16.670884+0000 mon.a (mon.0) 3430 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-04-19T23:02:19.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[28910]: cluster 2024-04-19T23:02:17.684741+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-04-19T23:02:19.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[28910]: audit 2024-04-19T23:02:17.689104+0000 mon.c (mon.2) 885 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:19.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[28910]: audit 2024-04-19T23:02:17.691369+0000 mon.a (mon.0) 3432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:19.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[21528]: cluster 2024-04-19T23:02:17.684741+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-04-19T23:02:19.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[21528]: audit 2024-04-19T23:02:17.689104+0000 mon.c (mon.2) 885 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:19.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:18 smithi113 bash[21528]: audit 2024-04-19T23:02:17.691369+0000 mon.a (mon.0) 3432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:19.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:18 smithi178 bash[23441]: cluster 2024-04-19T23:02:17.684741+0000 mon.a (mon.0) 3431 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-04-19T23:02:19.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:18 smithi178 bash[23441]: audit 2024-04-19T23:02:17.689104+0000 mon.c (mon.2) 885 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:19.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:18 smithi178 bash[23441]: audit 2024-04-19T23:02:17.691369+0000 mon.a (mon.0) 3432 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:20.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[28910]: cluster 2024-04-19T23:02:18.203032+0000 mgr.y (mgr.24389) 658 : cluster 0 pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:02:20.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[28910]: audit 2024-04-19T23:02:18.688039+0000 mon.a (mon.0) 3433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[28910]: cluster 2024-04-19T23:02:18.699461+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[28910]: audit 2024-04-19T23:02:18.713133+0000 mon.c (mon.2) 886 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[28910]: audit 2024-04-19T23:02:18.714328+0000 mon.a (mon.0) 3435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[21528]: cluster 2024-04-19T23:02:18.203032+0000 mgr.y (mgr.24389) 658 : cluster 0 pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[21528]: audit 2024-04-19T23:02:18.688039+0000 mon.a (mon.0) 3433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[21528]: cluster 2024-04-19T23:02:18.699461+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[21528]: audit 2024-04-19T23:02:18.713133+0000 mon.c (mon.2) 886 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:20.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:19 smithi113 bash[21528]: audit 2024-04-19T23:02:18.714328+0000 mon.a (mon.0) 3435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:20.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:19 smithi178 bash[23441]: cluster 2024-04-19T23:02:18.203032+0000 mgr.y (mgr.24389) 658 : cluster 0 pgmap v1096: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-04-19T23:02:20.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:19 smithi178 bash[23441]: audit 2024-04-19T23:02:18.688039+0000 mon.a (mon.0) 3433 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:20.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:19 smithi178 bash[23441]: cluster 2024-04-19T23:02:18.699461+0000 mon.a (mon.0) 3434 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-04-19T23:02:20.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:19 smithi178 bash[23441]: audit 2024-04-19T23:02:18.713133+0000 mon.c (mon.2) 886 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:20.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:19 smithi178 bash[23441]: audit 2024-04-19T23:02:18.714328+0000 mon.a (mon.0) 3435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:21.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:19.690583+0000 mon.a (mon.0) 3436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: cluster 2024-04-19T23:02:19.701347+0000 mon.a (mon.0) 3437 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:19.703018+0000 mon.c (mon.2) 887 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:19.704607+0000 mon.a (mon.0) 3438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:19.856332+0000 mon.a (mon.0) 3439 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:19.858727+0000 mon.a (mon.0) 3440 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:20.693376+0000 mon.a (mon.0) 3441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: cluster 2024-04-19T23:02:20.700907+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:20.702854+0000 mon.c (mon.2) 888 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:21.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[21528]: audit 2024-04-19T23:02:20.703918+0000 mon.a (mon.0) 3443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:19.690583+0000 mon.a (mon.0) 3436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: cluster 2024-04-19T23:02:19.701347+0000 mon.a (mon.0) 3437 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:19.703018+0000 mon.c (mon.2) 887 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:19.704607+0000 mon.a (mon.0) 3438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:19.856332+0000 mon.a (mon.0) 3439 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:19.858727+0000 mon.a (mon.0) 3440 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:20.693376+0000 mon.a (mon.0) 3441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: cluster 2024-04-19T23:02:20.700907+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:20.702854+0000 mon.c (mon.2) 888 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:21.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:20 smithi113 bash[28910]: audit 2024-04-19T23:02:20.703918+0000 mon.a (mon.0) 3443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:19.690583+0000 mon.a (mon.0) 3436 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: cluster 2024-04-19T23:02:19.701347+0000 mon.a (mon.0) 3437 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:19.703018+0000 mon.c (mon.2) 887 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:19.704607+0000 mon.a (mon.0) 3438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:19.856332+0000 mon.a (mon.0) 3439 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:19.858727+0000 mon.a (mon.0) 3440 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:20.693376+0000 mon.a (mon.0) 3441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: cluster 2024-04-19T23:02:20.700907+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:20.702854+0000 mon.c (mon.2) 888 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:21.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:20 smithi178 bash[23441]: audit 2024-04-19T23:02:20.703918+0000 mon.a (mon.0) 3443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]: dispatch 2024-04-19T23:02:22.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[21528]: cluster 2024-04-19T23:02:20.205024+0000 mgr.y (mgr.24389) 659 : cluster 0 pgmap v1099: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:22.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[21528]: cluster 2024-04-19T23:02:21.693678+0000 mon.a (mon.0) 3444 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:22.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[21528]: audit 2024-04-19T23:02:21.696121+0000 mon.a (mon.0) 3445 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]': finished 2024-04-19T23:02:22.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[21528]: cluster 2024-04-19T23:02:21.705479+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-04-19T23:02:22.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[28910]: cluster 2024-04-19T23:02:20.205024+0000 mgr.y (mgr.24389) 659 : cluster 0 pgmap v1099: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:22.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[28910]: cluster 2024-04-19T23:02:21.693678+0000 mon.a (mon.0) 3444 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:22.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[28910]: audit 2024-04-19T23:02:21.696121+0000 mon.a (mon.0) 3445 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]': finished 2024-04-19T23:02:22.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:21 smithi113 bash[28910]: cluster 2024-04-19T23:02:21.705479+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-04-19T23:02:22.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:21 smithi178 bash[23441]: cluster 2024-04-19T23:02:20.205024+0000 mgr.y (mgr.24389) 659 : cluster 0 pgmap v1099: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:02:22.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:21 smithi178 bash[23441]: cluster 2024-04-19T23:02:21.693678+0000 mon.a (mon.0) 3444 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:22.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:21 smithi178 bash[23441]: audit 2024-04-19T23:02:21.696121+0000 mon.a (mon.0) 3445 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-132", "mode": "writeback"}]': finished 2024-04-19T23:02:22.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:21 smithi178 bash[23441]: cluster 2024-04-19T23:02:21.705479+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-04-19T23:02:24.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:23 smithi113 bash[21528]: cluster 2024-04-19T23:02:22.205848+0000 mgr.y (mgr.24389) 660 : cluster 0 pgmap v1102: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:24.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:23 smithi113 bash[21528]: cluster 2024-04-19T23:02:22.728820+0000 mon.a (mon.0) 3447 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-04-19T23:02:24.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:23 smithi113 bash[28910]: cluster 2024-04-19T23:02:22.205848+0000 mgr.y (mgr.24389) 660 : cluster 0 pgmap v1102: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:24.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:23 smithi113 bash[28910]: cluster 2024-04-19T23:02:22.728820+0000 mon.a (mon.0) 3447 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-04-19T23:02:24.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:23 smithi178 bash[23441]: cluster 2024-04-19T23:02:22.205848+0000 mgr.y (mgr.24389) 660 : cluster 0 pgmap v1102: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:24.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:23 smithi178 bash[23441]: cluster 2024-04-19T23:02:22.728820+0000 mon.a (mon.0) 3447 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-04-19T23:02:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[21528]: cluster 2024-04-19T23:02:23.731871+0000 mon.a (mon.0) 3448 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-04-19T23:02:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[21528]: audit 2024-04-19T23:02:23.818609+0000 mon.c (mon.2) 889 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[21528]: audit 2024-04-19T23:02:23.819342+0000 mon.a (mon.0) 3449 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[21528]: cluster 2024-04-19T23:02:24.206734+0000 mgr.y (mgr.24389) 661 : cluster 0 pgmap v1105: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:25.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[28910]: cluster 2024-04-19T23:02:23.731871+0000 mon.a (mon.0) 3448 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-04-19T23:02:25.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[28910]: audit 2024-04-19T23:02:23.818609+0000 mon.c (mon.2) 889 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[28910]: audit 2024-04-19T23:02:23.819342+0000 mon.a (mon.0) 3449 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:24 smithi113 bash[28910]: cluster 2024-04-19T23:02:24.206734+0000 mgr.y (mgr.24389) 661 : cluster 0 pgmap v1105: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:25.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:24 smithi178 bash[23441]: cluster 2024-04-19T23:02:23.731871+0000 mon.a (mon.0) 3448 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-04-19T23:02:25.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:24 smithi178 bash[23441]: audit 2024-04-19T23:02:23.818609+0000 mon.c (mon.2) 889 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:24 smithi178 bash[23441]: audit 2024-04-19T23:02:23.819342+0000 mon.a (mon.0) 3449 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:25.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:24 smithi178 bash[23441]: cluster 2024-04-19T23:02:24.206734+0000 mgr.y (mgr.24389) 661 : cluster 0 pgmap v1105: 204 pgs: 204 active+clean; 583 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:25.770 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[28910]: audit 2024-04-19T23:02:24.747720+0000 mon.a (mon.0) 3450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[28910]: cluster 2024-04-19T23:02:24.758716+0000 mon.a (mon.0) 3451 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-04-19T23:02:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[28910]: audit 2024-04-19T23:02:24.776796+0000 mon.c (mon.2) 890 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[28910]: audit 2024-04-19T23:02:24.777605+0000 mon.a (mon.0) 3452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[28910]: audit 2024-04-19T23:02:25.499097+0000 mgr.y (mgr.24389) 662 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[21528]: audit 2024-04-19T23:02:24.747720+0000 mon.a (mon.0) 3450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[21528]: cluster 2024-04-19T23:02:24.758716+0000 mon.a (mon.0) 3451 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-04-19T23:02:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[21528]: audit 2024-04-19T23:02:24.776796+0000 mon.c (mon.2) 890 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[21528]: audit 2024-04-19T23:02:24.777605+0000 mon.a (mon.0) 3452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:25 smithi113 bash[21528]: audit 2024-04-19T23:02:25.499097+0000 mgr.y (mgr.24389) 662 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[23441]: audit 2024-04-19T23:02:24.747720+0000 mon.a (mon.0) 3450 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:26.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[23441]: cluster 2024-04-19T23:02:24.758716+0000 mon.a (mon.0) 3451 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-04-19T23:02:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[23441]: audit 2024-04-19T23:02:24.776796+0000 mon.c (mon.2) 890 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[23441]: audit 2024-04-19T23:02:24.777605+0000 mon.a (mon.0) 3452 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:26.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:25 smithi178 bash[23441]: audit 2024-04-19T23:02:25.499097+0000 mgr.y (mgr.24389) 662 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:27.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[28910]: audit 2024-04-19T23:02:25.750371+0000 mon.a (mon.0) 3453 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:27.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[28910]: cluster 2024-04-19T23:02:25.758975+0000 mon.a (mon.0) 3454 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-04-19T23:02:27.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[28910]: cluster 2024-04-19T23:02:26.207545+0000 mgr.y (mgr.24389) 663 : cluster 0 pgmap v1108: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:27.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[28910]: cluster 2024-04-19T23:02:26.765119+0000 mon.a (mon.0) 3455 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-04-19T23:02:27.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[21528]: audit 2024-04-19T23:02:25.750371+0000 mon.a (mon.0) 3453 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:27.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[21528]: cluster 2024-04-19T23:02:25.758975+0000 mon.a (mon.0) 3454 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-04-19T23:02:27.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[21528]: cluster 2024-04-19T23:02:26.207545+0000 mgr.y (mgr.24389) 663 : cluster 0 pgmap v1108: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:27.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:26 smithi113 bash[21528]: cluster 2024-04-19T23:02:26.765119+0000 mon.a (mon.0) 3455 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-04-19T23:02:27.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:26 smithi178 bash[23441]: audit 2024-04-19T23:02:25.750371+0000 mon.a (mon.0) 3453 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:27.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:26 smithi178 bash[23441]: cluster 2024-04-19T23:02:25.758975+0000 mon.a (mon.0) 3454 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-04-19T23:02:27.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:26 smithi178 bash[23441]: cluster 2024-04-19T23:02:26.207545+0000 mgr.y (mgr.24389) 663 : cluster 0 pgmap v1108: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:27.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:26 smithi178 bash[23441]: cluster 2024-04-19T23:02:26.765119+0000 mon.a (mon.0) 3455 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-04-19T23:02:27.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:28.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:27 smithi113 bash[21528]: audit 2024-04-19T23:02:26.833343+0000 mon.c (mon.2) 891 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:28.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:27 smithi113 bash[21528]: audit 2024-04-19T23:02:26.834218+0000 mon.a (mon.0) 3456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:28.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:27 smithi113 bash[28910]: audit 2024-04-19T23:02:26.833343+0000 mon.c (mon.2) 891 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:28.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:27 smithi113 bash[28910]: audit 2024-04-19T23:02:26.834218+0000 mon.a (mon.0) 3456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:28.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:27 smithi178 bash[23441]: audit 2024-04-19T23:02:26.833343+0000 mon.c (mon.2) 891 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:28.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:27 smithi178 bash[23441]: audit 2024-04-19T23:02:26.834218+0000 mon.a (mon.0) 3456 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[28910]: audit 2024-04-19T23:02:27.807406+0000 mon.a (mon.0) 3457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[28910]: cluster 2024-04-19T23:02:27.815828+0000 mon.a (mon.0) 3458 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[28910]: audit 2024-04-19T23:02:27.819538+0000 mon.c (mon.2) 892 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[28910]: audit 2024-04-19T23:02:27.820633+0000 mon.a (mon.0) 3459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[28910]: cluster 2024-04-19T23:02:28.208446+0000 mgr.y (mgr.24389) 664 : cluster 0 pgmap v1111: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:29.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[21528]: audit 2024-04-19T23:02:27.807406+0000 mon.a (mon.0) 3457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:29.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[21528]: cluster 2024-04-19T23:02:27.815828+0000 mon.a (mon.0) 3458 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-04-19T23:02:29.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[21528]: audit 2024-04-19T23:02:27.819538+0000 mon.c (mon.2) 892 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[21528]: audit 2024-04-19T23:02:27.820633+0000 mon.a (mon.0) 3459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.301 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:28 smithi113 bash[21528]: cluster 2024-04-19T23:02:28.208446+0000 mgr.y (mgr.24389) 664 : cluster 0 pgmap v1111: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:28 smithi178 bash[23441]: audit 2024-04-19T23:02:27.807406+0000 mon.a (mon.0) 3457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:28 smithi178 bash[23441]: cluster 2024-04-19T23:02:27.815828+0000 mon.a (mon.0) 3458 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-04-19T23:02:29.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:28 smithi178 bash[23441]: audit 2024-04-19T23:02:27.819538+0000 mon.c (mon.2) 892 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.307 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:28 smithi178 bash[23441]: audit 2024-04-19T23:02:27.820633+0000 mon.a (mon.0) 3459 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]: dispatch 2024-04-19T23:02:29.307 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:28 smithi178 bash[23441]: cluster 2024-04-19T23:02:28.208446+0000 mgr.y (mgr.24389) 664 : cluster 0 pgmap v1111: 204 pgs: 204 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[28910]: cluster 2024-04-19T23:02:28.808379+0000 mon.a (mon.0) 3460 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[28910]: audit 2024-04-19T23:02:28.818671+0000 mon.a (mon.0) 3461 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[28910]: cluster 2024-04-19T23:02:28.829637+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[21528]: cluster 2024-04-19T23:02:28.808379+0000 mon.a (mon.0) 3460 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[21528]: audit 2024-04-19T23:02:28.818671+0000 mon.a (mon.0) 3461 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:30.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:30 smithi113 bash[21528]: cluster 2024-04-19T23:02:28.829637+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-04-19T23:02:30.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:30 smithi178 bash[23441]: cluster 2024-04-19T23:02:28.808379+0000 mon.a (mon.0) 3460 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:30.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:30 smithi178 bash[23441]: audit 2024-04-19T23:02:28.818671+0000 mon.a (mon.0) 3461 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-132"}]': finished 2024-04-19T23:02:30.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:30 smithi178 bash[23441]: cluster 2024-04-19T23:02:28.829637+0000 mon.a (mon.0) 3462 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-04-19T23:02:31.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[28910]: cluster 2024-04-19T23:02:29.830037+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-04-19T23:02:31.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[28910]: cluster 2024-04-19T23:02:30.210017+0000 mgr.y (mgr.24389) 665 : cluster 0 pgmap v1114: 172 pgs: 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:31.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[28910]: cluster 2024-04-19T23:02:30.842716+0000 mon.a (mon.0) 3464 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-04-19T23:02:31.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[28910]: audit 2024-04-19T23:02:30.850733+0000 mon.c (mon.2) 893 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:31.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[28910]: audit 2024-04-19T23:02:30.853562+0000 mon.a (mon.0) 3465 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:31.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[21528]: cluster 2024-04-19T23:02:29.830037+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-04-19T23:02:31.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[21528]: cluster 2024-04-19T23:02:30.210017+0000 mgr.y (mgr.24389) 665 : cluster 0 pgmap v1114: 172 pgs: 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:31.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[21528]: cluster 2024-04-19T23:02:30.842716+0000 mon.a (mon.0) 3464 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-04-19T23:02:31.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[21528]: audit 2024-04-19T23:02:30.850733+0000 mon.c (mon.2) 893 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:31.551 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:31 smithi113 bash[21528]: audit 2024-04-19T23:02:30.853562+0000 mon.a (mon.0) 3465 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:31.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:31 smithi178 bash[23441]: cluster 2024-04-19T23:02:29.830037+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-04-19T23:02:31.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:31 smithi178 bash[23441]: cluster 2024-04-19T23:02:30.210017+0000 mgr.y (mgr.24389) 665 : cluster 0 pgmap v1114: 172 pgs: 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:31.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:31 smithi178 bash[23441]: cluster 2024-04-19T23:02:30.842716+0000 mon.a (mon.0) 3464 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-04-19T23:02:31.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:31 smithi178 bash[23441]: audit 2024-04-19T23:02:30.850733+0000 mon.c (mon.2) 893 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:31.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:31 smithi178 bash[23441]: audit 2024-04-19T23:02:30.853562+0000 mon.a (mon.0) 3465 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[28910]: audit 2024-04-19T23:02:31.443396+0000 mon.a (mon.0) 3466 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[28910]: cluster 2024-04-19T23:02:31.450764+0000 mon.a (mon.0) 3467 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[28910]: audit 2024-04-19T23:02:31.458227+0000 mon.c (mon.2) 894 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[28910]: audit 2024-04-19T23:02:31.459912+0000 mon.a (mon.0) 3468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[21528]: audit 2024-04-19T23:02:31.443396+0000 mon.a (mon.0) 3466 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[21528]: cluster 2024-04-19T23:02:31.450764+0000 mon.a (mon.0) 3467 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-04-19T23:02:32.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[21528]: audit 2024-04-19T23:02:31.458227+0000 mon.c (mon.2) 894 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:32.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:32 smithi113 bash[21528]: audit 2024-04-19T23:02:31.459912+0000 mon.a (mon.0) 3468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:32 smithi178 bash[23441]: audit 2024-04-19T23:02:31.443396+0000 mon.a (mon.0) 3466 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:32 smithi178 bash[23441]: cluster 2024-04-19T23:02:31.450764+0000 mon.a (mon.0) 3467 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-04-19T23:02:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:32 smithi178 bash[23441]: audit 2024-04-19T23:02:31.458227+0000 mon.c (mon.2) 894 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:32 smithi178 bash[23441]: audit 2024-04-19T23:02:31.459912+0000 mon.a (mon.0) 3468 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[28910]: cluster 2024-04-19T23:02:32.211011+0000 mgr.y (mgr.24389) 666 : cluster 0 pgmap v1117: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[28910]: audit 2024-04-19T23:02:32.452169+0000 mon.a (mon.0) 3469 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[28910]: cluster 2024-04-19T23:02:32.462182+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[28910]: audit 2024-04-19T23:02:32.463472+0000 mon.c (mon.2) 895 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[28910]: audit 2024-04-19T23:02:32.464254+0000 mon.a (mon.0) 3471 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[21528]: cluster 2024-04-19T23:02:32.211011+0000 mgr.y (mgr.24389) 666 : cluster 0 pgmap v1117: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[21528]: audit 2024-04-19T23:02:32.452169+0000 mon.a (mon.0) 3469 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:33.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[21528]: cluster 2024-04-19T23:02:32.462182+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-04-19T23:02:33.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[21528]: audit 2024-04-19T23:02:32.463472+0000 mon.c (mon.2) 895 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:33.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:33 smithi113 bash[21528]: audit 2024-04-19T23:02:32.464254+0000 mon.a (mon.0) 3471 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:33 smithi178 bash[23441]: cluster 2024-04-19T23:02:32.211011+0000 mgr.y (mgr.24389) 666 : cluster 0 pgmap v1117: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-04-19T23:02:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:33 smithi178 bash[23441]: audit 2024-04-19T23:02:32.452169+0000 mon.a (mon.0) 3469 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:33 smithi178 bash[23441]: cluster 2024-04-19T23:02:32.462182+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-04-19T23:02:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:33 smithi178 bash[23441]: audit 2024-04-19T23:02:32.463472+0000 mon.c (mon.2) 895 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:33.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:33 smithi178 bash[23441]: audit 2024-04-19T23:02:32.464254+0000 mon.a (mon.0) 3471 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:34.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: audit 2024-04-19T23:02:33.454922+0000 mon.a (mon.0) 3472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:34.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: cluster 2024-04-19T23:02:33.462227+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-04-19T23:02:34.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: audit 2024-04-19T23:02:33.464884+0000 mon.c (mon.2) 896 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: audit 2024-04-19T23:02:33.471614+0000 mon.a (mon.0) 3474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: cluster 2024-04-19T23:02:34.455440+0000 mon.a (mon.0) 3475 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:34.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[28910]: audit 2024-04-19T23:02:34.458466+0000 mon.a (mon.0) 3476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]': finished 2024-04-19T23:02:34.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: audit 2024-04-19T23:02:33.454922+0000 mon.a (mon.0) 3472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:34.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: cluster 2024-04-19T23:02:33.462227+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-04-19T23:02:34.802 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: audit 2024-04-19T23:02:33.464884+0000 mon.c (mon.2) 896 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.802 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: audit 2024-04-19T23:02:33.471614+0000 mon.a (mon.0) 3474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.802 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: cluster 2024-04-19T23:02:34.455440+0000 mon.a (mon.0) 3475 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:34.802 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:34 smithi113 bash[21528]: audit 2024-04-19T23:02:34.458466+0000 mon.a (mon.0) 3476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]': finished 2024-04-19T23:02:34.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: audit 2024-04-19T23:02:33.454922+0000 mon.a (mon.0) 3472 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:34.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: cluster 2024-04-19T23:02:33.462227+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-04-19T23:02:34.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: audit 2024-04-19T23:02:33.464884+0000 mon.c (mon.2) 896 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: audit 2024-04-19T23:02:33.471614+0000 mon.a (mon.0) 3474 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]: dispatch 2024-04-19T23:02:34.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: cluster 2024-04-19T23:02:34.455440+0000 mon.a (mon.0) 3475 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:34.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:34 smithi178 bash[23441]: audit 2024-04-19T23:02:34.458466+0000 mon.a (mon.0) 3476 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-134", "mode": "writeback"}]': finished 2024-04-19T23:02:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: cluster 2024-04-19T23:02:34.211847+0000 mgr.y (mgr.24389) 667 : cluster 0 pgmap v1120: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: cluster 2024-04-19T23:02:34.468631+0000 mon.a (mon.0) 3477 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-04-19T23:02:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: audit 2024-04-19T23:02:34.570495+0000 mon.c (mon.2) 897 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: audit 2024-04-19T23:02:34.571237+0000 mon.a (mon.0) 3478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: audit 2024-04-19T23:02:34.897464+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[28910]: audit 2024-04-19T23:02:34.899915+0000 mon.a (mon.0) 3480 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: cluster 2024-04-19T23:02:34.211847+0000 mgr.y (mgr.24389) 667 : cluster 0 pgmap v1120: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: cluster 2024-04-19T23:02:34.468631+0000 mon.a (mon.0) 3477 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: audit 2024-04-19T23:02:34.570495+0000 mon.c (mon.2) 897 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: audit 2024-04-19T23:02:34.571237+0000 mon.a (mon.0) 3478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: audit 2024-04-19T23:02:34.897464+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:35.802 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:35 smithi113 bash[21528]: audit 2024-04-19T23:02:34.899915+0000 mon.a (mon.0) 3480 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:35.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: cluster 2024-04-19T23:02:34.211847+0000 mgr.y (mgr.24389) 667 : cluster 0 pgmap v1120: 204 pgs: 32 unknown, 172 active+clean; 583 KiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: cluster 2024-04-19T23:02:34.468631+0000 mon.a (mon.0) 3477 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-04-19T23:02:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: audit 2024-04-19T23:02:34.570495+0000 mon.c (mon.2) 897 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: audit 2024-04-19T23:02:34.571237+0000 mon.a (mon.0) 3478 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: audit 2024-04-19T23:02:34.897464+0000 mon.a (mon.0) 3479 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:35.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:35 smithi178 bash[23441]: audit 2024-04-19T23:02:34.899915+0000 mon.a (mon.0) 3480 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:36.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[21528]: audit 2024-04-19T23:02:35.490367+0000 mon.a (mon.0) 3481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:36.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[21528]: cluster 2024-04-19T23:02:35.497784+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[21528]: audit 2024-04-19T23:02:35.502237+0000 mon.c (mon.2) 898 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[21528]: audit 2024-04-19T23:02:35.509407+0000 mgr.y (mgr.24389) 668 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[21528]: audit 2024-04-19T23:02:35.512394+0000 mon.a (mon.0) 3483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[28910]: audit 2024-04-19T23:02:35.490367+0000 mon.a (mon.0) 3481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[28910]: cluster 2024-04-19T23:02:35.497784+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-04-19T23:02:36.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[28910]: audit 2024-04-19T23:02:35.502237+0000 mon.c (mon.2) 898 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:36.802 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[28910]: audit 2024-04-19T23:02:35.509407+0000 mgr.y (mgr.24389) 668 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:36.802 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:36 smithi113 bash[28910]: audit 2024-04-19T23:02:35.512394+0000 mon.a (mon.0) 3483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:36.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:36 smithi178 bash[23441]: audit 2024-04-19T23:02:35.490367+0000 mon.a (mon.0) 3481 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:36.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:36 smithi178 bash[23441]: cluster 2024-04-19T23:02:35.497784+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-04-19T23:02:36.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:36 smithi178 bash[23441]: audit 2024-04-19T23:02:35.502237+0000 mon.c (mon.2) 898 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:36.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:36 smithi178 bash[23441]: audit 2024-04-19T23:02:35.509407+0000 mgr.y (mgr.24389) 668 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:36.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:36 smithi178 bash[23441]: audit 2024-04-19T23:02:35.512394+0000 mon.a (mon.0) 3483 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]: dispatch 2024-04-19T23:02:37.800 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[28910]: cluster 2024-04-19T23:02:36.212640+0000 mgr.y (mgr.24389) 669 : cluster 0 pgmap v1123: 204 pgs: 204 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T23:02:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[28910]: cluster 2024-04-19T23:02:36.505424+0000 mon.a (mon.0) 3484 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[28910]: audit 2024-04-19T23:02:36.518733+0000 mon.a (mon.0) 3485 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:37.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[28910]: cluster 2024-04-19T23:02:36.531655+0000 mon.a (mon.0) 3486 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-04-19T23:02:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[21528]: cluster 2024-04-19T23:02:36.212640+0000 mgr.y (mgr.24389) 669 : cluster 0 pgmap v1123: 204 pgs: 204 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T23:02:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[21528]: cluster 2024-04-19T23:02:36.505424+0000 mon.a (mon.0) 3484 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[21528]: audit 2024-04-19T23:02:36.518733+0000 mon.a (mon.0) 3485 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:37.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:37 smithi113 bash[21528]: cluster 2024-04-19T23:02:36.531655+0000 mon.a (mon.0) 3486 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-04-19T23:02:37.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:37 smithi178 bash[23441]: cluster 2024-04-19T23:02:36.212640+0000 mgr.y (mgr.24389) 669 : cluster 0 pgmap v1123: 204 pgs: 204 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-04-19T23:02:37.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:37 smithi178 bash[23441]: cluster 2024-04-19T23:02:36.505424+0000 mon.a (mon.0) 3484 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:37.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:37 smithi178 bash[23441]: audit 2024-04-19T23:02:36.518733+0000 mon.a (mon.0) 3485 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-134"}]': finished 2024-04-19T23:02:37.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:37 smithi178 bash[23441]: cluster 2024-04-19T23:02:36.531655+0000 mon.a (mon.0) 3486 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-04-19T23:02:38.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:38 smithi113 bash[28910]: cluster 2024-04-19T23:02:37.530342+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-04-19T23:02:38.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:38 smithi113 bash[21528]: cluster 2024-04-19T23:02:37.530342+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-04-19T23:02:38.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:38 smithi178 bash[23441]: cluster 2024-04-19T23:02:37.530342+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[21528]: cluster 2024-04-19T23:02:38.213522+0000 mgr.y (mgr.24389) 670 : cluster 0 pgmap v1126: 172 pgs: 172 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[21528]: cluster 2024-04-19T23:02:38.544347+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[21528]: audit 2024-04-19T23:02:38.547884+0000 mon.c (mon.2) 899 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[21528]: audit 2024-04-19T23:02:38.555959+0000 mon.a (mon.0) 3489 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[28910]: cluster 2024-04-19T23:02:38.213522+0000 mgr.y (mgr.24389) 670 : cluster 0 pgmap v1126: 172 pgs: 172 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[28910]: cluster 2024-04-19T23:02:38.544347+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-04-19T23:02:39.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[28910]: audit 2024-04-19T23:02:38.547884+0000 mon.c (mon.2) 899 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:39.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:39 smithi113 bash[28910]: audit 2024-04-19T23:02:38.555959+0000 mon.a (mon.0) 3489 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:39.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:39 smithi178 bash[23441]: cluster 2024-04-19T23:02:38.213522+0000 mgr.y (mgr.24389) 670 : cluster 0 pgmap v1126: 172 pgs: 172 active+clean; 583 KiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-04-19T23:02:39.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:39 smithi178 bash[23441]: cluster 2024-04-19T23:02:38.544347+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-04-19T23:02:39.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:39 smithi178 bash[23441]: audit 2024-04-19T23:02:38.547884+0000 mon.c (mon.2) 899 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:39.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:39 smithi178 bash[23441]: audit 2024-04-19T23:02:38.555959+0000 mon.a (mon.0) 3489 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[28910]: audit 2024-04-19T23:02:39.545023+0000 mon.a (mon.0) 3490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[28910]: cluster 2024-04-19T23:02:39.552749+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-04-19T23:02:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[28910]: audit 2024-04-19T23:02:39.563695+0000 mon.c (mon.2) 900 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:41.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[28910]: audit 2024-04-19T23:02:39.564849+0000 mon.a (mon.0) 3492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:41.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[21528]: audit 2024-04-19T23:02:39.545023+0000 mon.a (mon.0) 3490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:41.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[21528]: cluster 2024-04-19T23:02:39.552749+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-04-19T23:02:41.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[21528]: audit 2024-04-19T23:02:39.563695+0000 mon.c (mon.2) 900 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:41.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:40 smithi113 bash[21528]: audit 2024-04-19T23:02:39.564849+0000 mon.a (mon.0) 3492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:41.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:40 smithi178 bash[23441]: audit 2024-04-19T23:02:39.545023+0000 mon.a (mon.0) 3490 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:41.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:40 smithi178 bash[23441]: cluster 2024-04-19T23:02:39.552749+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-04-19T23:02:41.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:40 smithi178 bash[23441]: audit 2024-04-19T23:02:39.563695+0000 mon.c (mon.2) 900 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:41.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:40 smithi178 bash[23441]: audit 2024-04-19T23:02:39.564849+0000 mon.a (mon.0) 3492 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[21528]: cluster 2024-04-19T23:02:40.215606+0000 mgr.y (mgr.24389) 671 : cluster 0 pgmap v1129: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[21528]: audit 2024-04-19T23:02:40.556432+0000 mon.a (mon.0) 3493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[21528]: cluster 2024-04-19T23:02:40.565903+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-04-19T23:02:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[21528]: audit 2024-04-19T23:02:40.567770+0000 mon.c (mon.2) 901 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:42.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[21528]: audit 2024-04-19T23:02:40.569074+0000 mon.a (mon.0) 3495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[28910]: cluster 2024-04-19T23:02:40.215606+0000 mgr.y (mgr.24389) 671 : cluster 0 pgmap v1129: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[28910]: audit 2024-04-19T23:02:40.556432+0000 mon.a (mon.0) 3493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[28910]: cluster 2024-04-19T23:02:40.565903+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-04-19T23:02:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[28910]: audit 2024-04-19T23:02:40.567770+0000 mon.c (mon.2) 901 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:42.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:41 smithi113 bash[28910]: audit 2024-04-19T23:02:40.569074+0000 mon.a (mon.0) 3495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:41 smithi178 bash[23441]: cluster 2024-04-19T23:02:40.215606+0000 mgr.y (mgr.24389) 671 : cluster 0 pgmap v1129: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:41 smithi178 bash[23441]: audit 2024-04-19T23:02:40.556432+0000 mon.a (mon.0) 3493 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:41 smithi178 bash[23441]: cluster 2024-04-19T23:02:40.565903+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-04-19T23:02:42.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:41 smithi178 bash[23441]: audit 2024-04-19T23:02:40.567770+0000 mon.c (mon.2) 901 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:42.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:41 smithi178 bash[23441]: audit 2024-04-19T23:02:40.569074+0000 mon.a (mon.0) 3495 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[21528]: audit 2024-04-19T23:02:41.567501+0000 mon.a (mon.0) 3496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[21528]: cluster 2024-04-19T23:02:41.574583+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-04-19T23:02:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[21528]: audit 2024-04-19T23:02:41.576670+0000 mon.c (mon.2) 902 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:43.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[21528]: audit 2024-04-19T23:02:41.578236+0000 mon.a (mon.0) 3498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:43.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[28910]: audit 2024-04-19T23:02:41.567501+0000 mon.a (mon.0) 3496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[28910]: cluster 2024-04-19T23:02:41.574583+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-04-19T23:02:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[28910]: audit 2024-04-19T23:02:41.576670+0000 mon.c (mon.2) 902 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:43.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:42 smithi113 bash[28910]: audit 2024-04-19T23:02:41.578236+0000 mon.a (mon.0) 3498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:42 smithi178 bash[23441]: audit 2024-04-19T23:02:41.567501+0000 mon.a (mon.0) 3496 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:42 smithi178 bash[23441]: cluster 2024-04-19T23:02:41.574583+0000 mon.a (mon.0) 3497 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-04-19T23:02:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:42 smithi178 bash[23441]: audit 2024-04-19T23:02:41.576670+0000 mon.c (mon.2) 902 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:43.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:42 smithi178 bash[23441]: audit 2024-04-19T23:02:41.578236+0000 mon.a (mon.0) 3498 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]: dispatch 2024-04-19T23:02:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: cluster 2024-04-19T23:02:42.216524+0000 mgr.y (mgr.24389) 672 : cluster 0 pgmap v1132: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: cluster 2024-04-19T23:02:42.568422+0000 mon.a (mon.0) 3499 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: audit 2024-04-19T23:02:42.576095+0000 mon.a (mon.0) 3500 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]': finished 2024-04-19T23:02:44.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: cluster 2024-04-19T23:02:42.586659+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: audit 2024-04-19T23:02:42.709177+0000 mon.c (mon.2) 903 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[21528]: audit 2024-04-19T23:02:42.709999+0000 mon.a (mon.0) 3502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: cluster 2024-04-19T23:02:42.216524+0000 mgr.y (mgr.24389) 672 : cluster 0 pgmap v1132: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: cluster 2024-04-19T23:02:42.568422+0000 mon.a (mon.0) 3499 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: audit 2024-04-19T23:02:42.576095+0000 mon.a (mon.0) 3500 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]': finished 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: cluster 2024-04-19T23:02:42.586659+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: audit 2024-04-19T23:02:42.709177+0000 mon.c (mon.2) 903 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:44.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:43 smithi113 bash[28910]: audit 2024-04-19T23:02:42.709999+0000 mon.a (mon.0) 3502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: cluster 2024-04-19T23:02:42.216524+0000 mgr.y (mgr.24389) 672 : cluster 0 pgmap v1132: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: cluster 2024-04-19T23:02:42.568422+0000 mon.a (mon.0) 3499 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:02:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: audit 2024-04-19T23:02:42.576095+0000 mon.a (mon.0) 3500 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-136", "mode": "writeback"}]': finished 2024-04-19T23:02:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: cluster 2024-04-19T23:02:42.586659+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-04-19T23:02:44.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: audit 2024-04-19T23:02:42.709177+0000 mon.c (mon.2) 903 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:44.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:43 smithi178 bash[23441]: audit 2024-04-19T23:02:42.709999+0000 mon.a (mon.0) 3502 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[21528]: audit 2024-04-19T23:02:43.579071+0000 mon.a (mon.0) 3503 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[21528]: cluster 2024-04-19T23:02:43.585574+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[21528]: audit 2024-04-19T23:02:43.590181+0000 mon.c (mon.2) 904 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[21528]: audit 2024-04-19T23:02:43.602579+0000 mon.a (mon.0) 3505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[28910]: audit 2024-04-19T23:02:43.579071+0000 mon.a (mon.0) 3503 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[28910]: cluster 2024-04-19T23:02:43.585574+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-04-19T23:02:45.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[28910]: audit 2024-04-19T23:02:43.590181+0000 mon.c (mon.2) 904 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:44 smithi113 bash[28910]: audit 2024-04-19T23:02:43.602579+0000 mon.a (mon.0) 3505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:44 smithi178 bash[23441]: audit 2024-04-19T23:02:43.579071+0000 mon.a (mon.0) 3503 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:02:45.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:44 smithi178 bash[23441]: cluster 2024-04-19T23:02:43.585574+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-04-19T23:02:45.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:44 smithi178 bash[23441]: audit 2024-04-19T23:02:43.590181+0000 mon.c (mon.2) 904 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:44 smithi178 bash[23441]: audit 2024-04-19T23:02:43.602579+0000 mon.a (mon.0) 3505 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]: dispatch 2024-04-19T23:02:45.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[28910]: cluster 2024-04-19T23:02:44.217384+0000 mgr.y (mgr.24389) 673 : cluster 0 pgmap v1135: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[28910]: cluster 2024-04-19T23:02:44.592238+0000 mon.a (mon.0) 3506 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[28910]: audit 2024-04-19T23:02:44.599956+0000 mon.a (mon.0) 3507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[28910]: cluster 2024-04-19T23:02:44.612277+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[21528]: cluster 2024-04-19T23:02:44.217384+0000 mgr.y (mgr.24389) 673 : cluster 0 pgmap v1135: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[21528]: cluster 2024-04-19T23:02:44.592238+0000 mon.a (mon.0) 3506 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[21528]: audit 2024-04-19T23:02:44.599956+0000 mon.a (mon.0) 3507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:46.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:46 smithi113 bash[21528]: cluster 2024-04-19T23:02:44.612277+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-04-19T23:02:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:46 smithi178 bash[23441]: cluster 2024-04-19T23:02:44.217384+0000 mgr.y (mgr.24389) 673 : cluster 0 pgmap v1135: 204 pgs: 204 active+clean; 583 KiB data, 659 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:02:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:46 smithi178 bash[23441]: cluster 2024-04-19T23:02:44.592238+0000 mon.a (mon.0) 3506 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:02:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:46 smithi178 bash[23441]: audit 2024-04-19T23:02:44.599956+0000 mon.a (mon.0) 3507 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-136"}]': finished 2024-04-19T23:02:46.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:46 smithi178 bash[23441]: cluster 2024-04-19T23:02:44.612277+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-04-19T23:02:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: audit 2024-04-19T23:02:45.520832+0000 mgr.y (mgr.24389) 674 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: cluster 2024-04-19T23:02:45.610415+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-04-19T23:02:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: cluster 2024-04-19T23:02:46.218159+0000 mgr.y (mgr.24389) 675 : cluster 0 pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: cluster 2024-04-19T23:02:46.617127+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-04-19T23:02:47.480 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: audit 2024-04-19T23:02:46.622808+0000 mon.c (mon.2) 905 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[28910]: audit 2024-04-19T23:02:46.627172+0000 mon.a (mon.0) 3511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: audit 2024-04-19T23:02:45.520832+0000 mgr.y (mgr.24389) 674 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: cluster 2024-04-19T23:02:45.610415+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: cluster 2024-04-19T23:02:46.218159+0000 mgr.y (mgr.24389) 675 : cluster 0 pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: cluster 2024-04-19T23:02:46.617127+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: audit 2024-04-19T23:02:46.622808+0000 mon.c (mon.2) 905 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.481 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21528]: audit 2024-04-19T23:02:46.627172+0000 mon.a (mon.0) 3511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: audit 2024-04-19T23:02:45.520832+0000 mgr.y (mgr.24389) 674 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: cluster 2024-04-19T23:02:45.610415+0000 mon.a (mon.0) 3509 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-04-19T23:02:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: cluster 2024-04-19T23:02:46.218159+0000 mgr.y (mgr.24389) 675 : cluster 0 pgmap v1138: 172 pgs: 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:47.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: cluster 2024-04-19T23:02:46.617127+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-04-19T23:02:47.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: audit 2024-04-19T23:02:46.622808+0000 mon.c (mon.2) 905 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.557 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:47 smithi178 bash[23441]: audit 2024-04-19T23:02:46.627172+0000 mon.a (mon.0) 3511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:47.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[21528]: audit 2024-04-19T23:02:47.610079+0000 mon.a (mon.0) 3512 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[21528]: cluster 2024-04-19T23:02:47.618312+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[21528]: audit 2024-04-19T23:02:47.622263+0000 mon.c (mon.2) 906 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[21528]: audit 2024-04-19T23:02:47.624356+0000 mon.a (mon.0) 3514 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[28910]: audit 2024-04-19T23:02:47.610079+0000 mon.a (mon.0) 3512 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[28910]: cluster 2024-04-19T23:02:47.618312+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[28910]: audit 2024-04-19T23:02:47.622263+0000 mon.c (mon.2) 906 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:49.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:48 smithi113 bash[28910]: audit 2024-04-19T23:02:47.624356+0000 mon.a (mon.0) 3514 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:49.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:48 smithi178 bash[23441]: audit 2024-04-19T23:02:47.610079+0000 mon.a (mon.0) 3512 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:49.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:48 smithi178 bash[23441]: cluster 2024-04-19T23:02:47.618312+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-04-19T23:02:49.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:48 smithi178 bash[23441]: audit 2024-04-19T23:02:47.622263+0000 mon.c (mon.2) 906 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:49.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:48 smithi178 bash[23441]: audit 2024-04-19T23:02:47.624356+0000 mon.a (mon.0) 3514 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[28910]: cluster 2024-04-19T23:02:48.219119+0000 mgr.y (mgr.24389) 676 : cluster 0 pgmap v1141: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[28910]: audit 2024-04-19T23:02:48.620553+0000 mon.a (mon.0) 3515 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[28910]: cluster 2024-04-19T23:02:48.629001+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[28910]: audit 2024-04-19T23:02:48.631673+0000 mon.c (mon.2) 907 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[28910]: audit 2024-04-19T23:02:48.632948+0000 mon.a (mon.0) 3517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:50.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[21528]: cluster 2024-04-19T23:02:48.219119+0000 mgr.y (mgr.24389) 676 : cluster 0 pgmap v1141: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:50.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[21528]: audit 2024-04-19T23:02:48.620553+0000 mon.a (mon.0) 3515 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:50.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[21528]: cluster 2024-04-19T23:02:48.629001+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-04-19T23:02:50.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[21528]: audit 2024-04-19T23:02:48.631673+0000 mon.c (mon.2) 907 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:50.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:49 smithi113 bash[21528]: audit 2024-04-19T23:02:48.632948+0000 mon.a (mon.0) 3517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:49 smithi178 bash[23441]: cluster 2024-04-19T23:02:48.219119+0000 mgr.y (mgr.24389) 676 : cluster 0 pgmap v1141: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 665 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-04-19T23:02:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:49 smithi178 bash[23441]: audit 2024-04-19T23:02:48.620553+0000 mon.a (mon.0) 3515 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:49 smithi178 bash[23441]: cluster 2024-04-19T23:02:48.629001+0000 mon.a (mon.0) 3516 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-04-19T23:02:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:49 smithi178 bash[23441]: audit 2024-04-19T23:02:48.631673+0000 mon.c (mon.2) 907 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:50.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:49 smithi178 bash[23441]: audit 2024-04-19T23:02:48.632948+0000 mon.a (mon.0) 3517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:02:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:49.623467+0000 mon.a (mon.0) 3518 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:02:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: cluster 2024-04-19T23:02:49.630325+0000 mon.a (mon.0) 3519 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-04-19T23:02:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:49.633001+0000 mon.c (mon.2) 908 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:49.635257+0000 mon.a (mon.0) 3520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:49.938544+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:49.941055+0000 mon.a (mon.0) 3522 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: audit 2024-04-19T23:02:50.626200+0000 mon.a (mon.0) 3523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[21528]: cluster 2024-04-19T23:02:50.633555+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:49.623467+0000 mon.a (mon.0) 3518 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: cluster 2024-04-19T23:02:49.630325+0000 mon.a (mon.0) 3519 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:49.633001+0000 mon.c (mon.2) 908 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:49.635257+0000 mon.a (mon.0) 3520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:49.938544+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:51.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:49.941055+0000 mon.a (mon.0) 3522 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:51.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: audit 2024-04-19T23:02:50.626200+0000 mon.a (mon.0) 3523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:02:51.052 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:50 smithi113 bash[28910]: cluster 2024-04-19T23:02:50.633555+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-04-19T23:02:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:49.623467+0000 mon.a (mon.0) 3518 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:02:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: cluster 2024-04-19T23:02:49.630325+0000 mon.a (mon.0) 3519 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-04-19T23:02:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:49.633001+0000 mon.c (mon.2) 908 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:49.635257+0000 mon.a (mon.0) 3520 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:02:51.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:49.938544+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:02:51.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:49.941055+0000 mon.a (mon.0) 3522 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:02:51.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: audit 2024-04-19T23:02:50.626200+0000 mon.a (mon.0) 3523 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:02:51.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:50 smithi178 bash[23441]: cluster 2024-04-19T23:02:50.633555+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[21528]: cluster 2024-04-19T23:02:50.221154+0000 mgr.y (mgr.24389) 677 : cluster 0 pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[21528]: audit 2024-04-19T23:02:50.635722+0000 mon.c (mon.2) 909 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[21528]: audit 2024-04-19T23:02:50.639514+0000 mon.a (mon.0) 3525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[21528]: audit 2024-04-19T23:02:51.630493+0000 mon.a (mon.0) 3526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[21528]: cluster 2024-04-19T23:02:51.640845+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[28910]: cluster 2024-04-19T23:02:50.221154+0000 mgr.y (mgr.24389) 677 : cluster 0 pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[28910]: audit 2024-04-19T23:02:50.635722+0000 mon.c (mon.2) 909 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[28910]: audit 2024-04-19T23:02:50.639514+0000 mon.a (mon.0) 3525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[28910]: audit 2024-04-19T23:02:51.630493+0000 mon.a (mon.0) 3526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:02:52.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:51 smithi113 bash[28910]: cluster 2024-04-19T23:02:51.640845+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-04-19T23:02:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:51 smithi178 bash[23441]: cluster 2024-04-19T23:02:50.221154+0000 mgr.y (mgr.24389) 677 : cluster 0 pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:51 smithi178 bash[23441]: audit 2024-04-19T23:02:50.635722+0000 mon.c (mon.2) 909 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:51 smithi178 bash[23441]: audit 2024-04-19T23:02:50.639514+0000 mon.a (mon.0) 3525 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-04-19T23:02:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:51 smithi178 bash[23441]: audit 2024-04-19T23:02:51.630493+0000 mon.a (mon.0) 3526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-04-19T23:02:52.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:51 smithi178 bash[23441]: cluster 2024-04-19T23:02:51.640845+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[21528]: cluster 2024-04-19T23:02:52.221997+0000 mgr.y (mgr.24389) 678 : cluster 0 pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[21528]: audit 2024-04-19T23:02:52.677441+0000 mon.c (mon.2) 910 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[21528]: audit 2024-04-19T23:02:52.678338+0000 mon.a (mon.0) 3528 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[21528]: audit 2024-04-19T23:02:52.679636+0000 mon.c (mon.2) 911 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[21528]: audit 2024-04-19T23:02:52.680428+0000 mon.a (mon.0) 3529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[28910]: cluster 2024-04-19T23:02:52.221997+0000 mgr.y (mgr.24389) 678 : cluster 0 pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[28910]: audit 2024-04-19T23:02:52.677441+0000 mon.c (mon.2) 910 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[28910]: audit 2024-04-19T23:02:52.678338+0000 mon.a (mon.0) 3528 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[28910]: audit 2024-04-19T23:02:52.679636+0000 mon.c (mon.2) 911 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:54.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:53 smithi113 bash[28910]: audit 2024-04-19T23:02:52.680428+0000 mon.a (mon.0) 3529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:54.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:53 smithi178 bash[23441]: cluster 2024-04-19T23:02:52.221997+0000 mgr.y (mgr.24389) 678 : cluster 0 pgmap v1147: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:02:54.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:53 smithi178 bash[23441]: audit 2024-04-19T23:02:52.677441+0000 mon.c (mon.2) 910 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:53 smithi178 bash[23441]: audit 2024-04-19T23:02:52.678338+0000 mon.a (mon.0) 3528 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:02:54.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:53 smithi178 bash[23441]: audit 2024-04-19T23:02:52.679636+0000 mon.c (mon.2) 911 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:54.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:53 smithi178 bash[23441]: audit 2024-04-19T23:02:52.680428+0000 mon.a (mon.0) 3529 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]: dispatch 2024-04-19T23:02:55.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:54 smithi113 bash[21528]: audit 2024-04-19T23:02:53.652037+0000 mon.a (mon.0) 3530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]': finished 2024-04-19T23:02:55.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:54 smithi113 bash[21528]: cluster 2024-04-19T23:02:53.659701+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-04-19T23:02:55.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:54 smithi113 bash[28910]: audit 2024-04-19T23:02:53.652037+0000 mon.a (mon.0) 3530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]': finished 2024-04-19T23:02:55.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:54 smithi113 bash[28910]: cluster 2024-04-19T23:02:53.659701+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-04-19T23:02:55.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:54 smithi178 bash[23441]: audit 2024-04-19T23:02:53.652037+0000 mon.a (mon.0) 3530 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-138"}]': finished 2024-04-19T23:02:55.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:54 smithi178 bash[23441]: cluster 2024-04-19T23:02:53.659701+0000 mon.a (mon.0) 3531 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-04-19T23:02:55.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:02:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:02:55.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:55 smithi178 bash[23441]: cluster 2024-04-19T23:02:54.222851+0000 mgr.y (mgr.24389) 679 : cluster 0 pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:55.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:55 smithi178 bash[23441]: cluster 2024-04-19T23:02:54.667300+0000 mon.a (mon.0) 3532 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:55.807 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:55 smithi178 bash[23441]: cluster 2024-04-19T23:02:54.692081+0000 mon.a (mon.0) 3533 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[28910]: cluster 2024-04-19T23:02:54.222851+0000 mgr.y (mgr.24389) 679 : cluster 0 pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[28910]: cluster 2024-04-19T23:02:54.667300+0000 mon.a (mon.0) 3532 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[28910]: cluster 2024-04-19T23:02:54.692081+0000 mon.a (mon.0) 3533 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[21528]: cluster 2024-04-19T23:02:54.222851+0000 mgr.y (mgr.24389) 679 : cluster 0 pgmap v1149: 204 pgs: 204 active+clean; 4.4 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[21528]: cluster 2024-04-19T23:02:54.667300+0000 mon.a (mon.0) 3532 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:02:56.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:55 smithi113 bash[21528]: cluster 2024-04-19T23:02:54.692081+0000 mon.a (mon.0) 3533 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-04-19T23:02:57.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[28910]: audit 2024-04-19T23:02:55.532337+0000 mgr.y (mgr.24389) 680 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[28910]: cluster 2024-04-19T23:02:55.702038+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[28910]: audit 2024-04-19T23:02:55.707151+0000 mon.c (mon.2) 912 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[28910]: audit 2024-04-19T23:02:55.708318+0000 mon.a (mon.0) 3535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[21528]: audit 2024-04-19T23:02:55.532337+0000 mgr.y (mgr.24389) 680 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[21528]: cluster 2024-04-19T23:02:55.702038+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[21528]: audit 2024-04-19T23:02:55.707151+0000 mon.c (mon.2) 912 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:56 smithi113 bash[21528]: audit 2024-04-19T23:02:55.708318+0000 mon.a (mon.0) 3535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:56 smithi178 bash[23441]: audit 2024-04-19T23:02:55.532337+0000 mgr.y (mgr.24389) 680 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:02:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:56 smithi178 bash[23441]: cluster 2024-04-19T23:02:55.702038+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-04-19T23:02:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:56 smithi178 bash[23441]: audit 2024-04-19T23:02:55.707151+0000 mon.c (mon.2) 912 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:56 smithi178 bash[23441]: audit 2024-04-19T23:02:55.708318+0000 mon.a (mon.0) 3535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:02:57.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:02:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[28910]: cluster 2024-04-19T23:02:56.223803+0000 mgr.y (mgr.24389) 681 : cluster 0 pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[28910]: audit 2024-04-19T23:02:56.705737+0000 mon.a (mon.0) 3536 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[28910]: cluster 2024-04-19T23:02:56.716419+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[28910]: audit 2024-04-19T23:02:56.725393+0000 mon.c (mon.2) 913 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[28910]: audit 2024-04-19T23:02:56.727741+0000 mon.a (mon.0) 3538 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21528]: cluster 2024-04-19T23:02:56.223803+0000 mgr.y (mgr.24389) 681 : cluster 0 pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21528]: audit 2024-04-19T23:02:56.705737+0000 mon.a (mon.0) 3536 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:57.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21528]: cluster 2024-04-19T23:02:56.716419+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-04-19T23:02:57.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21528]: audit 2024-04-19T23:02:56.725393+0000 mon.c (mon.2) 913 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:57.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:57 smithi113 bash[21528]: audit 2024-04-19T23:02:56.727741+0000 mon.a (mon.0) 3538 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:57 smithi178 bash[23441]: cluster 2024-04-19T23:02:56.223803+0000 mgr.y (mgr.24389) 681 : cluster 0 pgmap v1152: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:02:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:57 smithi178 bash[23441]: audit 2024-04-19T23:02:56.705737+0000 mon.a (mon.0) 3536 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:02:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:57 smithi178 bash[23441]: cluster 2024-04-19T23:02:56.716419+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-04-19T23:02:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:57 smithi178 bash[23441]: audit 2024-04-19T23:02:56.725393+0000 mon.c (mon.2) 913 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:57 smithi178 bash[23441]: audit 2024-04-19T23:02:56.727741+0000 mon.a (mon.0) 3538 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:02:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: audit 2024-04-19T23:02:57.708751+0000 mon.a (mon.0) 3539 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: cluster 2024-04-19T23:02:57.716608+0000 mon.a (mon.0) 3540 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: audit 2024-04-19T23:02:57.718897+0000 mon.c (mon.2) 914 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: audit 2024-04-19T23:02:57.720413+0000 mon.a (mon.0) 3541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: audit 2024-04-19T23:02:58.711443+0000 mon.a (mon.0) 3542 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]': finished 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[28910]: cluster 2024-04-19T23:02:58.718913+0000 mon.a (mon.0) 3543 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: audit 2024-04-19T23:02:57.708751+0000 mon.a (mon.0) 3539 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: cluster 2024-04-19T23:02:57.716608+0000 mon.a (mon.0) 3540 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: audit 2024-04-19T23:02:57.718897+0000 mon.c (mon.2) 914 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: audit 2024-04-19T23:02:57.720413+0000 mon.a (mon.0) 3541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: audit 2024-04-19T23:02:58.711443+0000 mon.a (mon.0) 3542 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]': finished 2024-04-19T23:02:59.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:58 smithi113 bash[21528]: cluster 2024-04-19T23:02:58.718913+0000 mon.a (mon.0) 3543 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: audit 2024-04-19T23:02:57.708751+0000 mon.a (mon.0) 3539 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: cluster 2024-04-19T23:02:57.716608+0000 mon.a (mon.0) 3540 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: audit 2024-04-19T23:02:57.718897+0000 mon.c (mon.2) 914 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: audit 2024-04-19T23:02:57.720413+0000 mon.a (mon.0) 3541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]: dispatch 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: audit 2024-04-19T23:02:58.711443+0000 mon.a (mon.0) 3542 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_count","val": "3"}]': finished 2024-04-19T23:02:59.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:58 smithi178 bash[23441]: cluster 2024-04-19T23:02:58.718913+0000 mon.a (mon.0) 3543 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-04-19T23:03:00.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: cluster 2024-04-19T23:02:58.224661+0000 mgr.y (mgr.24389) 682 : cluster 0 pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:00.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: audit 2024-04-19T23:02:58.719995+0000 mon.c (mon.2) 915 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: audit 2024-04-19T23:02:58.723498+0000 mon.a (mon.0) 3544 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: audit 2024-04-19T23:02:59.714244+0000 mon.a (mon.0) 3545 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]': finished 2024-04-19T23:03:00.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: cluster 2024-04-19T23:02:59.721545+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-04-19T23:03:00.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: audit 2024-04-19T23:02:59.723771+0000 mon.c (mon.2) 916 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:00.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[28910]: audit 2024-04-19T23:02:59.724962+0000 mon.a (mon.0) 3547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:00.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: cluster 2024-04-19T23:02:58.224661+0000 mgr.y (mgr.24389) 682 : cluster 0 pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:00.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: audit 2024-04-19T23:02:58.719995+0000 mon.c (mon.2) 915 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: audit 2024-04-19T23:02:58.723498+0000 mon.a (mon.0) 3544 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: audit 2024-04-19T23:02:59.714244+0000 mon.a (mon.0) 3545 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]': finished 2024-04-19T23:03:00.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: cluster 2024-04-19T23:02:59.721545+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-04-19T23:03:00.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: audit 2024-04-19T23:02:59.723771+0000 mon.c (mon.2) 916 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:00.052 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:02:59 smithi113 bash[21528]: audit 2024-04-19T23:02:59.724962+0000 mon.a (mon.0) 3547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: cluster 2024-04-19T23:02:58.224661+0000 mgr.y (mgr.24389) 682 : cluster 0 pgmap v1155: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: audit 2024-04-19T23:02:58.719995+0000 mon.c (mon.2) 915 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: audit 2024-04-19T23:02:58.723498+0000 mon.a (mon.0) 3544 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]: dispatch 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: audit 2024-04-19T23:02:59.714244+0000 mon.a (mon.0) 3545 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_period","val": "3"}]': finished 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: cluster 2024-04-19T23:02:59.721545+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: audit 2024-04-19T23:02:59.723771+0000 mon.c (mon.2) 916 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:00.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:02:59 smithi178 bash[23441]: audit 2024-04-19T23:02:59.724962+0000 mon.a (mon.0) 3547 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: cluster 2024-04-19T23:03:00.226706+0000 mgr.y (mgr.24389) 683 : cluster 0 pgmap v1158: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: audit 2024-04-19T23:03:00.716932+0000 mon.a (mon.0) 3548 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: cluster 2024-04-19T23:03:00.724631+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: audit 2024-04-19T23:03:00.725863+0000 mon.c (mon.2) 917 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: audit 2024-04-19T23:03:00.726949+0000 mon.a (mon.0) 3550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[28910]: cluster 2024-04-19T23:03:01.449680+0000 mon.a (mon.0) 3551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: cluster 2024-04-19T23:03:00.226706+0000 mgr.y (mgr.24389) 683 : cluster 0 pgmap v1158: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: audit 2024-04-19T23:03:00.716932+0000 mon.a (mon.0) 3548 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:02.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: cluster 2024-04-19T23:03:00.724631+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-04-19T23:03:02.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: audit 2024-04-19T23:03:00.725863+0000 mon.c (mon.2) 917 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: audit 2024-04-19T23:03:00.726949+0000 mon.a (mon.0) 3550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.051 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:01 smithi113 bash[21528]: cluster 2024-04-19T23:03:01.449680+0000 mon.a (mon.0) 3551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: cluster 2024-04-19T23:03:00.226706+0000 mgr.y (mgr.24389) 683 : cluster 0 pgmap v1158: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: audit 2024-04-19T23:03:00.716932+0000 mon.a (mon.0) 3548 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: cluster 2024-04-19T23:03:00.724631+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: audit 2024-04-19T23:03:00.725863+0000 mon.c (mon.2) 917 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: audit 2024-04-19T23:03:00.726949+0000 mon.a (mon.0) 3550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-04-19T23:03:02.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:01 smithi178 bash[23441]: cluster 2024-04-19T23:03:01.449680+0000 mon.a (mon.0) 3551 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:03:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:02 smithi113 bash[28910]: audit 2024-04-19T23:03:01.727574+0000 mon.a (mon.0) 3552 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T23:03:03.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:02 smithi113 bash[28910]: cluster 2024-04-19T23:03:01.735429+0000 mon.a (mon.0) 3553 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-04-19T23:03:03.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:02 smithi113 bash[21528]: audit 2024-04-19T23:03:01.727574+0000 mon.a (mon.0) 3552 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T23:03:03.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:02 smithi113 bash[21528]: cluster 2024-04-19T23:03:01.735429+0000 mon.a (mon.0) 3553 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-04-19T23:03:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:02 smithi178 bash[23441]: audit 2024-04-19T23:03:01.727574+0000 mon.a (mon.0) 3552 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-04-19T23:03:03.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:02 smithi178 bash[23441]: cluster 2024-04-19T23:03:01.735429+0000 mon.a (mon.0) 3553 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-04-19T23:03:04.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:03 smithi113 bash[21528]: cluster 2024-04-19T23:03:02.227528+0000 mgr.y (mgr.24389) 684 : cluster 0 pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:04.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:03 smithi113 bash[28910]: cluster 2024-04-19T23:03:02.227528+0000 mgr.y (mgr.24389) 684 : cluster 0 pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:04.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:03 smithi178 bash[23441]: cluster 2024-04-19T23:03:02.227528+0000 mgr.y (mgr.24389) 684 : cluster 0 pgmap v1161: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:04 smithi113 bash[28910]: cluster 2024-04-19T23:03:04.228571+0000 mgr.y (mgr.24389) 685 : cluster 0 pgmap v1162: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s 2024-04-19T23:03:05.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:04 smithi113 bash[28910]: audit 2024-04-19T23:03:04.289198+0000 mon.a (mon.0) 3554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:03:05.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:04 smithi113 bash[21528]: cluster 2024-04-19T23:03:04.228571+0000 mgr.y (mgr.24389) 685 : cluster 0 pgmap v1162: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s 2024-04-19T23:03:05.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:04 smithi113 bash[21528]: audit 2024-04-19T23:03:04.289198+0000 mon.a (mon.0) 3554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:03:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:04 smithi178 bash[23441]: cluster 2024-04-19T23:03:04.228571+0000 mgr.y (mgr.24389) 685 : cluster 0 pgmap v1162: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s 2024-04-19T23:03:05.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:04 smithi178 bash[23441]: audit 2024-04-19T23:03:04.289198+0000 mon.a (mon.0) 3554 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:03:05.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[23441]: audit 2024-04-19T23:03:04.975404+0000 mon.a (mon.0) 3555 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[23441]: audit 2024-04-19T23:03:05.024998+0000 mon.a (mon.0) 3556 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:03:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[23441]: audit 2024-04-19T23:03:05.025968+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:03:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[23441]: audit 2024-04-19T23:03:05.034960+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:05.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:05 smithi178 bash[23441]: audit 2024-04-19T23:03:05.543807+0000 mgr.y (mgr.24389) 686 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:06.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[21528]: audit 2024-04-19T23:03:04.975404+0000 mon.a (mon.0) 3555 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[21528]: audit 2024-04-19T23:03:05.024998+0000 mon.a (mon.0) 3556 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[21528]: audit 2024-04-19T23:03:05.025968+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[21528]: audit 2024-04-19T23:03:05.034960+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[21528]: audit 2024-04-19T23:03:05.543807+0000 mgr.y (mgr.24389) 686 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[28910]: audit 2024-04-19T23:03:04.975404+0000 mon.a (mon.0) 3555 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[28910]: audit 2024-04-19T23:03:05.024998+0000 mon.a (mon.0) 3556 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[28910]: audit 2024-04-19T23:03:05.025968+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:03:06.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[28910]: audit 2024-04-19T23:03:05.034960+0000 mon.a (mon.0) 3558 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:06.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:05 smithi113 bash[28910]: audit 2024-04-19T23:03:05.543807+0000 mgr.y (mgr.24389) 686 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:07.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:06 smithi113 bash[28910]: cluster 2024-04-19T23:03:06.230719+0000 mgr.y (mgr.24389) 687 : cluster 0 pgmap v1163: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.1 KiB/s wr, 2 op/s 2024-04-19T23:03:07.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:06 smithi113 bash[21528]: cluster 2024-04-19T23:03:06.230719+0000 mgr.y (mgr.24389) 687 : cluster 0 pgmap v1163: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.1 KiB/s wr, 2 op/s 2024-04-19T23:03:07.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:06 smithi178 bash[23441]: cluster 2024-04-19T23:03:06.230719+0000 mgr.y (mgr.24389) 687 : cluster 0 pgmap v1163: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.1 KiB/s wr, 2 op/s 2024-04-19T23:03:07.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:09.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:09 smithi113 bash[21528]: cluster 2024-04-19T23:03:08.231505+0000 mgr.y (mgr.24389) 688 : cluster 0 pgmap v1164: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:03:09.550 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:09 smithi113 bash[28910]: cluster 2024-04-19T23:03:08.231505+0000 mgr.y (mgr.24389) 688 : cluster 0 pgmap v1164: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:03:09.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:09 smithi178 bash[23441]: cluster 2024-04-19T23:03:08.231505+0000 mgr.y (mgr.24389) 688 : cluster 0 pgmap v1164: 204 pgs: 204 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:03:11.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:11 smithi113 bash[28910]: cluster 2024-04-19T23:03:10.233621+0000 mgr.y (mgr.24389) 689 : cluster 0 pgmap v1165: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.8 KiB/s wr, 2 op/s 2024-04-19T23:03:11.550 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:11 smithi113 bash[21528]: cluster 2024-04-19T23:03:10.233621+0000 mgr.y (mgr.24389) 689 : cluster 0 pgmap v1165: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.8 KiB/s wr, 2 op/s 2024-04-19T23:03:11.556 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:11 smithi178 bash[23441]: cluster 2024-04-19T23:03:10.233621+0000 mgr.y (mgr.24389) 689 : cluster 0 pgmap v1165: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.8 KiB/s wr, 2 op/s 2024-04-19T23:03:13.549 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:13 smithi113 bash[28910]: cluster 2024-04-19T23:03:12.234488+0000 mgr.y (mgr.24389) 690 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-04-19T23:03:13.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:13 smithi113 bash[21528]: cluster 2024-04-19T23:03:12.234488+0000 mgr.y (mgr.24389) 690 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-04-19T23:03:13.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:13 smithi178 bash[23441]: cluster 2024-04-19T23:03:12.234488+0000 mgr.y (mgr.24389) 690 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-04-19T23:03:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[28910]: audit 2024-04-19T23:03:13.832212+0000 mon.c (mon.2) 918 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[28910]: audit 2024-04-19T23:03:13.832950+0000 mon.a (mon.0) 3559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[28910]: audit 2024-04-19T23:03:13.834228+0000 mon.c (mon.2) 919 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[28910]: audit 2024-04-19T23:03:13.834944+0000 mon.a (mon.0) 3560 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[21528]: audit 2024-04-19T23:03:13.832212+0000 mon.c (mon.2) 918 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[21528]: audit 2024-04-19T23:03:13.832950+0000 mon.a (mon.0) 3559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[21528]: audit 2024-04-19T23:03:13.834228+0000 mon.c (mon.2) 919 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:14.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:14 smithi113 bash[21528]: audit 2024-04-19T23:03:13.834944+0000 mon.a (mon.0) 3560 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:14 smithi178 bash[23441]: audit 2024-04-19T23:03:13.832212+0000 mon.c (mon.2) 918 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:14 smithi178 bash[23441]: audit 2024-04-19T23:03:13.832950+0000 mon.a (mon.0) 3559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:14 smithi178 bash[23441]: audit 2024-04-19T23:03:13.834228+0000 mon.c (mon.2) 919 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:14.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:14 smithi178 bash[23441]: audit 2024-04-19T23:03:13.834944+0000 mon.a (mon.0) 3560 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]: dispatch 2024-04-19T23:03:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[28910]: cluster 2024-04-19T23:03:14.235322+0000 mgr.y (mgr.24389) 691 : cluster 0 pgmap v1167: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-19T23:03:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[28910]: audit 2024-04-19T23:03:14.300499+0000 mon.a (mon.0) 3561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]': finished 2024-04-19T23:03:15.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[28910]: cluster 2024-04-19T23:03:14.307494+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-04-19T23:03:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[21528]: cluster 2024-04-19T23:03:14.235322+0000 mgr.y (mgr.24389) 691 : cluster 0 pgmap v1167: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-19T23:03:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[21528]: audit 2024-04-19T23:03:14.300499+0000 mon.a (mon.0) 3561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]': finished 2024-04-19T23:03:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:15 smithi113 bash[21528]: cluster 2024-04-19T23:03:14.307494+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-04-19T23:03:15.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:15.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:15 smithi178 bash[23441]: cluster 2024-04-19T23:03:14.235322+0000 mgr.y (mgr.24389) 691 : cluster 0 pgmap v1167: 204 pgs: 204 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 6.2 KiB/s wr, 1 op/s 2024-04-19T23:03:15.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:15 smithi178 bash[23441]: audit 2024-04-19T23:03:14.300499+0000 mon.a (mon.0) 3561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-140"}]': finished 2024-04-19T23:03:15.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:15 smithi178 bash[23441]: cluster 2024-04-19T23:03:14.307494+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-04-19T23:03:16.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:16 smithi113 bash[28910]: cluster 2024-04-19T23:03:15.326056+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-04-19T23:03:16.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:16 smithi113 bash[28910]: audit 2024-04-19T23:03:15.555204+0000 mgr.y (mgr.24389) 692 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:16 smithi113 bash[21528]: cluster 2024-04-19T23:03:15.326056+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-04-19T23:03:16.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:16 smithi113 bash[21528]: audit 2024-04-19T23:03:15.555204+0000 mgr.y (mgr.24389) 692 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:16 smithi178 bash[23441]: cluster 2024-04-19T23:03:15.326056+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-04-19T23:03:16.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:16 smithi178 bash[23441]: audit 2024-04-19T23:03:15.555204+0000 mgr.y (mgr.24389) 692 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:17.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[28910]: cluster 2024-04-19T23:03:16.236130+0000 mgr.y (mgr.24389) 693 : cluster 0 pgmap v1170: 172 pgs: 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[28910]: cluster 2024-04-19T23:03:16.351702+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[28910]: audit 2024-04-19T23:03:16.355639+0000 mon.c (mon.2) 920 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[28910]: audit 2024-04-19T23:03:16.359196+0000 mon.a (mon.0) 3565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[21528]: cluster 2024-04-19T23:03:16.236130+0000 mgr.y (mgr.24389) 693 : cluster 0 pgmap v1170: 172 pgs: 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[21528]: cluster 2024-04-19T23:03:16.351702+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[21528]: audit 2024-04-19T23:03:16.355639+0000 mon.c (mon.2) 920 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:17 smithi113 bash[21528]: audit 2024-04-19T23:03:16.359196+0000 mon.a (mon.0) 3565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:17 smithi178 bash[23441]: cluster 2024-04-19T23:03:16.236130+0000 mgr.y (mgr.24389) 693 : cluster 0 pgmap v1170: 172 pgs: 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:17 smithi178 bash[23441]: cluster 2024-04-19T23:03:16.351702+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-04-19T23:03:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:17 smithi178 bash[23441]: audit 2024-04-19T23:03:16.355639+0000 mon.c (mon.2) 920 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:17 smithi178 bash[23441]: audit 2024-04-19T23:03:16.359196+0000 mon.a (mon.0) 3565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[21528]: audit 2024-04-19T23:03:17.346390+0000 mon.a (mon.0) 3566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[21528]: cluster 2024-04-19T23:03:17.355203+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-04-19T23:03:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[21528]: audit 2024-04-19T23:03:17.453657+0000 mon.c (mon.2) 921 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:18.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[21528]: audit 2024-04-19T23:03:17.454386+0000 mon.a (mon.0) 3568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[28910]: audit 2024-04-19T23:03:17.346390+0000 mon.a (mon.0) 3566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[28910]: cluster 2024-04-19T23:03:17.355203+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-04-19T23:03:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[28910]: audit 2024-04-19T23:03:17.453657+0000 mon.c (mon.2) 921 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:18 smithi113 bash[28910]: audit 2024-04-19T23:03:17.454386+0000 mon.a (mon.0) 3568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:18.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:18 smithi178 bash[23441]: audit 2024-04-19T23:03:17.346390+0000 mon.a (mon.0) 3566 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:18.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:18 smithi178 bash[23441]: cluster 2024-04-19T23:03:17.355203+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-04-19T23:03:18.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:18 smithi178 bash[23441]: audit 2024-04-19T23:03:17.453657+0000 mon.c (mon.2) 921 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:18.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:18 smithi178 bash[23441]: audit 2024-04-19T23:03:17.454386+0000 mon.a (mon.0) 3568 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:19.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[21528]: cluster 2024-04-19T23:03:18.237016+0000 mgr.y (mgr.24389) 694 : cluster 0 pgmap v1173: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:19.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[21528]: audit 2024-04-19T23:03:18.372636+0000 mon.a (mon.0) 3569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:19.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[21528]: cluster 2024-04-19T23:03:18.384749+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[21528]: audit 2024-04-19T23:03:18.386073+0000 mon.c (mon.2) 922 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[21528]: audit 2024-04-19T23:03:18.388090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[28910]: cluster 2024-04-19T23:03:18.237016+0000 mgr.y (mgr.24389) 694 : cluster 0 pgmap v1173: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[28910]: audit 2024-04-19T23:03:18.372636+0000 mon.a (mon.0) 3569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[28910]: cluster 2024-04-19T23:03:18.384749+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[28910]: audit 2024-04-19T23:03:18.386073+0000 mon.c (mon.2) 922 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:19.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:19 smithi113 bash[28910]: audit 2024-04-19T23:03:18.388090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:19 smithi178 bash[23441]: cluster 2024-04-19T23:03:18.237016+0000 mgr.y (mgr.24389) 694 : cluster 0 pgmap v1173: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:19 smithi178 bash[23441]: audit 2024-04-19T23:03:18.372636+0000 mon.a (mon.0) 3569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:19 smithi178 bash[23441]: cluster 2024-04-19T23:03:18.384749+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-04-19T23:03:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:19 smithi178 bash[23441]: audit 2024-04-19T23:03:18.386073+0000 mon.c (mon.2) 922 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:19.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:19 smithi178 bash[23441]: audit 2024-04-19T23:03:18.388090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[21528]: audit 2024-04-19T23:03:19.375186+0000 mon.a (mon.0) 3572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[21528]: cluster 2024-04-19T23:03:19.382269+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[21528]: audit 2024-04-19T23:03:19.386876+0000 mon.c (mon.2) 923 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[21528]: audit 2024-04-19T23:03:19.402213+0000 mon.a (mon.0) 3574 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[21528]: audit 2024-04-19T23:03:20.012392+0000 mon.a (mon.0) 3575 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[28910]: audit 2024-04-19T23:03:19.375186+0000 mon.a (mon.0) 3572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[28910]: cluster 2024-04-19T23:03:19.382269+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[28910]: audit 2024-04-19T23:03:19.386876+0000 mon.c (mon.2) 923 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[28910]: audit 2024-04-19T23:03:19.402213+0000 mon.a (mon.0) 3574 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:20 smithi113 bash[28910]: audit 2024-04-19T23:03:20.012392+0000 mon.a (mon.0) 3575 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:20 smithi178 bash[23441]: audit 2024-04-19T23:03:19.375186+0000 mon.a (mon.0) 3572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:20 smithi178 bash[23441]: cluster 2024-04-19T23:03:19.382269+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-04-19T23:03:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:20 smithi178 bash[23441]: audit 2024-04-19T23:03:19.386876+0000 mon.c (mon.2) 923 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:20 smithi178 bash[23441]: audit 2024-04-19T23:03:19.402213+0000 mon.a (mon.0) 3574 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]: dispatch 2024-04-19T23:03:20.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:20 smithi178 bash[23441]: audit 2024-04-19T23:03:20.012392+0000 mon.a (mon.0) 3575 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:21.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: cluster 2024-04-19T23:03:20.239073+0000 mgr.y (mgr.24389) 695 : cluster 0 pgmap v1176: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: cluster 2024-04-19T23:03:20.391956+0000 mon.a (mon.0) 3576 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: audit 2024-04-19T23:03:20.407447+0000 mon.a (mon.0) 3577 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]': finished 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: cluster 2024-04-19T23:03:20.419422+0000 mon.a (mon.0) 3578 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: audit 2024-04-19T23:03:20.419968+0000 mon.c (mon.2) 924 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[28910]: audit 2024-04-19T23:03:20.422561+0000 mon.a (mon.0) 3579 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: cluster 2024-04-19T23:03:20.239073+0000 mgr.y (mgr.24389) 695 : cluster 0 pgmap v1176: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: cluster 2024-04-19T23:03:20.391956+0000 mon.a (mon.0) 3576 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: audit 2024-04-19T23:03:20.407447+0000 mon.a (mon.0) 3577 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]': finished 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: cluster 2024-04-19T23:03:20.419422+0000 mon.a (mon.0) 3578 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-04-19T23:03:21.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: audit 2024-04-19T23:03:20.419968+0000 mon.c (mon.2) 924 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:21.801 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:21 smithi113 bash[21528]: audit 2024-04-19T23:03:20.422561+0000 mon.a (mon.0) 3579 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: cluster 2024-04-19T23:03:20.239073+0000 mgr.y (mgr.24389) 695 : cluster 0 pgmap v1176: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: cluster 2024-04-19T23:03:20.391956+0000 mon.a (mon.0) 3576 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: audit 2024-04-19T23:03:20.407447+0000 mon.a (mon.0) 3577 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-142", "mode": "writeback"}]': finished 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: cluster 2024-04-19T23:03:20.419422+0000 mon.a (mon.0) 3578 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: audit 2024-04-19T23:03:20.419968+0000 mon.c (mon.2) 924 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:21.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:21 smithi178 bash[23441]: audit 2024-04-19T23:03:20.422561+0000 mon.a (mon.0) 3579 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:22.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[28910]: audit 2024-04-19T23:03:21.409843+0000 mon.a (mon.0) 3580 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:22.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[28910]: cluster 2024-04-19T23:03:21.418320+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-04-19T23:03:22.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[28910]: audit 2024-04-19T23:03:21.420303+0000 mon.c (mon.2) 925 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:22.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[28910]: audit 2024-04-19T23:03:21.422003+0000 mon.a (mon.0) 3582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:22.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[21528]: audit 2024-04-19T23:03:21.409843+0000 mon.a (mon.0) 3580 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:22.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[21528]: cluster 2024-04-19T23:03:21.418320+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-04-19T23:03:22.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[21528]: audit 2024-04-19T23:03:21.420303+0000 mon.c (mon.2) 925 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:22.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:22 smithi113 bash[21528]: audit 2024-04-19T23:03:21.422003+0000 mon.a (mon.0) 3582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:22.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:22 smithi178 bash[23441]: audit 2024-04-19T23:03:21.409843+0000 mon.a (mon.0) 3580 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:22.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:22 smithi178 bash[23441]: cluster 2024-04-19T23:03:21.418320+0000 mon.a (mon.0) 3581 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-04-19T23:03:22.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:22 smithi178 bash[23441]: audit 2024-04-19T23:03:21.420303+0000 mon.c (mon.2) 925 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:22.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:22 smithi178 bash[23441]: audit 2024-04-19T23:03:21.422003+0000 mon.a (mon.0) 3582 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[28910]: cluster 2024-04-19T23:03:22.239859+0000 mgr.y (mgr.24389) 696 : cluster 0 pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[28910]: audit 2024-04-19T23:03:22.419220+0000 mon.a (mon.0) 3583 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[28910]: cluster 2024-04-19T23:03:22.428473+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[28910]: audit 2024-04-19T23:03:22.430274+0000 mon.c (mon.2) 926 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[28910]: audit 2024-04-19T23:03:22.435261+0000 mon.a (mon.0) 3585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[21528]: cluster 2024-04-19T23:03:22.239859+0000 mgr.y (mgr.24389) 696 : cluster 0 pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[21528]: audit 2024-04-19T23:03:22.419220+0000 mon.a (mon.0) 3583 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[21528]: cluster 2024-04-19T23:03:22.428473+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[21528]: audit 2024-04-19T23:03:22.430274+0000 mon.c (mon.2) 926 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:23.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:23 smithi113 bash[21528]: audit 2024-04-19T23:03:22.435261+0000 mon.a (mon.0) 3585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:23 smithi178 bash[23441]: cluster 2024-04-19T23:03:22.239859+0000 mgr.y (mgr.24389) 696 : cluster 0 pgmap v1179: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-19T23:03:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:23 smithi178 bash[23441]: audit 2024-04-19T23:03:22.419220+0000 mon.a (mon.0) 3583 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:23 smithi178 bash[23441]: cluster 2024-04-19T23:03:22.428473+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-04-19T23:03:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:23 smithi178 bash[23441]: audit 2024-04-19T23:03:22.430274+0000 mon.c (mon.2) 926 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:23.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:23 smithi178 bash[23441]: audit 2024-04-19T23:03:22.435261+0000 mon.a (mon.0) 3585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: cluster 2024-04-19T23:03:23.419472+0000 mon.a (mon.0) 3586 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: audit 2024-04-19T23:03:23.421745+0000 mon.a (mon.0) 3587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: cluster 2024-04-19T23:03:23.429727+0000 mon.a (mon.0) 3588 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: audit 2024-04-19T23:03:23.431412+0000 mon.c (mon.2) 927 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: audit 2024-04-19T23:03:23.433790+0000 mon.a (mon.0) 3589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: audit 2024-04-19T23:03:24.424412+0000 mon.a (mon.0) 3590 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: cluster 2024-04-19T23:03:24.431823+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-04-19T23:03:24.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[21528]: audit 2024-04-19T23:03:24.433102+0000 mon.c (mon.2) 928 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: cluster 2024-04-19T23:03:23.419472+0000 mon.a (mon.0) 3586 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: audit 2024-04-19T23:03:23.421745+0000 mon.a (mon.0) 3587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: cluster 2024-04-19T23:03:23.429727+0000 mon.a (mon.0) 3588 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: audit 2024-04-19T23:03:23.431412+0000 mon.c (mon.2) 927 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: audit 2024-04-19T23:03:23.433790+0000 mon.a (mon.0) 3589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: audit 2024-04-19T23:03:24.424412+0000 mon.a (mon.0) 3590 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: cluster 2024-04-19T23:03:24.431823+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-04-19T23:03:24.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:24 smithi113 bash[28910]: audit 2024-04-19T23:03:24.433102+0000 mon.c (mon.2) 928 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: cluster 2024-04-19T23:03:23.419472+0000 mon.a (mon.0) 3586 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: audit 2024-04-19T23:03:23.421745+0000 mon.a (mon.0) 3587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: cluster 2024-04-19T23:03:23.429727+0000 mon.a (mon.0) 3588 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: audit 2024-04-19T23:03:23.431412+0000 mon.c (mon.2) 927 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: audit 2024-04-19T23:03:23.433790+0000 mon.a (mon.0) 3589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: audit 2024-04-19T23:03:24.424412+0000 mon.a (mon.0) 3590 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: cluster 2024-04-19T23:03:24.431823+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-04-19T23:03:24.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:24 smithi178 bash[23441]: audit 2024-04-19T23:03:24.433102+0000 mon.c (mon.2) 928 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:25.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[21528]: cluster 2024-04-19T23:03:24.240620+0000 mgr.y (mgr.24389) 697 : cluster 0 pgmap v1182: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[21528]: audit 2024-04-19T23:03:24.434897+0000 mon.a (mon.0) 3592 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[21528]: audit 2024-04-19T23:03:25.426882+0000 mon.a (mon.0) 3593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[21528]: cluster 2024-04-19T23:03:25.437270+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[28910]: cluster 2024-04-19T23:03:24.240620+0000 mgr.y (mgr.24389) 697 : cluster 0 pgmap v1182: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[28910]: audit 2024-04-19T23:03:24.434897+0000 mon.a (mon.0) 3592 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[28910]: audit 2024-04-19T23:03:25.426882+0000 mon.a (mon.0) 3593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T23:03:25.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:25 smithi113 bash[28910]: cluster 2024-04-19T23:03:25.437270+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-04-19T23:03:25.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:25 smithi178 bash[23441]: cluster 2024-04-19T23:03:24.240620+0000 mgr.y (mgr.24389) 697 : cluster 0 pgmap v1182: 204 pgs: 204 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:25 smithi178 bash[23441]: audit 2024-04-19T23:03:24.434897+0000 mon.a (mon.0) 3592 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-04-19T23:03:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:25 smithi178 bash[23441]: audit 2024-04-19T23:03:25.426882+0000 mon.a (mon.0) 3593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-04-19T23:03:25.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:25 smithi178 bash[23441]: cluster 2024-04-19T23:03:25.437270+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-04-19T23:03:26.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[21528]: audit 2024-04-19T23:03:25.438674+0000 mon.c (mon.2) 929 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[21528]: audit 2024-04-19T23:03:25.442102+0000 mon.a (mon.0) 3595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[21528]: audit 2024-04-19T23:03:25.566639+0000 mgr.y (mgr.24389) 698 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[21528]: audit 2024-04-19T23:03:26.429775+0000 mon.a (mon.0) 3596 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[21528]: cluster 2024-04-19T23:03:26.436601+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[28910]: audit 2024-04-19T23:03:25.438674+0000 mon.c (mon.2) 929 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[28910]: audit 2024-04-19T23:03:25.442102+0000 mon.a (mon.0) 3595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[28910]: audit 2024-04-19T23:03:25.566639+0000 mgr.y (mgr.24389) 698 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[28910]: audit 2024-04-19T23:03:26.429775+0000 mon.a (mon.0) 3596 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T23:03:26.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:26 smithi113 bash[28910]: cluster 2024-04-19T23:03:26.436601+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-04-19T23:03:26.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:26 smithi178 bash[23441]: audit 2024-04-19T23:03:25.438674+0000 mon.c (mon.2) 929 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:26 smithi178 bash[23441]: audit 2024-04-19T23:03:25.442102+0000 mon.a (mon.0) 3595 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-04-19T23:03:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:26 smithi178 bash[23441]: audit 2024-04-19T23:03:25.566639+0000 mgr.y (mgr.24389) 698 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:26 smithi178 bash[23441]: audit 2024-04-19T23:03:26.429775+0000 mon.a (mon.0) 3596 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-04-19T23:03:26.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:26 smithi178 bash[23441]: cluster 2024-04-19T23:03:26.436601+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-04-19T23:03:27.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:27.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[28910]: cluster 2024-04-19T23:03:26.241448+0000 mgr.y (mgr.24389) 699 : cluster 0 pgmap v1185: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:27.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[28910]: audit 2024-04-19T23:03:26.536913+0000 mon.c (mon.2) 930 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:27.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[28910]: audit 2024-04-19T23:03:26.537716+0000 mon.a (mon.0) 3598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[21528]: cluster 2024-04-19T23:03:26.241448+0000 mgr.y (mgr.24389) 699 : cluster 0 pgmap v1185: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[21528]: audit 2024-04-19T23:03:26.536913+0000 mon.c (mon.2) 930 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:27.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:27 smithi113 bash[21528]: audit 2024-04-19T23:03:26.537716+0000 mon.a (mon.0) 3598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:27.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:27 smithi178 bash[23441]: cluster 2024-04-19T23:03:26.241448+0000 mgr.y (mgr.24389) 699 : cluster 0 pgmap v1185: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:27 smithi178 bash[23441]: audit 2024-04-19T23:03:26.536913+0000 mon.c (mon.2) 930 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:27.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:27 smithi178 bash[23441]: audit 2024-04-19T23:03:26.537716+0000 mon.a (mon.0) 3598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:28.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[21528]: audit 2024-04-19T23:03:27.465038+0000 mon.a (mon.0) 3599 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[21528]: cluster 2024-04-19T23:03:27.473570+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[21528]: audit 2024-04-19T23:03:27.473859+0000 mon.c (mon.2) 931 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[21528]: audit 2024-04-19T23:03:27.475183+0000 mon.a (mon.0) 3601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[28910]: audit 2024-04-19T23:03:27.465038+0000 mon.a (mon.0) 3599 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[28910]: cluster 2024-04-19T23:03:27.473570+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[28910]: audit 2024-04-19T23:03:27.473859+0000 mon.c (mon.2) 931 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:28.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:28 smithi113 bash[28910]: audit 2024-04-19T23:03:27.475183+0000 mon.a (mon.0) 3601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:28.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:28 smithi178 bash[23441]: audit 2024-04-19T23:03:27.465038+0000 mon.a (mon.0) 3599 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:28 smithi178 bash[23441]: cluster 2024-04-19T23:03:27.473570+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-04-19T23:03:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:28 smithi178 bash[23441]: audit 2024-04-19T23:03:27.473859+0000 mon.c (mon.2) 931 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:28.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:28 smithi178 bash[23441]: audit 2024-04-19T23:03:27.475183+0000 mon.a (mon.0) 3601 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: cluster 2024-04-19T23:03:28.242261+0000 mgr.y (mgr.24389) 700 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:30.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: audit 2024-04-19T23:03:28.474155+0000 mon.a (mon.0) 3602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: cluster 2024-04-19T23:03:28.485161+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: audit 2024-04-19T23:03:28.547615+0000 mon.c (mon.2) 932 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: audit 2024-04-19T23:03:28.548301+0000 mon.a (mon.0) 3604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: audit 2024-04-19T23:03:28.549542+0000 mon.c (mon.2) 933 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[21528]: audit 2024-04-19T23:03:28.550206+0000 mon.a (mon.0) 3605 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: cluster 2024-04-19T23:03:28.242261+0000 mgr.y (mgr.24389) 700 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: audit 2024-04-19T23:03:28.474155+0000 mon.a (mon.0) 3602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: cluster 2024-04-19T23:03:28.485161+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: audit 2024-04-19T23:03:28.547615+0000 mon.c (mon.2) 932 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: audit 2024-04-19T23:03:28.548301+0000 mon.a (mon.0) 3604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: audit 2024-04-19T23:03:28.549542+0000 mon.c (mon.2) 933 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.301 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:29 smithi113 bash[28910]: audit 2024-04-19T23:03:28.550206+0000 mon.a (mon.0) 3605 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: cluster 2024-04-19T23:03:28.242261+0000 mgr.y (mgr.24389) 700 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: audit 2024-04-19T23:03:28.474155+0000 mon.a (mon.0) 3602 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]': finished 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: cluster 2024-04-19T23:03:28.485161+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: audit 2024-04-19T23:03:28.547615+0000 mon.c (mon.2) 932 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: audit 2024-04-19T23:03:28.548301+0000 mon.a (mon.0) 3604 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: audit 2024-04-19T23:03:28.549542+0000 mon.c (mon.2) 933 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:30.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:29 smithi178 bash[23441]: audit 2024-04-19T23:03:28.550206+0000 mon.a (mon.0) 3605 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-142"}]: dispatch 2024-04-19T23:03:31.299 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[21528]: cluster 2024-04-19T23:03:29.484984+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[21528]: cluster 2024-04-19T23:03:30.244113+0000 mgr.y (mgr.24389) 701 : cluster 0 pgmap v1191: 172 pgs: 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[21528]: cluster 2024-04-19T23:03:30.488104+0000 mon.a (mon.0) 3607 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[21528]: audit 2024-04-19T23:03:30.492112+0000 mon.c (mon.2) 934 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[21528]: audit 2024-04-19T23:03:30.499770+0000 mon.a (mon.0) 3608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[28910]: cluster 2024-04-19T23:03:29.484984+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[28910]: cluster 2024-04-19T23:03:30.244113+0000 mgr.y (mgr.24389) 701 : cluster 0 pgmap v1191: 172 pgs: 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[28910]: cluster 2024-04-19T23:03:30.488104+0000 mon.a (mon.0) 3607 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[28910]: audit 2024-04-19T23:03:30.492112+0000 mon.c (mon.2) 934 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:31.300 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:30 smithi113 bash[28910]: audit 2024-04-19T23:03:30.499770+0000 mon.a (mon.0) 3608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:31.305 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:30 smithi178 bash[23441]: cluster 2024-04-19T23:03:29.484984+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-04-19T23:03:31.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:30 smithi178 bash[23441]: cluster 2024-04-19T23:03:30.244113+0000 mgr.y (mgr.24389) 701 : cluster 0 pgmap v1191: 172 pgs: 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:31.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:30 smithi178 bash[23441]: cluster 2024-04-19T23:03:30.488104+0000 mon.a (mon.0) 3607 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-04-19T23:03:31.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:30 smithi178 bash[23441]: audit 2024-04-19T23:03:30.492112+0000 mon.c (mon.2) 934 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:31.306 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:30 smithi178 bash[23441]: audit 2024-04-19T23:03:30.499770+0000 mon.a (mon.0) 3608 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[21528]: audit 2024-04-19T23:03:31.483529+0000 mon.a (mon.0) 3609 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[21528]: cluster 2024-04-19T23:03:31.491826+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-04-19T23:03:32.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[21528]: audit 2024-04-19T23:03:31.539391+0000 mon.c (mon.2) 935 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:32.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[21528]: audit 2024-04-19T23:03:31.541327+0000 mon.a (mon.0) 3611 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[28910]: audit 2024-04-19T23:03:31.483529+0000 mon.a (mon.0) 3609 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[28910]: cluster 2024-04-19T23:03:31.491826+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-04-19T23:03:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[28910]: audit 2024-04-19T23:03:31.539391+0000 mon.c (mon.2) 935 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:32.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:32 smithi113 bash[28910]: audit 2024-04-19T23:03:31.541327+0000 mon.a (mon.0) 3611 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:32 smithi178 bash[23441]: audit 2024-04-19T23:03:31.483529+0000 mon.a (mon.0) 3609 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:32 smithi178 bash[23441]: cluster 2024-04-19T23:03:31.491826+0000 mon.a (mon.0) 3610 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-04-19T23:03:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:32 smithi178 bash[23441]: audit 2024-04-19T23:03:31.539391+0000 mon.c (mon.2) 935 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:32.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:32 smithi178 bash[23441]: audit 2024-04-19T23:03:31.541327+0000 mon.a (mon.0) 3611 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:33.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[21528]: cluster 2024-04-19T23:03:32.244952+0000 mgr.y (mgr.24389) 702 : cluster 0 pgmap v1194: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:33.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[21528]: audit 2024-04-19T23:03:32.494291+0000 mon.a (mon.0) 3612 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:33.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[21528]: cluster 2024-04-19T23:03:32.508301+0000 mon.a (mon.0) 3613 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-04-19T23:03:33.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[21528]: audit 2024-04-19T23:03:32.509951+0000 mon.c (mon.2) 936 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[21528]: audit 2024-04-19T23:03:32.513016+0000 mon.a (mon.0) 3614 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[28910]: cluster 2024-04-19T23:03:32.244952+0000 mgr.y (mgr.24389) 702 : cluster 0 pgmap v1194: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[28910]: audit 2024-04-19T23:03:32.494291+0000 mon.a (mon.0) 3612 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[28910]: cluster 2024-04-19T23:03:32.508301+0000 mon.a (mon.0) 3613 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[28910]: audit 2024-04-19T23:03:32.509951+0000 mon.c (mon.2) 936 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:33.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:33 smithi113 bash[28910]: audit 2024-04-19T23:03:32.513016+0000 mon.a (mon.0) 3614 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:33.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:33 smithi178 bash[23441]: cluster 2024-04-19T23:03:32.244952+0000 mgr.y (mgr.24389) 702 : cluster 0 pgmap v1194: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-19T23:03:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:33 smithi178 bash[23441]: audit 2024-04-19T23:03:32.494291+0000 mon.a (mon.0) 3612 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:33 smithi178 bash[23441]: cluster 2024-04-19T23:03:32.508301+0000 mon.a (mon.0) 3613 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-04-19T23:03:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:33 smithi178 bash[23441]: audit 2024-04-19T23:03:32.509951+0000 mon.c (mon.2) 936 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:33.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:33 smithi178 bash[23441]: audit 2024-04-19T23:03:32.513016+0000 mon.a (mon.0) 3614 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[28910]: audit 2024-04-19T23:03:33.498576+0000 mon.a (mon.0) 3615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[28910]: cluster 2024-04-19T23:03:33.507440+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-04-19T23:03:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[28910]: audit 2024-04-19T23:03:33.511409+0000 mon.c (mon.2) 937 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:34.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[28910]: audit 2024-04-19T23:03:33.523348+0000 mon.a (mon.0) 3617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:34.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[21528]: audit 2024-04-19T23:03:33.498576+0000 mon.a (mon.0) 3615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:34.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[21528]: cluster 2024-04-19T23:03:33.507440+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-04-19T23:03:34.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[21528]: audit 2024-04-19T23:03:33.511409+0000 mon.c (mon.2) 937 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:34.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:34 smithi113 bash[21528]: audit 2024-04-19T23:03:33.523348+0000 mon.a (mon.0) 3617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:34.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:34 smithi178 bash[23441]: audit 2024-04-19T23:03:33.498576+0000 mon.a (mon.0) 3615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:34.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:34 smithi178 bash[23441]: cluster 2024-04-19T23:03:33.507440+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-04-19T23:03:34.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:34 smithi178 bash[23441]: audit 2024-04-19T23:03:33.511409+0000 mon.c (mon.2) 937 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:34.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:34 smithi178 bash[23441]: audit 2024-04-19T23:03:33.523348+0000 mon.a (mon.0) 3617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]: dispatch 2024-04-19T23:03:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: cluster 2024-04-19T23:03:34.245766+0000 mgr.y (mgr.24389) 703 : cluster 0 pgmap v1197: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: cluster 2024-04-19T23:03:34.514703+0000 mon.a (mon.0) 3618 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: audit 2024-04-19T23:03:34.526719+0000 mon.a (mon.0) 3619 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]': finished 2024-04-19T23:03:35.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: cluster 2024-04-19T23:03:34.535143+0000 mon.a (mon.0) 3620 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: audit 2024-04-19T23:03:35.048174+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[21528]: audit 2024-04-19T23:03:35.050637+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: cluster 2024-04-19T23:03:34.245766+0000 mgr.y (mgr.24389) 703 : cluster 0 pgmap v1197: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: cluster 2024-04-19T23:03:34.514703+0000 mon.a (mon.0) 3618 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: audit 2024-04-19T23:03:34.526719+0000 mon.a (mon.0) 3619 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]': finished 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: cluster 2024-04-19T23:03:34.535143+0000 mon.a (mon.0) 3620 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: audit 2024-04-19T23:03:35.048174+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:35.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:35 smithi113 bash[28910]: audit 2024-04-19T23:03:35.050637+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:35.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:35.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: cluster 2024-04-19T23:03:34.245766+0000 mgr.y (mgr.24389) 703 : cluster 0 pgmap v1197: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:03:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: cluster 2024-04-19T23:03:34.514703+0000 mon.a (mon.0) 3618 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: audit 2024-04-19T23:03:34.526719+0000 mon.a (mon.0) 3619 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-144", "mode": "readproxy"}]': finished 2024-04-19T23:03:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: cluster 2024-04-19T23:03:34.535143+0000 mon.a (mon.0) 3620 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-04-19T23:03:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: audit 2024-04-19T23:03:35.048174+0000 mon.a (mon.0) 3621 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:35.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:35 smithi178 bash[23441]: audit 2024-04-19T23:03:35.050637+0000 mon.a (mon.0) 3622 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:36.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:36 smithi113 bash[28910]: audit 2024-04-19T23:03:35.578092+0000 mgr.y (mgr.24389) 704 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:36.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:36 smithi113 bash[21528]: audit 2024-04-19T23:03:35.578092+0000 mgr.y (mgr.24389) 704 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:36.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:36 smithi178 bash[23441]: audit 2024-04-19T23:03:35.578092+0000 mgr.y (mgr.24389) 704 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:37.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:37 smithi113 bash[28910]: cluster 2024-04-19T23:03:36.247830+0000 mgr.y (mgr.24389) 705 : cluster 0 pgmap v1199: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 215 B/s wr, 1 op/s 2024-04-19T23:03:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:37 smithi113 bash[21528]: cluster 2024-04-19T23:03:36.247830+0000 mgr.y (mgr.24389) 705 : cluster 0 pgmap v1199: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 215 B/s wr, 1 op/s 2024-04-19T23:03:37.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:37.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:37 smithi178 bash[23441]: cluster 2024-04-19T23:03:36.247830+0000 mgr.y (mgr.24389) 705 : cluster 0 pgmap v1199: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 215 B/s wr, 1 op/s 2024-04-19T23:03:39.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:39 smithi113 bash[28910]: cluster 2024-04-19T23:03:38.248667+0000 mgr.y (mgr.24389) 706 : cluster 0 pgmap v1200: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-04-19T23:03:39.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:39 smithi113 bash[21528]: cluster 2024-04-19T23:03:38.248667+0000 mgr.y (mgr.24389) 706 : cluster 0 pgmap v1200: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-04-19T23:03:39.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:39 smithi178 bash[23441]: cluster 2024-04-19T23:03:38.248667+0000 mgr.y (mgr.24389) 706 : cluster 0 pgmap v1200: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-04-19T23:03:41.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:41 smithi113 bash[21528]: cluster 2024-04-19T23:03:40.250802+0000 mgr.y (mgr.24389) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 132 B/s wr, 1 op/s 2024-04-19T23:03:41.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:41 smithi113 bash[28910]: cluster 2024-04-19T23:03:40.250802+0000 mgr.y (mgr.24389) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 132 B/s wr, 1 op/s 2024-04-19T23:03:41.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:41 smithi178 bash[23441]: cluster 2024-04-19T23:03:40.250802+0000 mgr.y (mgr.24389) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 132 B/s wr, 1 op/s 2024-04-19T23:03:43.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:43 smithi113 bash[28910]: cluster 2024-04-19T23:03:42.251580+0000 mgr.y (mgr.24389) 708 : cluster 0 pgmap v1202: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 117 B/s wr, 1 op/s 2024-04-19T23:03:43.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:43 smithi113 bash[21528]: cluster 2024-04-19T23:03:42.251580+0000 mgr.y (mgr.24389) 708 : cluster 0 pgmap v1202: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 117 B/s wr, 1 op/s 2024-04-19T23:03:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:43 smithi178 bash[23441]: cluster 2024-04-19T23:03:42.251580+0000 mgr.y (mgr.24389) 708 : cluster 0 pgmap v1202: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 117 B/s wr, 1 op/s 2024-04-19T23:03:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[21528]: cluster 2024-04-19T23:03:44.252347+0000 mgr.y (mgr.24389) 709 : cluster 0 pgmap v1203: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-19T23:03:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[21528]: audit 2024-04-19T23:03:44.844093+0000 mon.c (mon.2) 938 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:46.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[21528]: audit 2024-04-19T23:03:44.844901+0000 mon.a (mon.0) 3623 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[28910]: cluster 2024-04-19T23:03:44.252347+0000 mgr.y (mgr.24389) 709 : cluster 0 pgmap v1203: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-19T23:03:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[28910]: audit 2024-04-19T23:03:44.844093+0000 mon.c (mon.2) 938 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:46.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:45 smithi113 bash[28910]: audit 2024-04-19T23:03:44.844901+0000 mon.a (mon.0) 3623 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:46.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:45 smithi178 bash[23441]: cluster 2024-04-19T23:03:44.252347+0000 mgr.y (mgr.24389) 709 : cluster 0 pgmap v1203: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-19T23:03:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:45 smithi178 bash[23441]: audit 2024-04-19T23:03:44.844093+0000 mon.c (mon.2) 938 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:46.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:45 smithi178 bash[23441]: audit 2024-04-19T23:03:44.844901+0000 mon.a (mon.0) 3623 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:47.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: audit 2024-04-19T23:03:45.551114+0000 mon.a (mon.0) 3624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: cluster 2024-04-19T23:03:45.559603+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: audit 2024-04-19T23:03:45.560966+0000 mon.c (mon.2) 939 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: audit 2024-04-19T23:03:45.561913+0000 mon.a (mon.0) 3626 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: audit 2024-04-19T23:03:45.580271+0000 mgr.y (mgr.24389) 710 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: cluster 2024-04-19T23:03:46.551484+0000 mon.a (mon.0) 3627 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: audit 2024-04-19T23:03:46.553863+0000 mon.a (mon.0) 3628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[21528]: cluster 2024-04-19T23:03:46.561155+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: audit 2024-04-19T23:03:45.551114+0000 mon.a (mon.0) 3624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:47.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: cluster 2024-04-19T23:03:45.559603+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: audit 2024-04-19T23:03:45.560966+0000 mon.c (mon.2) 939 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: audit 2024-04-19T23:03:45.561913+0000 mon.a (mon.0) 3626 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: audit 2024-04-19T23:03:45.580271+0000 mgr.y (mgr.24389) 710 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: cluster 2024-04-19T23:03:46.551484+0000 mon.a (mon.0) 3627 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: audit 2024-04-19T23:03:46.553863+0000 mon.a (mon.0) 3628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:47.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:46 smithi113 bash[28910]: cluster 2024-04-19T23:03:46.561155+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-04-19T23:03:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: audit 2024-04-19T23:03:45.551114+0000 mon.a (mon.0) 3624 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:03:47.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: cluster 2024-04-19T23:03:45.559603+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: audit 2024-04-19T23:03:45.560966+0000 mon.c (mon.2) 939 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: audit 2024-04-19T23:03:45.561913+0000 mon.a (mon.0) 3626 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: audit 2024-04-19T23:03:45.580271+0000 mgr.y (mgr.24389) 710 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: cluster 2024-04-19T23:03:46.551484+0000 mon.a (mon.0) 3627 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: audit 2024-04-19T23:03:46.553863+0000 mon.a (mon.0) 3628 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]': finished 2024-04-19T23:03:47.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:46 smithi178 bash[23441]: cluster 2024-04-19T23:03:46.561155+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21528]: cluster 2024-04-19T23:03:46.253171+0000 mgr.y (mgr.24389) 711 : cluster 0 pgmap v1205: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21528]: audit 2024-04-19T23:03:46.635351+0000 mon.c (mon.2) 940 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21528]: audit 2024-04-19T23:03:46.636107+0000 mon.a (mon.0) 3630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21528]: audit 2024-04-19T23:03:46.637331+0000 mon.c (mon.2) 941 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[21528]: audit 2024-04-19T23:03:46.638083+0000 mon.a (mon.0) 3631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[28910]: cluster 2024-04-19T23:03:46.253171+0000 mgr.y (mgr.24389) 711 : cluster 0 pgmap v1205: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:03:47.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[28910]: audit 2024-04-19T23:03:46.635351+0000 mon.c (mon.2) 940 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:47.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[28910]: audit 2024-04-19T23:03:46.636107+0000 mon.a (mon.0) 3630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:47.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[28910]: audit 2024-04-19T23:03:46.637331+0000 mon.c (mon.2) 941 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:47.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:47 smithi113 bash[28910]: audit 2024-04-19T23:03:46.638083+0000 mon.a (mon.0) 3631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:47 smithi178 bash[23441]: cluster 2024-04-19T23:03:46.253171+0000 mgr.y (mgr.24389) 711 : cluster 0 pgmap v1205: 204 pgs: 204 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:03:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:47 smithi178 bash[23441]: audit 2024-04-19T23:03:46.635351+0000 mon.c (mon.2) 940 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:47 smithi178 bash[23441]: audit 2024-04-19T23:03:46.636107+0000 mon.a (mon.0) 3630 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:03:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:47 smithi178 bash[23441]: audit 2024-04-19T23:03:46.637331+0000 mon.c (mon.2) 941 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:48.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:47 smithi178 bash[23441]: audit 2024-04-19T23:03:46.638083+0000 mon.a (mon.0) 3631 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-144"}]: dispatch 2024-04-19T23:03:49.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:48 smithi113 bash[21528]: cluster 2024-04-19T23:03:47.601849+0000 mon.a (mon.0) 3632 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-04-19T23:03:49.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:48 smithi113 bash[28910]: cluster 2024-04-19T23:03:47.601849+0000 mon.a (mon.0) 3632 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-04-19T23:03:49.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:48 smithi178 bash[23441]: cluster 2024-04-19T23:03:47.601849+0000 mon.a (mon.0) 3632 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[28910]: cluster 2024-04-19T23:03:48.253945+0000 mgr.y (mgr.24389) 712 : cluster 0 pgmap v1208: 172 pgs: 172 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[28910]: cluster 2024-04-19T23:03:48.614488+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[28910]: audit 2024-04-19T23:03:48.619787+0000 mon.c (mon.2) 942 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[28910]: audit 2024-04-19T23:03:48.620626+0000 mon.a (mon.0) 3634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[21528]: cluster 2024-04-19T23:03:48.253945+0000 mgr.y (mgr.24389) 712 : cluster 0 pgmap v1208: 172 pgs: 172 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[21528]: cluster 2024-04-19T23:03:48.614488+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[21528]: audit 2024-04-19T23:03:48.619787+0000 mon.c (mon.2) 942 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:49 smithi113 bash[21528]: audit 2024-04-19T23:03:48.620626+0000 mon.a (mon.0) 3634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:49 smithi178 bash[23441]: cluster 2024-04-19T23:03:48.253945+0000 mgr.y (mgr.24389) 712 : cluster 0 pgmap v1208: 172 pgs: 172 active+clean; 4.4 MiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:03:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:49 smithi178 bash[23441]: cluster 2024-04-19T23:03:48.614488+0000 mon.a (mon.0) 3633 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-04-19T23:03:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:49 smithi178 bash[23441]: audit 2024-04-19T23:03:48.619787+0000 mon.c (mon.2) 942 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:50.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:49 smithi178 bash[23441]: audit 2024-04-19T23:03:48.620626+0000 mon.a (mon.0) 3634 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: audit 2024-04-19T23:03:49.604233+0000 mon.a (mon.0) 3635 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: cluster 2024-04-19T23:03:49.612704+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: audit 2024-04-19T23:03:49.669838+0000 mon.c (mon.2) 943 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: audit 2024-04-19T23:03:49.670494+0000 mon.a (mon.0) 3637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: audit 2024-04-19T23:03:50.090105+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:51.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[28910]: audit 2024-04-19T23:03:50.092426+0000 mon.a (mon.0) 3639 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: audit 2024-04-19T23:03:49.604233+0000 mon.a (mon.0) 3635 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: cluster 2024-04-19T23:03:49.612704+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: audit 2024-04-19T23:03:49.669838+0000 mon.c (mon.2) 943 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: audit 2024-04-19T23:03:49.670494+0000 mon.a (mon.0) 3637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: audit 2024-04-19T23:03:50.090105+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:51.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:50 smithi113 bash[21528]: audit 2024-04-19T23:03:50.092426+0000 mon.a (mon.0) 3639 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:51.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: audit 2024-04-19T23:03:49.604233+0000 mon.a (mon.0) 3635 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:03:51.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: cluster 2024-04-19T23:03:49.612704+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-04-19T23:03:51.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: audit 2024-04-19T23:03:49.669838+0000 mon.c (mon.2) 943 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: audit 2024-04-19T23:03:49.670494+0000 mon.a (mon.0) 3637 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:03:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: audit 2024-04-19T23:03:50.090105+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:03:51.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:50 smithi178 bash[23441]: audit 2024-04-19T23:03:50.092426+0000 mon.a (mon.0) 3639 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: cluster 2024-04-19T23:03:50.256044+0000 mgr.y (mgr.24389) 713 : cluster 0 pgmap v1211: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: audit 2024-04-19T23:03:50.619404+0000 mon.a (mon.0) 3640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: cluster 2024-04-19T23:03:50.627162+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: audit 2024-04-19T23:03:50.629678+0000 mon.c (mon.2) 944 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: audit 2024-04-19T23:03:50.632881+0000 mon.a (mon.0) 3642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: audit 2024-04-19T23:03:51.622183+0000 mon.a (mon.0) 3643 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:03:52.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[21528]: cluster 2024-04-19T23:03:51.630212+0000 mon.a (mon.0) 3644 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: cluster 2024-04-19T23:03:50.256044+0000 mgr.y (mgr.24389) 713 : cluster 0 pgmap v1211: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: audit 2024-04-19T23:03:50.619404+0000 mon.a (mon.0) 3640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: cluster 2024-04-19T23:03:50.627162+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: audit 2024-04-19T23:03:50.629678+0000 mon.c (mon.2) 944 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: audit 2024-04-19T23:03:50.632881+0000 mon.a (mon.0) 3642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: audit 2024-04-19T23:03:51.622183+0000 mon.a (mon.0) 3643 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:03:52.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:51 smithi113 bash[28910]: cluster 2024-04-19T23:03:51.630212+0000 mon.a (mon.0) 3644 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-04-19T23:03:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: cluster 2024-04-19T23:03:50.256044+0000 mgr.y (mgr.24389) 713 : cluster 0 pgmap v1211: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: audit 2024-04-19T23:03:50.619404+0000 mon.a (mon.0) 3640 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:03:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: cluster 2024-04-19T23:03:50.627162+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-04-19T23:03:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: audit 2024-04-19T23:03:50.629678+0000 mon.c (mon.2) 944 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: audit 2024-04-19T23:03:50.632881+0000 mon.a (mon.0) 3642 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:03:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: audit 2024-04-19T23:03:51.622183+0000 mon.a (mon.0) 3643 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi113-63998-111", "overlaypool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:03:52.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:51 smithi178 bash[23441]: cluster 2024-04-19T23:03:51.630212+0000 mon.a (mon.0) 3644 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[28910]: audit 2024-04-19T23:03:51.633488+0000 mon.c (mon.2) 945 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[28910]: audit 2024-04-19T23:03:51.637551+0000 mon.a (mon.0) 3645 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[28910]: cluster 2024-04-19T23:03:52.622612+0000 mon.a (mon.0) 3646 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[28910]: audit 2024-04-19T23:03:52.625008+0000 mon.a (mon.0) 3647 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]': finished 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[28910]: cluster 2024-04-19T23:03:52.633467+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[21528]: audit 2024-04-19T23:03:51.633488+0000 mon.c (mon.2) 945 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[21528]: audit 2024-04-19T23:03:51.637551+0000 mon.a (mon.0) 3645 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[21528]: cluster 2024-04-19T23:03:52.622612+0000 mon.a (mon.0) 3646 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:53.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[21528]: audit 2024-04-19T23:03:52.625008+0000 mon.a (mon.0) 3647 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]': finished 2024-04-19T23:03:53.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:52 smithi113 bash[21528]: cluster 2024-04-19T23:03:52.633467+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-04-19T23:03:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:52 smithi178 bash[23441]: audit 2024-04-19T23:03:51.633488+0000 mon.c (mon.2) 945 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:52 smithi178 bash[23441]: audit 2024-04-19T23:03:51.637551+0000 mon.a (mon.0) 3645 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]: dispatch 2024-04-19T23:03:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:52 smithi178 bash[23441]: cluster 2024-04-19T23:03:52.622612+0000 mon.a (mon.0) 3646 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-19T23:03:53.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:52 smithi178 bash[23441]: audit 2024-04-19T23:03:52.625008+0000 mon.a (mon.0) 3647 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi113-63998-146", "mode": "writeback"}]': finished 2024-04-19T23:03:53.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:52 smithi178 bash[23441]: cluster 2024-04-19T23:03:52.633467+0000 mon.a (mon.0) 3648 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[21528]: cluster 2024-04-19T23:03:52.256889+0000 mgr.y (mgr.24389) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[21528]: audit 2024-04-19T23:03:52.728495+0000 mon.c (mon.2) 946 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[21528]: audit 2024-04-19T23:03:52.729287+0000 mon.a (mon.0) 3649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[28910]: cluster 2024-04-19T23:03:52.256889+0000 mgr.y (mgr.24389) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[28910]: audit 2024-04-19T23:03:52.728495+0000 mon.c (mon.2) 946 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:54.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:53 smithi113 bash[28910]: audit 2024-04-19T23:03:52.729287+0000 mon.a (mon.0) 3649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:53 smithi178 bash[23441]: cluster 2024-04-19T23:03:52.256889+0000 mgr.y (mgr.24389) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-04-19T23:03:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:53 smithi178 bash[23441]: audit 2024-04-19T23:03:52.728495+0000 mon.c (mon.2) 946 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:54.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:53 smithi178 bash[23441]: audit 2024-04-19T23:03:52.729287+0000 mon.a (mon.0) 3649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]: dispatch 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[21528]: audit 2024-04-19T23:03:53.664967+0000 mon.a (mon.0) 3650 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[21528]: cluster 2024-04-19T23:03:53.672340+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[21528]: audit 2024-04-19T23:03:53.674207+0000 mon.c (mon.2) 947 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[21528]: audit 2024-04-19T23:03:53.675272+0000 mon.a (mon.0) 3652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[28910]: audit 2024-04-19T23:03:53.664967+0000 mon.a (mon.0) 3650 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[28910]: cluster 2024-04-19T23:03:53.672340+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[28910]: audit 2024-04-19T23:03:53.674207+0000 mon.c (mon.2) 947 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:55.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:54 smithi113 bash[28910]: audit 2024-04-19T23:03:53.675272+0000 mon.a (mon.0) 3652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:54 smithi178 bash[23441]: audit 2024-04-19T23:03:53.664967+0000 mon.a (mon.0) 3650 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_count","val": "2"}]': finished 2024-04-19T23:03:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:54 smithi178 bash[23441]: cluster 2024-04-19T23:03:53.672340+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-04-19T23:03:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:54 smithi178 bash[23441]: audit 2024-04-19T23:03:53.674207+0000 mon.c (mon.2) 947 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:55.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:54 smithi178 bash[23441]: audit 2024-04-19T23:03:53.675272+0000 mon.a (mon.0) 3652 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]: dispatch 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[21528]: cluster 2024-04-19T23:03:54.257653+0000 mgr.y (mgr.24389) 715 : cluster 0 pgmap v1217: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[21528]: audit 2024-04-19T23:03:54.674021+0000 mon.a (mon.0) 3653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[21528]: cluster 2024-04-19T23:03:54.682982+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[21528]: audit 2024-04-19T23:03:54.684527+0000 mon.c (mon.2) 948 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[21528]: audit 2024-04-19T23:03:54.689255+0000 mon.a (mon.0) 3655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[28910]: cluster 2024-04-19T23:03:54.257653+0000 mgr.y (mgr.24389) 715 : cluster 0 pgmap v1217: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[28910]: audit 2024-04-19T23:03:54.674021+0000 mon.a (mon.0) 3653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:56.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[28910]: cluster 2024-04-19T23:03:54.682982+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-04-19T23:03:56.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[28910]: audit 2024-04-19T23:03:54.684527+0000 mon.c (mon.2) 948 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:56.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:55 smithi113 bash[28910]: audit 2024-04-19T23:03:54.689255+0000 mon.a (mon.0) 3655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:56.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:03:56.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[23441]: cluster 2024-04-19T23:03:54.257653+0000 mgr.y (mgr.24389) 715 : cluster 0 pgmap v1217: 204 pgs: 204 active+clean; 4.4 MiB data, 736 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:03:56.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[23441]: audit 2024-04-19T23:03:54.674021+0000 mon.a (mon.0) 3653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_period","val": "600"}]': finished 2024-04-19T23:03:56.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[23441]: cluster 2024-04-19T23:03:54.682982+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-04-19T23:03:56.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[23441]: audit 2024-04-19T23:03:54.684527+0000 mon.c (mon.2) 948 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:56.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:55 smithi178 bash[23441]: audit 2024-04-19T23:03:54.689255+0000 mon.a (mon.0) 3655 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-04-19T23:03:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: audit 2024-04-19T23:03:55.589586+0000 mgr.y (mgr.24389) 716 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: cluster 2024-04-19T23:03:55.674318+0000 mon.a (mon.0) 3656 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:57.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: audit 2024-04-19T23:03:55.676676+0000 mon.a (mon.0) 3657 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: cluster 2024-04-19T23:03:55.684688+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: audit 2024-04-19T23:03:55.687172+0000 mon.c (mon.2) 949 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: audit 2024-04-19T23:03:55.688074+0000 mon.a (mon.0) 3659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[21528]: audit 2024-04-19T23:03:56.679371+0000 mon.a (mon.0) 3660 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: audit 2024-04-19T23:03:55.589586+0000 mgr.y (mgr.24389) 716 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: cluster 2024-04-19T23:03:55.674318+0000 mon.a (mon.0) 3656 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: audit 2024-04-19T23:03:55.676676+0000 mon.a (mon.0) 3657 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:57.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: cluster 2024-04-19T23:03:55.684688+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-04-19T23:03:57.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: audit 2024-04-19T23:03:55.687172+0000 mon.c (mon.2) 949 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: audit 2024-04-19T23:03:55.688074+0000 mon.a (mon.0) 3659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.051 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:56 smithi113 bash[28910]: audit 2024-04-19T23:03:56.679371+0000 mon.a (mon.0) 3660 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: audit 2024-04-19T23:03:55.589586+0000 mgr.y (mgr.24389) 716 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:03:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: cluster 2024-04-19T23:03:55.674318+0000 mon.a (mon.0) 3656 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-04-19T23:03:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: audit 2024-04-19T23:03:55.676676+0000 mon.a (mon.0) 3657 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "hit_set_type","val": "bloom"}]': finished 2024-04-19T23:03:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: cluster 2024-04-19T23:03:55.684688+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-04-19T23:03:57.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: audit 2024-04-19T23:03:55.687172+0000 mon.c (mon.2) 949 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: audit 2024-04-19T23:03:55.688074+0000 mon.a (mon.0) 3659 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-04-19T23:03:57.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:56 smithi178 bash[23441]: audit 2024-04-19T23:03:56.679371+0000 mon.a (mon.0) 3660 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:03:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: cluster 2024-04-19T23:03:56.258487+0000 mgr.y (mgr.24389) 717 : cluster 0 pgmap v1220: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: cluster 2024-04-19T23:03:56.688794+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: audit 2024-04-19T23:03:56.689970+0000 mon.c (mon.2) 950 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: audit 2024-04-19T23:03:56.693108+0000 mon.a (mon.0) 3662 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: audit 2024-04-19T23:03:57.681887+0000 mon.a (mon.0) 3663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]': finished 2024-04-19T23:03:57.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[28910]: cluster 2024-04-19T23:03:57.689230+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: cluster 2024-04-19T23:03:56.258487+0000 mgr.y (mgr.24389) 717 : cluster 0 pgmap v1220: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: cluster 2024-04-19T23:03:56.688794+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: audit 2024-04-19T23:03:56.689970+0000 mon.c (mon.2) 950 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: audit 2024-04-19T23:03:56.693108+0000 mon.a (mon.0) 3662 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: audit 2024-04-19T23:03:57.681887+0000 mon.a (mon.0) 3663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]': finished 2024-04-19T23:03:57.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:57 smithi113 bash[21528]: cluster 2024-04-19T23:03:57.689230+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-04-19T23:03:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: cluster 2024-04-19T23:03:56.258487+0000 mgr.y (mgr.24389) 717 : cluster 0 pgmap v1220: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:58.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: cluster 2024-04-19T23:03:56.688794+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-04-19T23:03:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: audit 2024-04-19T23:03:56.689970+0000 mon.c (mon.2) 950 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: audit 2024-04-19T23:03:56.693108+0000 mon.a (mon.0) 3662 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]: dispatch 2024-04-19T23:03:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: audit 2024-04-19T23:03:57.681887+0000 mon.a (mon.0) 3663 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-146","var": "target_max_objects","val": "1"}]': finished 2024-04-19T23:03:58.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:57 smithi178 bash[23441]: cluster 2024-04-19T23:03:57.689230+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-04-19T23:03:59.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:58 smithi113 bash[21528]: cluster 2024-04-19T23:03:58.259302+0000 mgr.y (mgr.24389) 718 : cluster 0 pgmap v1223: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:59.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:03:58 smithi113 bash[21528]: cluster 2024-04-19T23:03:58.698074+0000 mon.a (mon.0) 3665 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T23:03:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:58 smithi113 bash[28910]: cluster 2024-04-19T23:03:58.259302+0000 mgr.y (mgr.24389) 718 : cluster 0 pgmap v1223: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:59.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:03:58 smithi113 bash[28910]: cluster 2024-04-19T23:03:58.698074+0000 mon.a (mon.0) 3665 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T23:03:59.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:58 smithi178 bash[23441]: cluster 2024-04-19T23:03:58.259302+0000 mgr.y (mgr.24389) 718 : cluster 0 pgmap v1223: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:03:59.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:03:58 smithi178 bash[23441]: cluster 2024-04-19T23:03:58.698074+0000 mon.a (mon.0) 3665 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-04-19T23:04:01.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:01 smithi113 bash[21528]: cluster 2024-04-19T23:04:00.261417+0000 mgr.y (mgr.24389) 719 : cluster 0 pgmap v1224: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:04:01.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:01 smithi113 bash[28910]: cluster 2024-04-19T23:04:00.261417+0000 mgr.y (mgr.24389) 719 : cluster 0 pgmap v1224: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:04:01.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:01 smithi178 bash[23441]: cluster 2024-04-19T23:04:00.261417+0000 mgr.y (mgr.24389) 719 : cluster 0 pgmap v1224: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-19T23:04:03.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:03 smithi113 bash[21528]: cluster 2024-04-19T23:04:02.262293+0000 mgr.y (mgr.24389) 720 : cluster 0 pgmap v1225: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 777 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:03.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:03 smithi113 bash[28910]: cluster 2024-04-19T23:04:02.262293+0000 mgr.y (mgr.24389) 720 : cluster 0 pgmap v1225: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 777 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:03.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:03 smithi178 bash[23441]: cluster 2024-04-19T23:04:02.262293+0000 mgr.y (mgr.24389) 720 : cluster 0 pgmap v1225: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 777 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:05.601 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:05 smithi178 bash[23441]: cluster 2024-04-19T23:04:04.263081+0000 mgr.y (mgr.24389) 721 : cluster 0 pgmap v1226: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T23:04:05.601 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:05 smithi178 bash[23441]: audit 2024-04-19T23:04:05.096455+0000 mon.a (mon.0) 3666 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:04:05.601 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:05 smithi178 bash[23441]: audit 2024-04-19T23:04:05.124383+0000 mon.a (mon.0) 3667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:05.601 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:05 smithi178 bash[23441]: audit 2024-04-19T23:04:05.126721+0000 mon.a (mon.0) 3668 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:05.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[28910]: cluster 2024-04-19T23:04:04.263081+0000 mgr.y (mgr.24389) 721 : cluster 0 pgmap v1226: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[28910]: audit 2024-04-19T23:04:05.096455+0000 mon.a (mon.0) 3666 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[28910]: audit 2024-04-19T23:04:05.124383+0000 mon.a (mon.0) 3667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[28910]: audit 2024-04-19T23:04:05.126721+0000 mon.a (mon.0) 3668 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[21528]: cluster 2024-04-19T23:04:04.263081+0000 mgr.y (mgr.24389) 721 : cluster 0 pgmap v1226: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[21528]: audit 2024-04-19T23:04:05.096455+0000 mon.a (mon.0) 3666 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[21528]: audit 2024-04-19T23:04:05.124383+0000 mon.a (mon.0) 3667 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:05.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:05 smithi113 bash[21528]: audit 2024-04-19T23:04:05.126721+0000 mon.a (mon.0) 3668 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:06.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[21528]: audit 2024-04-19T23:04:05.600934+0000 mgr.y (mgr.24389) 722 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[21528]: audit 2024-04-19T23:04:05.888099+0000 mon.a (mon.0) 3669 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[21528]: audit 2024-04-19T23:04:05.889793+0000 mon.a (mon.0) 3670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[21528]: audit 2024-04-19T23:04:05.898576+0000 mon.a (mon.0) 3671 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[28910]: audit 2024-04-19T23:04:05.600934+0000 mgr.y (mgr.24389) 722 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[28910]: audit 2024-04-19T23:04:05.888099+0000 mon.a (mon.0) 3669 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[28910]: audit 2024-04-19T23:04:05.889793+0000 mon.a (mon.0) 3670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:04:06.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:06 smithi113 bash[28910]: audit 2024-04-19T23:04:05.898576+0000 mon.a (mon.0) 3671 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:06 smithi178 bash[23441]: audit 2024-04-19T23:04:05.600934+0000 mgr.y (mgr.24389) 722 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:06 smithi178 bash[23441]: audit 2024-04-19T23:04:05.888099+0000 mon.a (mon.0) 3669 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:04:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:06 smithi178 bash[23441]: audit 2024-04-19T23:04:05.889793+0000 mon.a (mon.0) 3670 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:04:06.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:06 smithi178 bash[23441]: audit 2024-04-19T23:04:05.898576+0000 mon.a (mon.0) 3671 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:07.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:07 smithi113 bash[21528]: cluster 2024-04-19T23:04:06.265142+0000 mgr.y (mgr.24389) 723 : cluster 0 pgmap v1227: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:07.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:07 smithi113 bash[28910]: cluster 2024-04-19T23:04:06.265142+0000 mgr.y (mgr.24389) 723 : cluster 0 pgmap v1227: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:07 smithi178 bash[23441]: cluster 2024-04-19T23:04:06.265142+0000 mgr.y (mgr.24389) 723 : cluster 0 pgmap v1227: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:08.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:08 smithi113 bash[21528]: audit 2024-04-19T23:04:07.719680+0000 mon.c (mon.2) 951 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:08.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:08 smithi113 bash[21528]: audit 2024-04-19T23:04:07.720440+0000 mon.a (mon.0) 3672 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:08.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:08 smithi113 bash[28910]: audit 2024-04-19T23:04:07.719680+0000 mon.c (mon.2) 951 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:08.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:08 smithi113 bash[28910]: audit 2024-04-19T23:04:07.720440+0000 mon.a (mon.0) 3672 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:08.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:08 smithi178 bash[23441]: audit 2024-04-19T23:04:07.719680+0000 mon.c (mon.2) 951 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:08.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:08 smithi178 bash[23441]: audit 2024-04-19T23:04:07.720440+0000 mon.a (mon.0) 3672 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[21528]: cluster 2024-04-19T23:04:08.266005+0000 mgr.y (mgr.24389) 724 : cluster 0 pgmap v1228: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 967 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[21528]: audit 2024-04-19T23:04:08.342283+0000 mon.a (mon.0) 3673 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[21528]: cluster 2024-04-19T23:04:08.349016+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[21528]: audit 2024-04-19T23:04:08.351212+0000 mon.c (mon.2) 952 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[21528]: audit 2024-04-19T23:04:08.352201+0000 mon.a (mon.0) 3675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:09.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[28910]: cluster 2024-04-19T23:04:08.266005+0000 mgr.y (mgr.24389) 724 : cluster 0 pgmap v1228: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 967 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:09.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[28910]: audit 2024-04-19T23:04:08.342283+0000 mon.a (mon.0) 3673 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:09.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[28910]: cluster 2024-04-19T23:04:08.349016+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-04-19T23:04:09.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[28910]: audit 2024-04-19T23:04:08.351212+0000 mon.c (mon.2) 952 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:09.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:09 smithi113 bash[28910]: audit 2024-04-19T23:04:08.352201+0000 mon.a (mon.0) 3675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:09 smithi178 bash[23441]: cluster 2024-04-19T23:04:08.266005+0000 mgr.y (mgr.24389) 724 : cluster 0 pgmap v1228: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 967 B/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:09 smithi178 bash[23441]: audit 2024-04-19T23:04:08.342283+0000 mon.a (mon.0) 3673 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:09 smithi178 bash[23441]: cluster 2024-04-19T23:04:08.349016+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-04-19T23:04:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:09 smithi178 bash[23441]: audit 2024-04-19T23:04:08.351212+0000 mon.c (mon.2) 952 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:09.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:09 smithi178 bash[23441]: audit 2024-04-19T23:04:08.352201+0000 mon.a (mon.0) 3675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: audit 2024-04-19T23:04:09.352946+0000 mon.a (mon.0) 3676 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: cluster 2024-04-19T23:04:09.360511+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: audit 2024-04-19T23:04:09.424699+0000 mon.c (mon.2) 953 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: audit 2024-04-19T23:04:09.425494+0000 mon.a (mon.0) 3678 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: audit 2024-04-19T23:04:09.426731+0000 mon.c (mon.2) 954 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[21528]: audit 2024-04-19T23:04:09.427397+0000 mon.a (mon.0) 3679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: audit 2024-04-19T23:04:09.352946+0000 mon.a (mon.0) 3676 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: cluster 2024-04-19T23:04:09.360511+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: audit 2024-04-19T23:04:09.424699+0000 mon.c (mon.2) 953 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: audit 2024-04-19T23:04:09.425494+0000 mon.a (mon.0) 3678 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: audit 2024-04-19T23:04:09.426731+0000 mon.c (mon.2) 954 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:10 smithi113 bash[28910]: audit 2024-04-19T23:04:09.427397+0000 mon.a (mon.0) 3679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: audit 2024-04-19T23:04:09.352946+0000 mon.a (mon.0) 3676 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]': finished 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: cluster 2024-04-19T23:04:09.360511+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: audit 2024-04-19T23:04:09.424699+0000 mon.c (mon.2) 953 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: audit 2024-04-19T23:04:09.425494+0000 mon.a (mon.0) 3678 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: audit 2024-04-19T23:04:09.426731+0000 mon.c (mon.2) 954 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:10.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:10 smithi178 bash[23441]: audit 2024-04-19T23:04:09.427397+0000 mon.a (mon.0) 3679 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-146"}]: dispatch 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[28910]: cluster 2024-04-19T23:04:10.268103+0000 mgr.y (mgr.24389) 725 : cluster 0 pgmap v1231: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[28910]: cluster 2024-04-19T23:04:10.353871+0000 mon.a (mon.0) 3680 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[28910]: cluster 2024-04-19T23:04:10.353926+0000 mon.a (mon.0) 3681 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[28910]: cluster 2024-04-19T23:04:10.367658+0000 mon.a (mon.0) 3682 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[21528]: cluster 2024-04-19T23:04:10.268103+0000 mgr.y (mgr.24389) 725 : cluster 0 pgmap v1231: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[21528]: cluster 2024-04-19T23:04:10.353871+0000 mon.a (mon.0) 3680 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[21528]: cluster 2024-04-19T23:04:10.353926+0000 mon.a (mon.0) 3681 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T23:04:11.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:11 smithi113 bash[21528]: cluster 2024-04-19T23:04:10.367658+0000 mon.a (mon.0) 3682 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-04-19T23:04:11.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:11 smithi178 bash[23441]: cluster 2024-04-19T23:04:10.268103+0000 mgr.y (mgr.24389) 725 : cluster 0 pgmap v1231: 204 pgs: 204 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-19T23:04:11.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:11 smithi178 bash[23441]: cluster 2024-04-19T23:04:10.353871+0000 mon.a (mon.0) 3680 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:11.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:11 smithi178 bash[23441]: cluster 2024-04-19T23:04:10.353926+0000 mon.a (mon.0) 3681 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-04-19T23:04:11.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:11 smithi178 bash[23441]: cluster 2024-04-19T23:04:10.367658+0000 mon.a (mon.0) 3682 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[21528]: cluster 2024-04-19T23:04:11.400208+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[21528]: audit 2024-04-19T23:04:11.405072+0000 mon.c (mon.2) 955 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[21528]: audit 2024-04-19T23:04:11.407641+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[28910]: cluster 2024-04-19T23:04:11.400208+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[28910]: audit 2024-04-19T23:04:11.405072+0000 mon.c (mon.2) 955 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:12.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:12 smithi113 bash[28910]: audit 2024-04-19T23:04:11.407641+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:12 smithi178 bash[23441]: cluster 2024-04-19T23:04:11.400208+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-04-19T23:04:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:12 smithi178 bash[23441]: audit 2024-04-19T23:04:11.405072+0000 mon.c (mon.2) 955 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:12.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:12 smithi178 bash[23441]: audit 2024-04-19T23:04:11.407641+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[28910]: cluster 2024-04-19T23:04:12.268887+0000 mgr.y (mgr.24389) 726 : cluster 0 pgmap v1234: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[28910]: audit 2024-04-19T23:04:12.400350+0000 mon.a (mon.0) 3685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[28910]: cluster 2024-04-19T23:04:12.411888+0000 mon.a (mon.0) 3686 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[28910]: audit 2024-04-19T23:04:12.465228+0000 mon.c (mon.2) 956 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[28910]: audit 2024-04-19T23:04:12.465809+0000 mon.a (mon.0) 3687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[21528]: cluster 2024-04-19T23:04:12.268887+0000 mgr.y (mgr.24389) 726 : cluster 0 pgmap v1234: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-19T23:04:13.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[21528]: audit 2024-04-19T23:04:12.400350+0000 mon.a (mon.0) 3685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[21528]: cluster 2024-04-19T23:04:12.411888+0000 mon.a (mon.0) 3686 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-04-19T23:04:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[21528]: audit 2024-04-19T23:04:12.465228+0000 mon.c (mon.2) 956 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:13.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:13 smithi113 bash[21528]: audit 2024-04-19T23:04:12.465809+0000 mon.a (mon.0) 3687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:13.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:13 smithi178 bash[23441]: cluster 2024-04-19T23:04:12.268887+0000 mgr.y (mgr.24389) 726 : cluster 0 pgmap v1234: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-04-19T23:04:13.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:13 smithi178 bash[23441]: audit 2024-04-19T23:04:12.400350+0000 mon.a (mon.0) 3685 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:13.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:13 smithi178 bash[23441]: cluster 2024-04-19T23:04:12.411888+0000 mon.a (mon.0) 3686 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-04-19T23:04:13.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:13 smithi178 bash[23441]: audit 2024-04-19T23:04:12.465228+0000 mon.c (mon.2) 956 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:13.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:13 smithi178 bash[23441]: audit 2024-04-19T23:04:12.465809+0000 mon.a (mon.0) 3687 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-04-19T23:04:14.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[28910]: audit 2024-04-19T23:04:13.413754+0000 mon.a (mon.0) 3688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[28910]: cluster 2024-04-19T23:04:13.420899+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[28910]: audit 2024-04-19T23:04:13.435579+0000 mon.c (mon.2) 957 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[28910]: audit 2024-04-19T23:04:13.436550+0000 mon.a (mon.0) 3690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[21528]: audit 2024-04-19T23:04:13.413754+0000 mon.a (mon.0) 3688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[21528]: cluster 2024-04-19T23:04:13.420899+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[21528]: audit 2024-04-19T23:04:13.435579+0000 mon.c (mon.2) 957 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:14.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:14 smithi113 bash[21528]: audit 2024-04-19T23:04:13.436550+0000 mon.a (mon.0) 3690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:14 smithi178 bash[23441]: audit 2024-04-19T23:04:13.413754+0000 mon.a (mon.0) 3688 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148", "force_nonempty": "--force-nonempty" }]': finished 2024-04-19T23:04:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:14 smithi178 bash[23441]: cluster 2024-04-19T23:04:13.420899+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-04-19T23:04:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:14 smithi178 bash[23441]: audit 2024-04-19T23:04:13.435579+0000 mon.c (mon.2) 957 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:14.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:14 smithi178 bash[23441]: audit 2024-04-19T23:04:13.436550+0000 mon.a (mon.0) 3690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: cluster 2024-04-19T23:04:14.269772+0000 mgr.y (mgr.24389) 727 : cluster 0 pgmap v1237: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: audit 2024-04-19T23:04:14.424073+0000 mon.a (mon.0) 3691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]': finished 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: cluster 2024-04-19T23:04:14.434187+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: audit 2024-04-19T23:04:14.501673+0000 mon.c (mon.2) 958 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: audit 2024-04-19T23:04:14.502520+0000 mon.a (mon.0) 3693 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: audit 2024-04-19T23:04:14.503802+0000 mon.c (mon.2) 959 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[28910]: audit 2024-04-19T23:04:14.504538+0000 mon.a (mon.0) 3694 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: cluster 2024-04-19T23:04:14.269772+0000 mgr.y (mgr.24389) 727 : cluster 0 pgmap v1237: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: audit 2024-04-19T23:04:14.424073+0000 mon.a (mon.0) 3691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]': finished 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: cluster 2024-04-19T23:04:14.434187+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: audit 2024-04-19T23:04:14.501673+0000 mon.c (mon.2) 958 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: audit 2024-04-19T23:04:14.502520+0000 mon.a (mon.0) 3693 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: audit 2024-04-19T23:04:14.503802+0000 mon.c (mon.2) 959 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:15 smithi113 bash[21528]: audit 2024-04-19T23:04:14.504538+0000 mon.a (mon.0) 3694 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.805 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: cluster 2024-04-19T23:04:14.269772+0000 mgr.y (mgr.24389) 727 : cluster 0 pgmap v1237: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: audit 2024-04-19T23:04:14.424073+0000 mon.a (mon.0) 3691 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]': finished 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: cluster 2024-04-19T23:04:14.434187+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: audit 2024-04-19T23:04:14.501673+0000 mon.c (mon.2) 958 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: audit 2024-04-19T23:04:14.502520+0000 mon.a (mon.0) 3693 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: audit 2024-04-19T23:04:14.503802+0000 mon.c (mon.2) 959 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:15.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:15 smithi178 bash[23441]: audit 2024-04-19T23:04:14.504538+0000 mon.a (mon.0) 3694 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-148"}]: dispatch 2024-04-19T23:04:16.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:16 smithi113 bash[28910]: cluster 2024-04-19T23:04:15.434196+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-04-19T23:04:16.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:16 smithi113 bash[28910]: audit 2024-04-19T23:04:15.612095+0000 mgr.y (mgr.24389) 728 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:16.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:16 smithi113 bash[21528]: cluster 2024-04-19T23:04:15.434196+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-04-19T23:04:16.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:16 smithi113 bash[21528]: audit 2024-04-19T23:04:15.612095+0000 mgr.y (mgr.24389) 728 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:16 smithi178 bash[23441]: cluster 2024-04-19T23:04:15.434196+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-04-19T23:04:16.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:16 smithi178 bash[23441]: audit 2024-04-19T23:04:15.612095+0000 mgr.y (mgr.24389) 728 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:17.799 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:17.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21528]: cluster 2024-04-19T23:04:16.270592+0000 mgr.y (mgr.24389) 729 : cluster 0 pgmap v1240: 172 pgs: 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:17.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21528]: cluster 2024-04-19T23:04:16.460962+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-04-19T23:04:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21528]: audit 2024-04-19T23:04:16.463554+0000 mon.c (mon.2) 960 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21528]: audit 2024-04-19T23:04:16.466492+0000 mon.a (mon.0) 3697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[21528]: cluster 2024-04-19T23:04:16.481039+0000 mon.a (mon.0) 3698 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[28910]: cluster 2024-04-19T23:04:16.270592+0000 mgr.y (mgr.24389) 729 : cluster 0 pgmap v1240: 172 pgs: 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:17.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[28910]: cluster 2024-04-19T23:04:16.460962+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-04-19T23:04:17.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[28910]: audit 2024-04-19T23:04:16.463554+0000 mon.c (mon.2) 960 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[28910]: audit 2024-04-19T23:04:16.466492+0000 mon.a (mon.0) 3697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.801 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:17 smithi113 bash[28910]: cluster 2024-04-19T23:04:16.481039+0000 mon.a (mon.0) 3698 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:17 smithi178 bash[23441]: cluster 2024-04-19T23:04:16.270592+0000 mgr.y (mgr.24389) 729 : cluster 0 pgmap v1240: 172 pgs: 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:17 smithi178 bash[23441]: cluster 2024-04-19T23:04:16.460962+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-04-19T23:04:17.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:17 smithi178 bash[23441]: audit 2024-04-19T23:04:16.463554+0000 mon.c (mon.2) 960 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:17 smithi178 bash[23441]: audit 2024-04-19T23:04:16.466492+0000 mon.a (mon.0) 3697 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:17.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:17 smithi178 bash[23441]: cluster 2024-04-19T23:04:16.481039+0000 mon.a (mon.0) 3698 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: audit 2024-04-19T23:04:17.453795+0000 mon.a (mon.0) 3699 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: cluster 2024-04-19T23:04:17.461737+0000 mon.a (mon.0) 3700 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: audit 2024-04-19T23:04:17.550883+0000 mon.c (mon.2) 961 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: audit 2024-04-19T23:04:17.551527+0000 mon.a (mon.0) 3701 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: audit 2024-04-19T23:04:17.552443+0000 mon.c (mon.2) 962 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[21528]: audit 2024-04-19T23:04:17.552866+0000 mon.a (mon.0) 3702 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: audit 2024-04-19T23:04:17.453795+0000 mon.a (mon.0) 3699 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: cluster 2024-04-19T23:04:17.461737+0000 mon.a (mon.0) 3700 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: audit 2024-04-19T23:04:17.550883+0000 mon.c (mon.2) 961 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: audit 2024-04-19T23:04:17.551527+0000 mon.a (mon.0) 3701 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: audit 2024-04-19T23:04:17.552443+0000 mon.c (mon.2) 962 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:18.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:18 smithi113 bash[28910]: audit 2024-04-19T23:04:17.552866+0000 mon.a (mon.0) 3702 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: audit 2024-04-19T23:04:17.453795+0000 mon.a (mon.0) 3699 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: cluster 2024-04-19T23:04:17.461737+0000 mon.a (mon.0) 3700 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: audit 2024-04-19T23:04:17.550883+0000 mon.c (mon.2) 961 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: audit 2024-04-19T23:04:17.551527+0000 mon.a (mon.0) 3701 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: audit 2024-04-19T23:04:17.552443+0000 mon.c (mon.2) 962 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:18.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:18 smithi178 bash[23441]: audit 2024-04-19T23:04:17.552866+0000 mon.a (mon.0) 3702 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-150"}]: dispatch 2024-04-19T23:04:19.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:19 smithi113 bash[28910]: cluster 2024-04-19T23:04:18.271390+0000 mgr.y (mgr.24389) 730 : cluster 0 pgmap v1243: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:19.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:19 smithi113 bash[28910]: cluster 2024-04-19T23:04:18.488528+0000 mon.a (mon.0) 3703 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-04-19T23:04:19.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:19 smithi113 bash[21528]: cluster 2024-04-19T23:04:18.271390+0000 mgr.y (mgr.24389) 730 : cluster 0 pgmap v1243: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:19.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:19 smithi113 bash[21528]: cluster 2024-04-19T23:04:18.488528+0000 mon.a (mon.0) 3703 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-04-19T23:04:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:19 smithi178 bash[23441]: cluster 2024-04-19T23:04:18.271390+0000 mgr.y (mgr.24389) 730 : cluster 0 pgmap v1243: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-04-19T23:04:19.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:19 smithi178 bash[23441]: cluster 2024-04-19T23:04:18.488528+0000 mon.a (mon.0) 3703 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[21528]: cluster 2024-04-19T23:04:19.500123+0000 mon.a (mon.0) 3704 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[21528]: audit 2024-04-19T23:04:19.506563+0000 mon.c (mon.2) 963 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[21528]: audit 2024-04-19T23:04:19.507838+0000 mon.a (mon.0) 3705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[21528]: audit 2024-04-19T23:04:20.175858+0000 mon.a (mon.0) 3706 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[21528]: audit 2024-04-19T23:04:20.178198+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[28910]: cluster 2024-04-19T23:04:19.500123+0000 mon.a (mon.0) 3704 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[28910]: audit 2024-04-19T23:04:19.506563+0000 mon.c (mon.2) 963 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[28910]: audit 2024-04-19T23:04:19.507838+0000 mon.a (mon.0) 3705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[28910]: audit 2024-04-19T23:04:20.175858+0000 mon.a (mon.0) 3706 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:20.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:20 smithi113 bash[28910]: audit 2024-04-19T23:04:20.178198+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:20 smithi178 bash[23441]: cluster 2024-04-19T23:04:19.500123+0000 mon.a (mon.0) 3704 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-04-19T23:04:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:20 smithi178 bash[23441]: audit 2024-04-19T23:04:19.506563+0000 mon.c (mon.2) 963 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:20 smithi178 bash[23441]: audit 2024-04-19T23:04:19.507838+0000 mon.a (mon.0) 3705 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:20 smithi178 bash[23441]: audit 2024-04-19T23:04:20.175858+0000 mon.a (mon.0) 3706 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:20.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:20 smithi178 bash[23441]: audit 2024-04-19T23:04:20.178198+0000 mon.a (mon.0) 3707 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: cluster 2024-04-19T23:04:20.273429+0000 mgr.y (mgr.24389) 731 : cluster 0 pgmap v1246: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: audit 2024-04-19T23:04:20.496331+0000 mon.a (mon.0) 3708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: cluster 2024-04-19T23:04:20.504588+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: audit 2024-04-19T23:04:20.592824+0000 mon.c (mon.2) 964 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: audit 2024-04-19T23:04:20.593425+0000 mon.a (mon.0) 3710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: audit 2024-04-19T23:04:20.594462+0000 mon.c (mon.2) 965 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: audit 2024-04-19T23:04:20.595110+0000 mon.a (mon.0) 3711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[21528]: cluster 2024-04-19T23:04:21.482946+0000 mon.a (mon.0) 3712 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: cluster 2024-04-19T23:04:20.273429+0000 mgr.y (mgr.24389) 731 : cluster 0 pgmap v1246: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: audit 2024-04-19T23:04:20.496331+0000 mon.a (mon.0) 3708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: cluster 2024-04-19T23:04:20.504588+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: audit 2024-04-19T23:04:20.592824+0000 mon.c (mon.2) 964 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: audit 2024-04-19T23:04:20.593425+0000 mon.a (mon.0) 3710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: audit 2024-04-19T23:04:20.594462+0000 mon.c (mon.2) 965 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: audit 2024-04-19T23:04:20.595110+0000 mon.a (mon.0) 3711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:21 smithi113 bash[28910]: cluster 2024-04-19T23:04:21.482946+0000 mon.a (mon.0) 3712 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: cluster 2024-04-19T23:04:20.273429+0000 mgr.y (mgr.24389) 731 : cluster 0 pgmap v1246: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: audit 2024-04-19T23:04:20.496331+0000 mon.a (mon.0) 3708 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: cluster 2024-04-19T23:04:20.504588+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: audit 2024-04-19T23:04:20.592824+0000 mon.c (mon.2) 964 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: audit 2024-04-19T23:04:20.593425+0000 mon.a (mon.0) 3710 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: audit 2024-04-19T23:04:20.594462+0000 mon.c (mon.2) 965 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: audit 2024-04-19T23:04:20.595110+0000 mon.a (mon.0) 3711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-152"}]: dispatch 2024-04-19T23:04:21.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:21 smithi178 bash[23441]: cluster 2024-04-19T23:04:21.482946+0000 mon.a (mon.0) 3712 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:22.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:22 smithi113 bash[28910]: cluster 2024-04-19T23:04:21.535940+0000 mon.a (mon.0) 3713 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-04-19T23:04:22.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:22 smithi113 bash[21528]: cluster 2024-04-19T23:04:21.535940+0000 mon.a (mon.0) 3713 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-04-19T23:04:22.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:22 smithi178 bash[23441]: cluster 2024-04-19T23:04:21.535940+0000 mon.a (mon.0) 3713 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-04-19T23:04:23.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[21528]: cluster 2024-04-19T23:04:22.274340+0000 mgr.y (mgr.24389) 732 : cluster 0 pgmap v1249: 172 pgs: 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[21528]: cluster 2024-04-19T23:04:22.551829+0000 mon.a (mon.0) 3714 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-04-19T23:04:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[21528]: audit 2024-04-19T23:04:22.555874+0000 mon.c (mon.2) 966 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:23.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[21528]: audit 2024-04-19T23:04:22.557154+0000 mon.a (mon.0) 3715 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[28910]: cluster 2024-04-19T23:04:22.274340+0000 mgr.y (mgr.24389) 732 : cluster 0 pgmap v1249: 172 pgs: 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:23.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[28910]: cluster 2024-04-19T23:04:22.551829+0000 mon.a (mon.0) 3714 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-04-19T23:04:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[28910]: audit 2024-04-19T23:04:22.555874+0000 mon.c (mon.2) 966 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:23.800 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:23 smithi113 bash[28910]: audit 2024-04-19T23:04:22.557154+0000 mon.a (mon.0) 3715 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:23 smithi178 bash[23441]: cluster 2024-04-19T23:04:22.274340+0000 mgr.y (mgr.24389) 732 : cluster 0 pgmap v1249: 172 pgs: 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-19T23:04:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:23 smithi178 bash[23441]: cluster 2024-04-19T23:04:22.551829+0000 mon.a (mon.0) 3714 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-04-19T23:04:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:23 smithi178 bash[23441]: audit 2024-04-19T23:04:22.555874+0000 mon.c (mon.2) 966 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:23.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:23 smithi178 bash[23441]: audit 2024-04-19T23:04:22.557154+0000 mon.a (mon.0) 3715 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.557400+0000 mon.a (mon.0) 3716 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: cluster 2024-04-19T23:04:23.566289+0000 mon.a (mon.0) 3717 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.571666+0000 mon.c (mon.2) 967 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.572960+0000 mon.a (mon.0) 3718 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.632116+0000 mon.c (mon.2) 968 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.632612+0000 mon.a (mon.0) 3719 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.633550+0000 mon.c (mon.2) 969 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[28910]: audit 2024-04-19T23:04:23.634010+0000 mon.a (mon.0) 3720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.557400+0000 mon.a (mon.0) 3716 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: cluster 2024-04-19T23:04:23.566289+0000 mon.a (mon.0) 3717 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.571666+0000 mon.c (mon.2) 967 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.572960+0000 mon.a (mon.0) 3718 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.632116+0000 mon.c (mon.2) 968 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.632612+0000 mon.a (mon.0) 3719 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.633550+0000 mon.c (mon.2) 969 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.050 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:24 smithi113 bash[21528]: audit 2024-04-19T23:04:23.634010+0000 mon.a (mon.0) 3720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.557400+0000 mon.a (mon.0) 3716 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi113-63998-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: cluster 2024-04-19T23:04:23.566289+0000 mon.a (mon.0) 3717 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.571666+0000 mon.c (mon.2) 967 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.572960+0000 mon.a (mon.0) 3718 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi113-63998-111","var": "dedup_tier","val": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.632116+0000 mon.c (mon.2) 968 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.632612+0000 mon.a (mon.0) 3719 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:25.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.633550+0000 mon.c (mon.2) 969 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:25.056 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:24 smithi178 bash[23441]: audit 2024-04-19T23:04:23.634010+0000 mon.a (mon.0) 3720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi113-63998-111", "tierpool": "test-rados-api-smithi113-63998-154"}]: dispatch 2024-04-19T23:04:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:25 smithi113 bash[28910]: cluster 2024-04-19T23:04:24.275193+0000 mgr.y (mgr.24389) 733 : cluster 0 pgmap v1252: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:26.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:25 smithi113 bash[28910]: cluster 2024-04-19T23:04:24.579360+0000 mon.a (mon.0) 3721 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-04-19T23:04:26.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:25 smithi113 bash[21528]: cluster 2024-04-19T23:04:24.275193+0000 mgr.y (mgr.24389) 733 : cluster 0 pgmap v1252: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:26.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:25 smithi113 bash[21528]: cluster 2024-04-19T23:04:24.579360+0000 mon.a (mon.0) 3721 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-04-19T23:04:26.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:25 smithi178 bash[23441]: cluster 2024-04-19T23:04:24.275193+0000 mgr.y (mgr.24389) 733 : cluster 0 pgmap v1252: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 734 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:26.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:25 smithi178 bash[23441]: cluster 2024-04-19T23:04:24.579360+0000 mon.a (mon.0) 3721 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-04-19T23:04:27.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[21528]: cluster 2024-04-19T23:04:25.578915+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[21528]: audit 2024-04-19T23:04:25.581371+0000 mon.c (mon.2) 970 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[21528]: audit 2024-04-19T23:04:25.592336+0000 mon.a (mon.0) 3723 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[21528]: audit 2024-04-19T23:04:25.618992+0000 mgr.y (mgr.24389) 734 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[21528]: cluster 2024-04-19T23:04:26.484389+0000 mon.a (mon.0) 3724 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[28910]: cluster 2024-04-19T23:04:25.578915+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[28910]: audit 2024-04-19T23:04:25.581371+0000 mon.c (mon.2) 970 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[28910]: audit 2024-04-19T23:04:25.592336+0000 mon.a (mon.0) 3723 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[28910]: audit 2024-04-19T23:04:25.618992+0000 mgr.y (mgr.24389) 734 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:27.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:26 smithi113 bash[28910]: cluster 2024-04-19T23:04:26.484389+0000 mon.a (mon.0) 3724 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:26 smithi178 bash[23441]: cluster 2024-04-19T23:04:25.578915+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-04-19T23:04:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:26 smithi178 bash[23441]: audit 2024-04-19T23:04:25.581371+0000 mon.c (mon.2) 970 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:26 smithi178 bash[23441]: audit 2024-04-19T23:04:25.592336+0000 mon.a (mon.0) 3723 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:26 smithi178 bash[23441]: audit 2024-04-19T23:04:25.618992+0000 mgr.y (mgr.24389) 734 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:27.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:26 smithi178 bash[23441]: cluster 2024-04-19T23:04:26.484389+0000 mon.a (mon.0) 3724 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7716 ms) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13124 ms) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8085 ms) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13159 ms) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7711 ms) 2024-04-19T23:04:27.619 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8069 ms) 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: ok, hit_set contains 337:602f83fe:::foo:head 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9081 ms) 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: first is 1713567782 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,0 2024-04-19T23:04:27.620 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,1713567790,1713567791,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,1713567790,1713567791,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567782,1713567784,1713567785,1713567787,1713567788,1713567790,1713567791,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: got ls 1713567785,1713567787,1713567788,1713567790,1713567791,1713567793,1713567794,0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: first now 1713567785, trimmed 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20636 ms) 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: foo0 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14158 ms) 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18116 ms) 2024-04-19T23:04:27.621 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22773 ms) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5061 ms) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3054 ms) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3046 ms) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3044 ms) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232616 ms total) 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-04-19T23:04:27.622 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (898237 ms total) 2024-04-19T23:04:27.623 INFO:tasks.workunit.client.0.smithi113.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-04-19T23:04:27.625 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.625 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63860 2024-04-19T23:04:27.625 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63860 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64035 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64035 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64347 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64347 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64178 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64178 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64105 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64105 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.626 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63967 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63967 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64151 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64151 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64501 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64501 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64547 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64547 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63984 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63984 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64365 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64365 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64315 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64315 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63844 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63844 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63876 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63876 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64323 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64323 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63836 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63836 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63852 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63852 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64652 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64652 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64056 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64056 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64671 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64671 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.629 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64120 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64120 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64437 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64437 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64718 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64718 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64068 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64068 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64331 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64331 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.630 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64647 2024-04-19T23:04:27.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64647 2024-04-19T23:04:27.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64414 2024-04-19T23:04:27.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64414 2024-04-19T23:04:27.631 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64663 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64663 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64298 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64298 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64019 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64019 2024-04-19T23:04:27.633 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64685 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64685 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64190 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64190 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63828 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63828 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63868 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63868 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.634 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64160 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64160 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=63947 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 63947 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64230 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64230 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64282 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64282 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64604 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64604 2024-04-19T23:04:27.635 INFO:tasks.workunit.client.0.smithi113.stderr:+ for t in "${!pids[@]}" 2024-04-19T23:04:27.636 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=64738 2024-04-19T23:04:27.636 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 64738 2024-04-19T23:04:27.636 INFO:tasks.workunit.client.0.smithi113.stderr:+ exit 0 2024-04-19T23:04:27.636 INFO:tasks.workunit.client.0.smithi113.stderr:+ cleanup 2024-04-19T23:04:27.636 INFO:tasks.workunit.client.0.smithi113.stderr:+ pkill -P 63822 2024-04-19T23:04:27.730 INFO:tasks.workunit.client.0.smithi113.stderr:+ true 2024-04-19T23:04:27.731 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-19T23:04:27.731 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T23:04:27.742 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21528]: cluster 2024-04-19T23:04:26.276041+0000 mgr.y (mgr.24389) 735 : cluster 0 pgmap v1255: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:27.742 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21528]: audit 2024-04-19T23:04:26.591692+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:27.742 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21528]: cluster 2024-04-19T23:04:26.597625+0000 mon.a (mon.0) 3726 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-04-19T23:04:27.742 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21528]: audit 2024-04-19T23:04:26.598729+0000 mon.c (mon.2) 971 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.742 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21528]: audit 2024-04-19T23:04:26.603821+0000 mon.a (mon.0) 3727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.743 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:27.743 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[28910]: cluster 2024-04-19T23:04:26.276041+0000 mgr.y (mgr.24389) 735 : cluster 0 pgmap v1255: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:27.743 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[28910]: audit 2024-04-19T23:04:26.591692+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:27.743 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[28910]: cluster 2024-04-19T23:04:26.597625+0000 mon.a (mon.0) 3726 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-04-19T23:04:27.744 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[28910]: audit 2024-04-19T23:04:26.598729+0000 mon.c (mon.2) 971 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.744 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:27 smithi113 bash[28910]: audit 2024-04-19T23:04:26.603821+0000 mon.a (mon.0) 3727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:27.746 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-04-19T23:04:27.747 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-04-19T23:04:27.747 DEBUG:teuthology.orchestra.run.smithi113:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e02d68a84525e0fa855f080a47dd96b350c21c42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-04-19T23:04:27.798 INFO:tasks.workunit.client.0.smithi113.stderr:+ uuidgen 2024-04-19T23:04:27.799 INFO:tasks.workunit.client.0.smithi113.stderr:+ p=46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:04:27.799 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool create 46f4c55d-95df-4d19-ae41-b63f718ffdb6 12 2024-04-19T23:04:27.923 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/3330702219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c10d0b0 msgr2=0x7f7f0c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:27.923 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- 172.21.15.113:0/3330702219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c10d0b0 0x7f7f0c114c30 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009cb0 tx=0x7f7f0401cca0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.923 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/3330702219 shutdown_connections 2024-04-19T23:04:27.923 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- 172.21.15.113:0/3330702219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c10d0b0 0x7f7f0c114c30 unknown :-1 s=CLOSED pgs=3245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.923 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- 172.21.15.113:0/3330702219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f0c108940 0x7f7f0c10c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- 172.21.15.113:0/3330702219 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c107f90 0x7f7f0c108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/3330702219 >> 172.21.15.113:0/3330702219 conn(0x7f7f0c0775a0 msgr2=0x7f7f0c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/3330702219 shutdown_connections 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/3330702219 wait complete. 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 Processor -- start 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- start start 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 0x7f7f0c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f0c108940 0x7f7f0c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c119f50 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c119dd0 con 0x7f7f0c108940 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0c11a0d0 con 0x7f7f0c107f90 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:27.924 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 0x7f7f0c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43246/0 (socket says 172.21.15.113:43246) 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 -- 172.21.15.113:0/1000738110 learned_addr learned my addr 172.21.15.113:0/1000738110 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 -- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 msgr2=0x7f7f0c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 0x7f7f0c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 -- 172.21.15.113:0/1000738110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f0c108940 msgr2=0x7f7f0c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f0c108940 0x7f7f0c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1a53c0 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0b7fe640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 0x7f7f0c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f0bfff640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f7f04005cd0 tx=0x7f7f040045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f040b2040 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1a5650 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f7f040047a0 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f040b6710 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.925 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1acf90 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.926 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c068ab0 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.926 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.922+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f7f04004a50 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.926 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.926+0000 7f7f08ff9640 1 --2- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 0x7f7ef40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:27.926 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.926+0000 7f7f0b7fe640 1 --2- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 0x7f7ef40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:27.927 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.926+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(778..778 src has 276..778) ==== 7268+0+0 (secure 0 0 0) 0x7f7f04128ba0 con 0x7f7f0c10d0b0 2024-04-19T23:04:27.927 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.926+0000 7f7f0b7fe640 1 --2- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 0x7f7ef40704e0 secure :-1 s=READY pgs=3118 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009600 tx=0x7f7efc0091e0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:27.930 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:27.930+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7f040169b0 con 0x7f7f0c10d0b0 2024-04-19T23:04:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:27 smithi178 bash[23441]: cluster 2024-04-19T23:04:26.276041+0000 mgr.y (mgr.24389) 735 : cluster 0 pgmap v1255: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:27 smithi178 bash[23441]: audit 2024-04-19T23:04:26.591692+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:27 smithi178 bash[23441]: cluster 2024-04-19T23:04:26.597625+0000 mon.a (mon.0) 3726 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-04-19T23:04:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:27 smithi178 bash[23441]: audit 2024-04-19T23:04:26.598729+0000 mon.c (mon.2) 971 : audit 1 from='client.? 172.21.15.113:0/1578845095' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:28.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:27 smithi178 bash[23441]: audit 2024-04-19T23:04:26.603821+0000 mon.a (mon.0) 3727 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]: dispatch 2024-04-19T23:04:28.103 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.102+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12} v 0) -- 0x7f7f0c1ad160 con 0x7f7f0c10d0b0 2024-04-19T23:04:28.623 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.622+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]=0 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' created v779) ==== 176+0+0 (secure 0 0 0) 0x7f7f040f6030 con 0x7f7f0c10d0b0 2024-04-19T23:04:28.728 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.726+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12} v 0) -- 0x7f7f0c061d90 con 0x7f7f0c10d0b0 2024-04-19T23:04:28.729 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f08ff9640 1 -- 172.21.15.113:0/1000738110 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]=0 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' already exists v779) ==== 183+0+0 (secure 0 0 0) 0x7f7f040f9ce0 con 0x7f7f0c10d0b0 2024-04-19T23:04:28.729 INFO:tasks.workunit.client.0.smithi113.stderr:pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' already exists 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 msgr2=0x7f7ef40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 0x7f7ef40704e0 secure :-1 s=READY pgs=3118 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009600 tx=0x7f7efc0091e0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 msgr2=0x7f7f0c1a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f7f04005cd0 tx=0x7f7f040045b0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 shutdown_connections 2024-04-19T23:04:28.732 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> v2:172.21.15.113:6800/3719359025 conn(0x7f7ef406e020 0x7f7ef40704e0 unknown :-1 s=CLOSED pgs=3118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7f0c10d0b0 0x7f7f0c1a4ce0 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f0c108940 0x7f7f0c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 --2- 172.21.15.113:0/1000738110 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7f0c107f90 0x7f7f0c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 >> 172.21.15.113:0/1000738110 conn(0x7f7f0c0775a0 msgr2=0x7f7f0c077980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.730+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 shutdown_connections 2024-04-19T23:04:28.733 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.734+0000 7f7f11c99640 1 -- 172.21.15.113:0/1000738110 wait complete. 2024-04-19T23:04:28.747 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_objects 10 2024-04-19T23:04:28.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/2188369767 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a741078c0 msgr2=0x7f5a74107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:28.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/2188369767 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a741078c0 0x7f5a74107ca0 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009ce0 tx=0x7f5a6c01cc80 comp rx=0 tx=0).stop 2024-04-19T23:04:28.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/2188369767 shutdown_connections 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/2188369767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7406a820 0x7f5a7410e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/2188369767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a74069e80 0x7f5a7406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/2188369767 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a741078c0 0x7f5a74107ca0 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/2188369767 >> 172.21.15.113:0/2188369767 conn(0x7f5a74077500 msgr2=0x7f5a74077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/2188369767 shutdown_connections 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/2188369767 wait complete. 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 Processor -- start 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- start start 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a7406a820 0x7f5a7419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a741078c0 0x7f5a7419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74113990 con 0x7f5a7406a820 2024-04-19T23:04:28.868 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74113810 con 0x7f5a741078c0 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74113b10 con 0x7f5a74069e80 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a71d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a7406a820 0x7f5a7419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:45200/0 (socket says 172.21.15.113:45200) 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 -- 172.21.15.113:0/1308008307 learned_addr learned my addr 172.21.15.113:0/1308008307 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 -- 172.21.15.113:0/1308008307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a741078c0 msgr2=0x7f5a7419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a741078c0 0x7f5a7419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 -- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a7406a820 msgr2=0x7f5a7419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a7406a820 0x7f5a7419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7419ee40 con 0x7f5a74069e80 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a7259c640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c01d160 tx=0x7f5a6c0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0b2040 con 0x7f5a74069e80 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f5a6c0047d0 con 0x7f5a74069e80 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7419f0d0 con 0x7f5a74069e80 2024-04-19T23:04:28.869 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0058e0 con 0x7f5a74069e80 2024-04-19T23:04:28.870 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a741a6a10 con 0x7f5a74069e80 2024-04-19T23:04:28.870 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.866+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a74102e30 con 0x7f5a74069e80 2024-04-19T23:04:28.871 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.870+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f5a6c004a50 con 0x7f5a74069e80 2024-04-19T23:04:28.871 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.870+0000 7f5a6b7fe640 1 --2- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 0x7f5a600704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:28.871 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.870+0000 7f5a71d9b640 1 --2- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 0x7f5a600704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:28.871 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.870+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(779..779 src has 276..779) ==== 7643+0+0 (secure 0 0 0) 0x7f5a6c128770 con 0x7f5a74069e80 2024-04-19T23:04:28.871 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.870+0000 7f5a71d9b640 1 --2- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 0x7f5a600704e0 secure :-1 s=READY pgs=3119 cs=0 l=1 rev1=1 crypto rx=0x7f5a74069310 tx=0x7f5a5c00b410 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:28.874 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:28.874+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5a6c016990 con 0x7f5a74069e80 2024-04-19T23:04:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[21528]: audit 2024-04-19T23:04:27.594774+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[21528]: cluster 2024-04-19T23:04:27.602706+0000 mon.a (mon.0) 3729 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-04-19T23:04:29.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[21528]: audit 2024-04-19T23:04:28.105513+0000 mon.a (mon.0) 3730 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:29.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[28910]: audit 2024-04-19T23:04:27.594774+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:29.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[28910]: cluster 2024-04-19T23:04:27.602706+0000 mon.a (mon.0) 3729 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-04-19T23:04:29.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:28 smithi113 bash[28910]: audit 2024-04-19T23:04:28.105513+0000 mon.a (mon.0) 3730 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:29.049 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:29.046+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"} v 0) -- 0x7f5a74068ab0 con 0x7f5a74069e80 2024-04-19T23:04:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:28 smithi178 bash[23441]: audit 2024-04-19T23:04:27.594774+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi113-63998-111"}]': finished 2024-04-19T23:04:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:28 smithi178 bash[23441]: cluster 2024-04-19T23:04:27.602706+0000 mon.a (mon.0) 3729 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-04-19T23:04:29.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:28 smithi178 bash[23441]: audit 2024-04-19T23:04:28.105513+0000 mon.a (mon.0) 3730 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:29.645 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:29.642+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v780) ==== 223+0+0 (secure 0 0 0) 0x7f5a6c0f5a90 con 0x7f5a74069e80 2024-04-19T23:04:29.756 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:29.754+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"} v 0) -- 0x7f5a74061dd0 con 0x7f5a74069e80 2024-04-19T23:04:30.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: cluster 2024-04-19T23:04:28.276787+0000 mgr.y (mgr.24389) 736 : cluster 0 pgmap v1258: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:30.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: audit 2024-04-19T23:04:28.624502+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]': finished 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: cluster 2024-04-19T23:04:28.630093+0000 mon.a (mon.0) 3732 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: audit 2024-04-19T23:04:28.730511+0000 mon.a (mon.0) 3733 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: audit 2024-04-19T23:04:29.050784+0000 mon.c (mon.2) 972 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[21528]: audit 2024-04-19T23:04:29.051255+0000 mon.a (mon.0) 3734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: cluster 2024-04-19T23:04:28.276787+0000 mgr.y (mgr.24389) 736 : cluster 0 pgmap v1258: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: audit 2024-04-19T23:04:28.624502+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]': finished 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: cluster 2024-04-19T23:04:28.630093+0000 mon.a (mon.0) 3732 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: audit 2024-04-19T23:04:28.730511+0000 mon.a (mon.0) 3733 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: audit 2024-04-19T23:04:29.050784+0000 mon.c (mon.2) 972 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:29 smithi113 bash[28910]: audit 2024-04-19T23:04:29.051255+0000 mon.a (mon.0) 3734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: cluster 2024-04-19T23:04:28.276787+0000 mgr.y (mgr.24389) 736 : cluster 0 pgmap v1258: 164 pgs: 164 active+clean; 583 KiB data, 724 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: audit 2024-04-19T23:04:28.624502+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]': finished 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: cluster 2024-04-19T23:04:28.630093+0000 mon.a (mon.0) 3732 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: audit 2024-04-19T23:04:28.730511+0000 mon.a (mon.0) 3733 : audit 1 from='client.? 172.21.15.113:0/1000738110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pg_num": 12}]: dispatch 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: audit 2024-04-19T23:04:29.050784+0000 mon.c (mon.2) 972 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:29 smithi178 bash[23441]: audit 2024-04-19T23:04:29.051255+0000 mon.a (mon.0) 3734 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:30.654 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.654+0000 7f5a6b7fe640 1 -- 172.21.15.113:0/1308008307 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v781) ==== 223+0+0 (secure 0 0 0) 0x7f5a6c0f9740 con 0x7f5a74069e80 2024-04-19T23:04:30.654 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_objects = 10 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:04:30.657 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 msgr2=0x7f5a600704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:30.657 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 0x7f5a600704e0 secure :-1 s=READY pgs=3119 cs=0 l=1 rev1=1 crypto rx=0x7f5a74069310 tx=0x7f5a5c00b410 comp rx=0 tx=0).stop 2024-04-19T23:04:30.657 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 msgr2=0x7f5a74199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:30.657 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c01d160 tx=0x7f5a6c0045e0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 shutdown_connections 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> v2:172.21.15.113:6800/3719359025 conn(0x7f5a6006e020 0x7f5a600704e0 unknown :-1 s=CLOSED pgs=3119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a741078c0 0x7f5a7419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a7406a820 0x7f5a7419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 --2- 172.21.15.113:0/1308008307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a74069e80 0x7f5a74199e90 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 >> 172.21.15.113:0/1308008307 conn(0x7f5a74077500 msgr2=0x7f5a741052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 shutdown_connections 2024-04-19T23:04:30.658 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.658+0000 7f5a78ad9640 1 -- 172.21.15.113:0/1308008307 wait complete. 2024-04-19T23:04:30.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool application enable 46f4c55d-95df-4d19-ae41-b63f718ffdb6 rados 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/3639839865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a4109900 msgr2=0x7fc0a4109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- 172.21.15.113:0/3639839865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a4109900 0x7fc0a4109ce0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009870 tx=0x7fc0a001c700 comp rx=0 tx=0).stop 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/3639839865 shutdown_connections 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- 172.21.15.113:0/3639839865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a41042c0 0x7fc0a41107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- 172.21.15.113:0/3639839865 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4103900 0x7fc0a4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- 172.21.15.113:0/3639839865 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a4109900 0x7fc0a4109ce0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/3639839865 >> 172.21.15.113:0/3639839865 conn(0x7fc0a40ff3d0 msgr2=0x7fc0a41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/3639839865 shutdown_connections 2024-04-19T23:04:30.797 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/3639839865 wait complete. 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 Processor -- start 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- start start 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a4103900 0x7fc0a419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4115b90 con 0x7fc0a41042c0 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4115a10 con 0x7fc0a4103900 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a4115d10 con 0x7fc0a4109900 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0a94fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0a94fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33548/0 (socket says 172.21.15.113:33548) 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:45224/0 (socket says 172.21.15.113:45224) 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0a94fd640 1 -- 172.21.15.113:0/2374099270 learned_addr learned my addr 172.21.15.113:0/2374099270 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:04:30.798 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 -- 172.21.15.113:0/2374099270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a4103900 msgr2=0x7fc0a419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0a9cfe640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a4103900 0x7fc0a419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a4103900 0x7fc0a419c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 -- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 msgr2=0x7fc0a419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a41a10a0 con 0x7fc0a4109900 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0a94fd640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0aa4ff640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00be20 tx=0x7fc09c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c019070 con 0x7fc0a4109900 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a41a1390 con 0x7fc0a4109900 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc09c0148f0 con 0x7fc0a4109900 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.794+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c012820 con 0x7fc0a4109900 2024-04-19T23:04:30.799 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a41a8c70 con 0x7fc0a4109900 2024-04-19T23:04:30.800 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a4068ab0 con 0x7fc0a4109900 2024-04-19T23:04:30.800 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fc09c01c070 con 0x7fc0a4109900 2024-04-19T23:04:30.800 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc09affd640 1 --2- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 0x7fc0900704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:04:30.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(781..781 src has 276..781) ==== 7643+0+0 (secure 0 0 0) 0x7fc09c08e3d0 con 0x7fc0a4109900 2024-04-19T23:04:30.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc0a9cfe640 1 --2- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 0x7fc0900704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:04:30.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.798+0000 7fc0a9cfe640 1 --2- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 0x7fc0900704e0 secure :-1 s=READY pgs=3120 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001cc70 tx=0x7fc0a0005fd0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:04:30.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.802+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc09c05f420 con 0x7fc0a4109900 2024-04-19T23:04:30.979 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:30.978+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"} v 0) -- 0x7fc0a419d450 con 0x7fc0a4109900 2024-04-19T23:04:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[28910]: audit 2024-04-19T23:04:29.636153+0000 mon.a (mon.0) 3735 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[28910]: cluster 2024-04-19T23:04:29.648274+0000 mon.a (mon.0) 3736 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-04-19T23:04:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[28910]: audit 2024-04-19T23:04:29.757784+0000 mon.c (mon.2) 973 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[28910]: audit 2024-04-19T23:04:29.758401+0000 mon.a (mon.0) 3737 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[21528]: audit 2024-04-19T23:04:29.636153+0000 mon.a (mon.0) 3735 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[21528]: cluster 2024-04-19T23:04:29.648274+0000 mon.a (mon.0) 3736 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-04-19T23:04:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[21528]: audit 2024-04-19T23:04:29.757784+0000 mon.c (mon.2) 973 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:30 smithi113 bash[21528]: audit 2024-04-19T23:04:29.758401+0000 mon.a (mon.0) 3737 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:30 smithi178 bash[23441]: audit 2024-04-19T23:04:29.636153+0000 mon.a (mon.0) 3735 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:30 smithi178 bash[23441]: cluster 2024-04-19T23:04:29.648274+0000 mon.a (mon.0) 3736 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-04-19T23:04:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:30 smithi178 bash[23441]: audit 2024-04-19T23:04:29.757784+0000 mon.c (mon.2) 973 : audit 1 from='client.? 172.21.15.113:0/1308008307' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:30 smithi178 bash[23441]: audit 2024-04-19T23:04:29.758401+0000 mon.a (mon.0) 3737 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:04:31.667 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:31.666+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]=0 enabled application 'rados' on pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' v782) ==== 213+0+0 (secure 0 0 0) 0x7fc0a419d450 con 0x7fc0a4109900 2024-04-19T23:04:31.777 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:31.774+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"} v 0) -- 0x7fc0a4061dd0 con 0x7fc0a4109900 2024-04-19T23:04:32.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[28910]: cluster 2024-04-19T23:04:30.278723+0000 mgr.y (mgr.24389) 737 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:32.101 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[28910]: audit 2024-04-19T23:04:30.645209+0000 mon.a (mon.0) 3738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:32.101 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[28910]: cluster 2024-04-19T23:04:30.655173+0000 mon.a (mon.0) 3739 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-04-19T23:04:32.101 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[28910]: audit 2024-04-19T23:04:30.981437+0000 mon.c (mon.2) 974 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.101 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[28910]: audit 2024-04-19T23:04:30.982044+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.101 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[21528]: cluster 2024-04-19T23:04:30.278723+0000 mgr.y (mgr.24389) 737 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[21528]: audit 2024-04-19T23:04:30.645209+0000 mon.a (mon.0) 3738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[21528]: cluster 2024-04-19T23:04:30.655173+0000 mon.a (mon.0) 3739 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[21528]: audit 2024-04-19T23:04:30.981437+0000 mon.c (mon.2) 974 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:31 smithi113 bash[21528]: audit 2024-04-19T23:04:30.982044+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:31 smithi178 bash[23441]: cluster 2024-04-19T23:04:30.278723+0000 mgr.y (mgr.24389) 737 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:31 smithi178 bash[23441]: audit 2024-04-19T23:04:30.645209+0000 mon.a (mon.0) 3738 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:31 smithi178 bash[23441]: cluster 2024-04-19T23:04:30.655173+0000 mon.a (mon.0) 3739 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:31 smithi178 bash[23441]: audit 2024-04-19T23:04:30.981437+0000 mon.c (mon.2) 974 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.102 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:31 smithi178 bash[23441]: audit 2024-04-19T23:04:30.982044+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:32.674 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.674+0000 7fc09affd640 1 -- 172.21.15.113:0/2374099270 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]=0 enabled application 'rados' on pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' v783) ==== 213+0+0 (secure 0 0 0) 0x7fc09c063c50 con 0x7fc0a4109900 2024-04-19T23:04:32.674 INFO:tasks.workunit.client.0.smithi113.stderr:enabled application 'rados' on pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' 2024-04-19T23:04:32.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 msgr2=0x7fc0900704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 0x7fc0900704e0 secure :-1 s=READY pgs=3120 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001cc70 tx=0x7fc0a0005fd0 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 msgr2=0x7fc0a41a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00be20 tx=0x7fc09c00bf10 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 shutdown_connections 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc09006e020 0x7fc0900704e0 unknown :-1 s=CLOSED pgs=3120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0a4109900 0x7fc0a41a09c0 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0a41042c0 0x7fc0a419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 --2- 172.21.15.113:0/2374099270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a4103900 0x7fc0a419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 >> 172.21.15.113:0/2374099270 conn(0x7fc0a40ff3d0 msgr2=0x7fc0a40ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:04:32.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 shutdown_connections 2024-04-19T23:04:32.680 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:04:32.678+0000 7fc0abf62640 1 -- 172.21.15.113:0/2374099270 wait complete. 2024-04-19T23:04:32.697 INFO:tasks.workunit.client.0.smithi113.stderr:+ seq 1 10 2024-04-19T23:04:32.717 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj1 /etc/passwd 2024-04-19T23:04:32.759 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj2 /etc/passwd 2024-04-19T23:04:32.799 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj3 /etc/passwd 2024-04-19T23:04:32.837 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj4 /etc/passwd 2024-04-19T23:04:32.874 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj5 /etc/passwd 2024-04-19T23:04:32.914 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj6 /etc/passwd 2024-04-19T23:04:32.953 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj7 /etc/passwd 2024-04-19T23:04:32.990 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj8 /etc/passwd 2024-04-19T23:04:33.027 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj9 /etc/passwd 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[28910]: audit 2024-04-19T23:04:31.655773+0000 mon.a (mon.0) 3741 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[28910]: cluster 2024-04-19T23:04:31.663245+0000 mon.a (mon.0) 3742 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[28910]: audit 2024-04-19T23:04:31.778666+0000 mon.c (mon.2) 975 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[28910]: audit 2024-04-19T23:04:31.779324+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[21528]: audit 2024-04-19T23:04:31.655773+0000 mon.a (mon.0) 3741 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[21528]: cluster 2024-04-19T23:04:31.663245+0000 mon.a (mon.0) 3742 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[21528]: audit 2024-04-19T23:04:31.778666+0000 mon.c (mon.2) 975 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:32 smithi113 bash[21528]: audit 2024-04-19T23:04:31.779324+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:32 smithi178 bash[23441]: audit 2024-04-19T23:04:31.655773+0000 mon.a (mon.0) 3741 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:32 smithi178 bash[23441]: cluster 2024-04-19T23:04:31.663245+0000 mon.a (mon.0) 3742 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-04-19T23:04:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:32 smithi178 bash[23441]: audit 2024-04-19T23:04:31.778666+0000 mon.c (mon.2) 975 : audit 1 from='client.? 172.21.15.113:0/2374099270' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:32 smithi178 bash[23441]: audit 2024-04-19T23:04:31.779324+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]: dispatch 2024-04-19T23:04:33.063 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put obj10 /etc/passwd 2024-04-19T23:04:33.101 INFO:tasks.workunit.client.0.smithi113.stderr:+ sleep 30 2024-04-19T23:04:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[21528]: cluster 2024-04-19T23:04:32.279456+0000 mgr.y (mgr.24389) 738 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:34.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[21528]: cluster 2024-04-19T23:04:32.655829+0000 mon.a (mon.0) 3744 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[21528]: audit 2024-04-19T23:04:32.665126+0000 mon.a (mon.0) 3745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[21528]: cluster 2024-04-19T23:04:32.674366+0000 mon.a (mon.0) 3746 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[28910]: cluster 2024-04-19T23:04:32.279456+0000 mgr.y (mgr.24389) 738 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[28910]: cluster 2024-04-19T23:04:32.655829+0000 mon.a (mon.0) 3744 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[28910]: audit 2024-04-19T23:04:32.665126+0000 mon.a (mon.0) 3745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:34.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:33 smithi113 bash[28910]: cluster 2024-04-19T23:04:32.674366+0000 mon.a (mon.0) 3746 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-04-19T23:04:34.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:33 smithi178 bash[23441]: cluster 2024-04-19T23:04:32.279456+0000 mgr.y (mgr.24389) 738 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:33 smithi178 bash[23441]: cluster 2024-04-19T23:04:32.655829+0000 mon.a (mon.0) 3744 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:04:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:33 smithi178 bash[23441]: audit 2024-04-19T23:04:32.665126+0000 mon.a (mon.0) 3745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "app": "rados"}]': finished 2024-04-19T23:04:34.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:33 smithi178 bash[23441]: cluster 2024-04-19T23:04:32.674366+0000 mon.a (mon.0) 3746 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-04-19T23:04:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:35 smithi113 bash[28910]: cluster 2024-04-19T23:04:34.280399+0000 mgr.y (mgr.24389) 739 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:04:36.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:35 smithi113 bash[28910]: audit 2024-04-19T23:04:35.210517+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:36.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:35 smithi113 bash[21528]: cluster 2024-04-19T23:04:34.280399+0000 mgr.y (mgr.24389) 739 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:04:36.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:35 smithi113 bash[21528]: audit 2024-04-19T23:04:35.210517+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:36.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:36.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:35 smithi178 bash[23441]: cluster 2024-04-19T23:04:34.280399+0000 mgr.y (mgr.24389) 739 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 583 KiB data, 717 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-19T23:04:36.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:35 smithi178 bash[23441]: audit 2024-04-19T23:04:35.210517+0000 mon.a (mon.0) 3747 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:37.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:36 smithi113 bash[21528]: audit 2024-04-19T23:04:35.629552+0000 mgr.y (mgr.24389) 740 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:37.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:36 smithi113 bash[28910]: audit 2024-04-19T23:04:35.629552+0000 mgr.y (mgr.24389) 740 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:37.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:36 smithi178 bash[23441]: audit 2024-04-19T23:04:35.629552+0000 mgr.y (mgr.24389) 740 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:37.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:37.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:37 smithi113 bash[28910]: cluster 2024-04-19T23:04:36.282322+0000 mgr.y (mgr.24389) 741 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 20 KiB/s wr, 2 op/s 2024-04-19T23:04:37.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:37 smithi113 bash[21528]: cluster 2024-04-19T23:04:36.282322+0000 mgr.y (mgr.24389) 741 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 20 KiB/s wr, 2 op/s 2024-04-19T23:04:38.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:37 smithi178 bash[23441]: cluster 2024-04-19T23:04:36.282322+0000 mgr.y (mgr.24389) 741 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 20 KiB/s wr, 2 op/s 2024-04-19T23:04:40.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:39 smithi113 bash[21528]: cluster 2024-04-19T23:04:38.283054+0000 mgr.y (mgr.24389) 742 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 16 KiB/s wr, 1 op/s 2024-04-19T23:04:40.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:39 smithi113 bash[28910]: cluster 2024-04-19T23:04:38.283054+0000 mgr.y (mgr.24389) 742 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 16 KiB/s wr, 1 op/s 2024-04-19T23:04:40.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:39 smithi178 bash[23441]: cluster 2024-04-19T23:04:38.283054+0000 mgr.y (mgr.24389) 742 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 16 KiB/s wr, 1 op/s 2024-04-19T23:04:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[21528]: cluster 2024-04-19T23:04:40.284910+0000 mgr.y (mgr.24389) 743 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 14 KiB/s wr, 2 op/s 2024-04-19T23:04:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[21528]: cluster 2024-04-19T23:04:41.502184+0000 mon.a (mon.0) 3748 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_objects: 10) 2024-04-19T23:04:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[21528]: cluster 2024-04-19T23:04:41.502695+0000 mon.a (mon.0) 3749 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:04:42.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[21528]: cluster 2024-04-19T23:04:41.512533+0000 mon.a (mon.0) 3750 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-04-19T23:04:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[28910]: cluster 2024-04-19T23:04:40.284910+0000 mgr.y (mgr.24389) 743 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 14 KiB/s wr, 2 op/s 2024-04-19T23:04:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[28910]: cluster 2024-04-19T23:04:41.502184+0000 mon.a (mon.0) 3748 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_objects: 10) 2024-04-19T23:04:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[28910]: cluster 2024-04-19T23:04:41.502695+0000 mon.a (mon.0) 3749 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:04:42.049 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:41 smithi113 bash[28910]: cluster 2024-04-19T23:04:41.512533+0000 mon.a (mon.0) 3750 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-04-19T23:04:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:41 smithi178 bash[23441]: cluster 2024-04-19T23:04:40.284910+0000 mgr.y (mgr.24389) 743 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 14 KiB/s wr, 2 op/s 2024-04-19T23:04:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:41 smithi178 bash[23441]: cluster 2024-04-19T23:04:41.502184+0000 mon.a (mon.0) 3748 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_objects: 10) 2024-04-19T23:04:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:41 smithi178 bash[23441]: cluster 2024-04-19T23:04:41.502695+0000 mon.a (mon.0) 3749 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:04:42.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:41 smithi178 bash[23441]: cluster 2024-04-19T23:04:41.512533+0000 mon.a (mon.0) 3750 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-04-19T23:04:44.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:43 smithi113 bash[28910]: cluster 2024-04-19T23:04:42.285819+0000 mgr.y (mgr.24389) 744 : cluster 0 pgmap v1271: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-19T23:04:44.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:43 smithi113 bash[21528]: cluster 2024-04-19T23:04:42.285819+0000 mgr.y (mgr.24389) 744 : cluster 0 pgmap v1271: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-19T23:04:44.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:43 smithi178 bash[23441]: cluster 2024-04-19T23:04:42.285819+0000 mgr.y (mgr.24389) 744 : cluster 0 pgmap v1271: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 12 KiB/s wr, 2 op/s 2024-04-19T23:04:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:45 smithi113 bash[28910]: cluster 2024-04-19T23:04:44.286776+0000 mgr.y (mgr.24389) 745 : cluster 0 pgmap v1272: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:04:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:45 smithi113 bash[21528]: cluster 2024-04-19T23:04:44.286776+0000 mgr.y (mgr.24389) 745 : cluster 0 pgmap v1272: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:04:46.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:46.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:45 smithi178 bash[23441]: cluster 2024-04-19T23:04:44.286776+0000 mgr.y (mgr.24389) 745 : cluster 0 pgmap v1272: 176 pgs: 176 active+clean; 700 KiB data, 715 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:04:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:46 smithi113 bash[28910]: audit 2024-04-19T23:04:45.636122+0000 mgr.y (mgr.24389) 746 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:46 smithi113 bash[21528]: audit 2024-04-19T23:04:45.636122+0000 mgr.y (mgr.24389) 746 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:46 smithi178 bash[23441]: audit 2024-04-19T23:04:45.636122+0000 mgr.y (mgr.24389) 746 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:47.805 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:47.805 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:47 smithi113 bash[28910]: cluster 2024-04-19T23:04:46.288592+0000 mgr.y (mgr.24389) 747 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:47.805 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:47 smithi113 bash[21528]: cluster 2024-04-19T23:04:46.288592+0000 mgr.y (mgr.24389) 747 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:47 smithi178 bash[23441]: cluster 2024-04-19T23:04:46.288592+0000 mgr.y (mgr.24389) 747 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:50.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:49 smithi113 bash[28910]: cluster 2024-04-19T23:04:48.289357+0000 mgr.y (mgr.24389) 748 : cluster 0 pgmap v1274: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:50.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:49 smithi113 bash[21528]: cluster 2024-04-19T23:04:48.289357+0000 mgr.y (mgr.24389) 748 : cluster 0 pgmap v1274: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:50.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:49 smithi178 bash[23441]: cluster 2024-04-19T23:04:48.289357+0000 mgr.y (mgr.24389) 748 : cluster 0 pgmap v1274: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[28910]: audit 2024-04-19T23:04:50.251067+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[28910]: audit 2024-04-19T23:04:50.253537+0000 mon.a (mon.0) 3752 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:51.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[28910]: cluster 2024-04-19T23:04:50.291196+0000 mgr.y (mgr.24389) 749 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:51.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[21528]: audit 2024-04-19T23:04:50.251067+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:51.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[21528]: audit 2024-04-19T23:04:50.253537+0000 mon.a (mon.0) 3752 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:51.549 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:51 smithi113 bash[21528]: cluster 2024-04-19T23:04:50.291196+0000 mgr.y (mgr.24389) 749 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:51.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:51 smithi178 bash[23441]: audit 2024-04-19T23:04:50.251067+0000 mon.a (mon.0) 3751 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:04:51.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:51 smithi178 bash[23441]: audit 2024-04-19T23:04:50.253537+0000 mon.a (mon.0) 3752 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:04:51.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:51 smithi178 bash[23441]: cluster 2024-04-19T23:04:50.291196+0000 mgr.y (mgr.24389) 749 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:04:53.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:53 smithi113 bash[21528]: cluster 2024-04-19T23:04:52.291991+0000 mgr.y (mgr.24389) 750 : cluster 0 pgmap v1276: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 op/s 2024-04-19T23:04:53.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:53 smithi113 bash[28910]: cluster 2024-04-19T23:04:52.291991+0000 mgr.y (mgr.24389) 750 : cluster 0 pgmap v1276: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 op/s 2024-04-19T23:04:53.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:53 smithi178 bash[23441]: cluster 2024-04-19T23:04:52.291991+0000 mgr.y (mgr.24389) 750 : cluster 0 pgmap v1276: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 op/s 2024-04-19T23:04:55.647 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:55 smithi178 bash[23441]: cluster 2024-04-19T23:04:54.292795+0000 mgr.y (mgr.24389) 751 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:04:55.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:55 smithi113 bash[21528]: cluster 2024-04-19T23:04:54.292795+0000 mgr.y (mgr.24389) 751 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:04:55.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:55 smithi113 bash[28910]: cluster 2024-04-19T23:04:54.292795+0000 mgr.y (mgr.24389) 751 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:04:56.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:04:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:04:56.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:56 smithi113 bash[21528]: audit 2024-04-19T23:04:55.647625+0000 mgr.y (mgr.24389) 752 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:56.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:56 smithi113 bash[28910]: audit 2024-04-19T23:04:55.647625+0000 mgr.y (mgr.24389) 752 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:56.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:56 smithi178 bash[23441]: audit 2024-04-19T23:04:55.647625+0000 mgr.y (mgr.24389) 752 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:04:57.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:04:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:04:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:04:57.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:57 smithi113 bash[28910]: cluster 2024-04-19T23:04:56.294664+0000 mgr.y (mgr.24389) 753 : cluster 0 pgmap v1278: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:57.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:57 smithi113 bash[21528]: cluster 2024-04-19T23:04:56.294664+0000 mgr.y (mgr.24389) 753 : cluster 0 pgmap v1278: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:57.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:57 smithi178 bash[23441]: cluster 2024-04-19T23:04:56.294664+0000 mgr.y (mgr.24389) 753 : cluster 0 pgmap v1278: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:04:59.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:04:59 smithi113 bash[21528]: cluster 2024-04-19T23:04:58.295503+0000 mgr.y (mgr.24389) 754 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:04:59.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:04:59 smithi113 bash[28910]: cluster 2024-04-19T23:04:58.295503+0000 mgr.y (mgr.24389) 754 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:04:59.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:04:59 smithi178 bash[23441]: cluster 2024-04-19T23:04:58.295503+0000 mgr.y (mgr.24389) 754 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:01.695 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:01 smithi113 bash[21528]: cluster 2024-04-19T23:05:00.297375+0000 mgr.y (mgr.24389) 755 : cluster 0 pgmap v1280: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:01.696 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:01 smithi113 bash[28910]: cluster 2024-04-19T23:05:00.297375+0000 mgr.y (mgr.24389) 755 : cluster 0 pgmap v1280: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:01.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:01 smithi178 bash[23441]: cluster 2024-04-19T23:05:00.297375+0000 mgr.y (mgr.24389) 755 : cluster 0 pgmap v1280: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:03.102 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=131943 2024-04-19T23:05:03.102 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_objects 100 2024-04-19T23:05:03.102 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put onemore /etc/passwd 2024-04-19T23:05:03.233 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- 172.21.15.113:0/1863588056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c101270 msgr2=0x7f234c10d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:03.233 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- 172.21.15.113:0/1863588056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c101270 0x7f234c10d460 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f2344009bf0 tx=0x7f234401caa0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- 172.21.15.113:0/1863588056 shutdown_connections 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- 172.21.15.113:0/1863588056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c101270 0x7f234c10d460 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- 172.21.15.113:0/1863588056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 0x7f234c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- 172.21.15.113:0/1863588056 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c106700 0x7f234c106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- 172.21.15.113:0/1863588056 >> 172.21.15.113:0/1863588056 conn(0x7f234c077510 msgr2=0x7f234c077920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- 172.21.15.113:0/1863588056 shutdown_connections 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- 172.21.15.113:0/1863588056 wait complete. 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 Processor -- start 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- start start 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 0x7f234c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 0x7f234c19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f234c112860 con 0x7f234c106700 2024-04-19T23:05:03.234 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f234c1126e0 con 0x7f234c1008d0 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f23523c0640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f234c1129e0 con 0x7f234c101270 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f234b7fe640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f235095d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 0x7f234c19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.229+0000 7f234b7fe640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:57286/0 (socket says 172.21.15.113:57286) 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f234b7fe640 1 -- 172.21.15.113:0/1963274902 learned_addr learned my addr 172.21.15.113:0/1963274902 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f234bfff640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 0x7f234c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 -- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 msgr2=0x7f234c19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 -- 172.21.15.113:0/1963274902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 msgr2=0x7f234c199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 0x7f234c199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c19ed60 con 0x7f234c106700 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f234b7fe640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f235095d640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 0x7f234c19e680 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f234401c8d0 tx=0x7f23440a5b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:03.235 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440ba020 con 0x7f234c106700 2024-04-19T23:05:03.236 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234c19eff0 con 0x7f234c106700 2024-04-19T23:05:03.236 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f2344004d10 con 0x7f234c106700 2024-04-19T23:05:03.236 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b2040 con 0x7f234c106700 2024-04-19T23:05:03.236 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234c19f4a0 con 0x7f234c106700 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234c101d40 con 0x7f234c106700 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f23440adba0 con 0x7f234c106700 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 --2- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 0x7f23340704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f234bfff640 1 --2- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 0x7f23340704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(784..784 src has 276..784) ==== 7656+0+0 (secure 0 0 0) 0x7f2344128a10 con 0x7f234c106700 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=785}) -- 0x7f23340792e0 con 0x7f234c106700 2024-04-19T23:05:03.237 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.233+0000 7f234bfff640 1 --2- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 0x7f23340704e0 secure :-1 s=READY pgs=3132 cs=0 l=1 rev1=1 crypto rx=0x7f233c009b80 tx=0x7f233c009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:03.240 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.241+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f23440c4020 con 0x7f234c106700 2024-04-19T23:05:03.415 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:03.413+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"} v 0) -- 0x7f234c1a69c0 con 0x7f234c106700 2024-04-19T23:05:03.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:03 smithi113 bash[28910]: cluster 2024-04-19T23:05:02.298216+0000 mgr.y (mgr.24389) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:03.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:03 smithi113 bash[21528]: cluster 2024-04-19T23:05:02.298216+0000 mgr.y (mgr.24389) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:03.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:03 smithi178 bash[23441]: cluster 2024-04-19T23:05:02.298216+0000 mgr.y (mgr.24389) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:04.387 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:04.385+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v785) ==== 225+0+0 (secure 0 0 0) 0x7f23440167b0 con 0x7f234c106700 2024-04-19T23:05:04.388 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:04.385+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 8 ==== osd_map(785..785 src has 276..785) ==== 628+0+0 (secure 0 0 0) 0x7f2344115060 con 0x7f234c106700 2024-04-19T23:05:04.388 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:04.385+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=786}) -- 0x7f233407a240 con 0x7f234c106700 2024-04-19T23:05:04.499 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:04.497+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"} v 0) -- 0x7f234c1a69c0 con 0x7f234c106700 2024-04-19T23:05:04.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:04 smithi113 bash[28910]: audit 2024-04-19T23:05:03.416938+0000 mon.a (mon.0) 3753 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:04.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:04 smithi113 bash[21528]: audit 2024-04-19T23:05:03.416938+0000 mon.a (mon.0) 3753 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:04.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:04 smithi178 bash[23441]: audit 2024-04-19T23:05:03.416938+0000 mon.a (mon.0) 3753 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:05.398 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.397+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v786) ==== 225+0+0 (secure 0 0 0) 0x7f23440f5d20 con 0x7f234c106700 2024-04-19T23:05:05.398 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_objects = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:05:05.398 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.397+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 <== mon.0 v2:172.21.15.113:3300/0 10 ==== osd_map(786..786 src has 276..786) ==== 628+0+0 (secure 0 0 0) 0x7f23441268b0 con 0x7f234c106700 2024-04-19T23:05:05.399 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.397+0000 7f23497fa640 1 -- 172.21.15.113:0/1963274902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=787}) -- 0x7f233407a2f0 con 0x7f234c106700 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 msgr2=0x7f23340704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 0x7f23340704e0 secure :-1 s=READY pgs=3132 cs=0 l=1 rev1=1 crypto rx=0x7f233c009b80 tx=0x7f233c009260 comp rx=0 tx=0).stop 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 msgr2=0x7f234c19e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 0x7f234c19e680 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f234401c8d0 tx=0x7f23440a5b50 comp rx=0 tx=0).stop 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 shutdown_connections 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> v2:172.21.15.113:6800/3719359025 conn(0x7f233406e020 0x7f23340704e0 unknown :-1 s=CLOSED pgs=3132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:05.404 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f234c106700 0x7f234c19e680 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:05.405 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f234c101270 0x7f234c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:05.405 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 --2- 172.21.15.113:0/1963274902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c1008d0 0x7f234c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:05.405 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.401+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 >> 172.21.15.113:0/1963274902 conn(0x7f234c077510 msgr2=0x7f234c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:05.407 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.405+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 shutdown_connections 2024-04-19T23:05:05.407 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:05.405+0000 7f23523c0640 1 -- 172.21.15.113:0/1963274902 wait complete. 2024-04-19T23:05:05.425 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 131943 2024-04-19T23:05:05.658 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[23441]: cluster 2024-04-19T23:05:04.299024+0000 mgr.y (mgr.24389) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:05.658 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[23441]: audit 2024-04-19T23:05:04.388186+0000 mon.a (mon.0) 3754 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:05.658 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[23441]: cluster 2024-04-19T23:05:04.396928+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-04-19T23:05:05.658 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[23441]: audit 2024-04-19T23:05:04.501793+0000 mon.a (mon.0) 3756 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:05.658 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[23441]: audit 2024-04-19T23:05:05.287563+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:05.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[21528]: cluster 2024-04-19T23:05:04.299024+0000 mgr.y (mgr.24389) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:05.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[21528]: audit 2024-04-19T23:05:04.388186+0000 mon.a (mon.0) 3754 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:05.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[21528]: cluster 2024-04-19T23:05:04.396928+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-04-19T23:05:05.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[21528]: audit 2024-04-19T23:05:04.501793+0000 mon.a (mon.0) 3756 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:05.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[21528]: audit 2024-04-19T23:05:05.287563+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[28910]: cluster 2024-04-19T23:05:04.299024+0000 mgr.y (mgr.24389) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 700 KiB data, 726 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[28910]: audit 2024-04-19T23:05:04.388186+0000 mon.a (mon.0) 3754 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[28910]: cluster 2024-04-19T23:05:04.396928+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-04-19T23:05:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[28910]: audit 2024-04-19T23:05:04.501793+0000 mon.a (mon.0) 3756 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]: dispatch 2024-04-19T23:05:05.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:05 smithi113 bash[28910]: audit 2024-04-19T23:05:05.287563+0000 mon.a (mon.0) 3757 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:06.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:06.524 INFO:tasks.workunit.client.0.smithi113.stderr:+ [ 0 -ne 0 ] 2024-04-19T23:05:06.524 INFO:tasks.workunit.client.0.smithi113.stderr:+ true 2024-04-19T23:05:06.524 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put twomore /etc/passwd 2024-04-19T23:05:06.566 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_bytes 100 2024-04-19T23:05:06.677 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- 172.21.15.113:0/788956366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 msgr2=0x7feb9c105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:06.677 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- 172.21.15.113:0/788956366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c105990 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7feb980098a0 tx=0x7feb9801c700 comp rx=0 tx=0).stop 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- 172.21.15.113:0/788956366 shutdown_connections 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- 172.21.15.113:0/788956366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb9c101740 0x7feb9c10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- 172.21.15.113:0/788956366 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- 172.21.15.113:0/788956366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c105990 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- 172.21.15.113:0/788956366 >> 172.21.15.113:0/788956366 conn(0x7feb9c076b40 msgr2=0x7feb9c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- 172.21.15.113:0/788956366 shutdown_connections 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- 172.21.15.113:0/788956366 wait complete. 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 Processor -- start 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- start start 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb9c101740 0x7feb9c0fc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c0fca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:06.678 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c112870 con 0x7feb9c1055b0 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c1126f0 con 0x7feb9c101740 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba35f7640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c1129f0 con 0x7feb9c100d80 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:57330/0 (socket says 172.21.15.113:57330) 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 -- 172.21.15.113:0/2901735628 learned_addr learned my addr 172.21.15.113:0/2901735628 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1b94640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c0fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 -- 172.21.15.113:0/2901735628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb9c101740 msgr2=0x7feb9c0fc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb9c101740 0x7feb9c0fc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 -- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 msgr2=0x7feb9c0fca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c0fca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.673+0000 7feba1393640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c1a83a0 con 0x7feb9c100d80 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba1393640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7feb9801cc70 tx=0x7feb98004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb980bc070 con 0x7feb9c100d80 2024-04-19T23:05:06.679 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c1a8630 con 0x7feb9c100d80 2024-04-19T23:05:06.680 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7feb98005520 con 0x7feb9c100d80 2024-04-19T23:05:06.680 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb980a6b70 con 0x7feb9c100d80 2024-04-19T23:05:06.680 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c1a8bc0 con 0x7feb9c100d80 2024-04-19T23:05:06.680 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c067dd0 con 0x7feb9c100d80 2024-04-19T23:05:06.681 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7feb980a53e0 con 0x7feb9c100d80 2024-04-19T23:05:06.681 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 --2- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 0x7feb880704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:06.681 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(787..787 src has 276..787) ==== 7656+0+0 (secure 0 0 0) 0x7feb98128fd0 con 0x7feb9c100d80 2024-04-19T23:05:06.681 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba0b92640 1 --2- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 0x7feb880704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:06.681 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.677+0000 7feba0b92640 1 --2- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 0x7feb880704e0 secure :-1 s=READY pgs=3134 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0096c0 tx=0x7feb8c005d20 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:06.683 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.681+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7feb98016410 con 0x7feb9c100d80 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[28910]: audit 2024-04-19T23:05:05.399354+0000 mon.a (mon.0) 3758 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[28910]: cluster 2024-04-19T23:05:05.407300+0000 mon.a (mon.0) 3759 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[28910]: audit 2024-04-19T23:05:05.658549+0000 mgr.y (mgr.24389) 758 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[28910]: audit 2024-04-19T23:05:05.970273+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[21528]: audit 2024-04-19T23:05:05.399354+0000 mon.a (mon.0) 3758 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:06.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[21528]: cluster 2024-04-19T23:05:05.407300+0000 mon.a (mon.0) 3759 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-04-19T23:05:06.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[21528]: audit 2024-04-19T23:05:05.658549+0000 mgr.y (mgr.24389) 758 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:06.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:06 smithi113 bash[21528]: audit 2024-04-19T23:05:05.970273+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:05:06.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:06 smithi178 bash[23441]: audit 2024-04-19T23:05:05.399354+0000 mon.a (mon.0) 3758 : audit 1 from='client.? 172.21.15.113:0/1963274902' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "100"}]': finished 2024-04-19T23:05:06.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:06 smithi178 bash[23441]: cluster 2024-04-19T23:05:05.407300+0000 mon.a (mon.0) 3759 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-04-19T23:05:06.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:06 smithi178 bash[23441]: audit 2024-04-19T23:05:05.658549+0000 mgr.y (mgr.24389) 758 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:06.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:06 smithi178 bash[23441]: audit 2024-04-19T23:05:05.970273+0000 mon.a (mon.0) 3760 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:05:06.857 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:06.857+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"} v 0) -- 0x7feb9c1a8e20 con 0x7feb9c100d80 2024-04-19T23:05:07.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:07.717+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v788) ==== 221+0+0 (secure 0 0 0) 0x7feb980f9f90 con 0x7feb9c100d80 2024-04-19T23:05:07.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: cluster 2024-04-19T23:05:06.299761+0000 mgr.y (mgr.24389) 759 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: cluster 2024-04-19T23:05:06.508874+0000 mon.a (mon.0) 3761 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: cluster 2024-04-19T23:05:06.509255+0000 mon.a (mon.0) 3762 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: cluster 2024-04-19T23:05:06.514955+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: audit 2024-04-19T23:05:06.701371+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: audit 2024-04-19T23:05:06.702160+0000 mon.a (mon.0) 3765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:05:07.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: audit 2024-04-19T23:05:06.707028+0000 mon.a (mon.0) 3766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: audit 2024-04-19T23:05:06.860100+0000 mon.c (mon.2) 976 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[28910]: audit 2024-04-19T23:05:06.860906+0000 mon.a (mon.0) 3767 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: cluster 2024-04-19T23:05:06.299761+0000 mgr.y (mgr.24389) 759 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: cluster 2024-04-19T23:05:06.508874+0000 mon.a (mon.0) 3761 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: cluster 2024-04-19T23:05:06.509255+0000 mon.a (mon.0) 3762 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: cluster 2024-04-19T23:05:06.514955+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: audit 2024-04-19T23:05:06.701371+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: audit 2024-04-19T23:05:06.702160+0000 mon.a (mon.0) 3765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:05:07.799 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: audit 2024-04-19T23:05:06.707028+0000 mon.a (mon.0) 3766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: audit 2024-04-19T23:05:06.860100+0000 mon.c (mon.2) 976 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.800 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:07 smithi113 bash[21528]: audit 2024-04-19T23:05:06.860906+0000 mon.a (mon.0) 3767 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: cluster 2024-04-19T23:05:06.299761+0000 mgr.y (mgr.24389) 759 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: cluster 2024-04-19T23:05:06.508874+0000 mon.a (mon.0) 3761 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:07.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: cluster 2024-04-19T23:05:06.509255+0000 mon.a (mon.0) 3762 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: cluster 2024-04-19T23:05:06.514955+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: audit 2024-04-19T23:05:06.701371+0000 mon.a (mon.0) 3764 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: audit 2024-04-19T23:05:06.702160+0000 mon.a (mon.0) 3765 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: audit 2024-04-19T23:05:06.707028+0000 mon.a (mon.0) 3766 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: audit 2024-04-19T23:05:06.860100+0000 mon.c (mon.2) 976 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:07 smithi178 bash[23441]: audit 2024-04-19T23:05:06.860906+0000 mon.a (mon.0) 3767 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:07.827 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:07.825+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"} v 0) -- 0x7feb9c061dd0 con 0x7feb9c100d80 2024-04-19T23:05:08.727 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.725+0000 7feb927fc640 1 -- 172.21.15.113:0/2901735628 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v789) ==== 221+0+0 (secure 0 0 0) 0x7feb980fe7c0 con 0x7feb9c100d80 2024-04-19T23:05:08.727 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_bytes = 100 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 msgr2=0x7feb880704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 0x7feb880704e0 secure :-1 s=READY pgs=3134 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0096c0 tx=0x7feb8c005d20 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 msgr2=0x7feb9c0fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 secure :-1 s=READY pgs=3269 cs=0 l=1 rev1=1 crypto rx=0x7feb9801cc70 tx=0x7feb98004430 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 shutdown_connections 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> v2:172.21.15.113:6800/3719359025 conn(0x7feb8806e020 0x7feb880704e0 unknown :-1 s=CLOSED pgs=3134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb9c1055b0 0x7feb9c0fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb9c101740 0x7feb9c0fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 --2- 172.21.15.113:0/2901735628 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7feb9c100d80 0x7feb9c0fbfc0 unknown :-1 s=CLOSED pgs=3269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 >> 172.21.15.113:0/2901735628 conn(0x7feb9c076b40 msgr2=0x7feb9c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 shutdown_connections 2024-04-19T23:05:08.731 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:08.729+0000 7feba35f7640 1 -- 172.21.15.113:0/2901735628 wait complete. 2024-04-19T23:05:08.748 INFO:tasks.workunit.client.0.smithi113.stderr:+ sleep 30 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[28910]: audit 2024-04-19T23:05:07.707916+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[28910]: cluster 2024-04-19T23:05:07.717758+0000 mon.a (mon.0) 3769 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[28910]: audit 2024-04-19T23:05:07.829128+0000 mon.c (mon.2) 977 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[28910]: audit 2024-04-19T23:05:07.829625+0000 mon.a (mon.0) 3770 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[21528]: audit 2024-04-19T23:05:07.707916+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[21528]: cluster 2024-04-19T23:05:07.717758+0000 mon.a (mon.0) 3769 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-04-19T23:05:09.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[21528]: audit 2024-04-19T23:05:07.829128+0000 mon.c (mon.2) 977 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:09.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:08 smithi113 bash[21528]: audit 2024-04-19T23:05:07.829625+0000 mon.a (mon.0) 3770 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:08 smithi178 bash[23441]: audit 2024-04-19T23:05:07.707916+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:08 smithi178 bash[23441]: cluster 2024-04-19T23:05:07.717758+0000 mon.a (mon.0) 3769 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-04-19T23:05:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:08 smithi178 bash[23441]: audit 2024-04-19T23:05:07.829128+0000 mon.c (mon.2) 977 : audit 1 from='client.? 172.21.15.113:0/2901735628' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:09.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:08 smithi178 bash[23441]: audit 2024-04-19T23:05:07.829625+0000 mon.a (mon.0) 3770 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]: dispatch 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[28910]: cluster 2024-04-19T23:05:08.300676+0000 mgr.y (mgr.24389) 760 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[28910]: audit 2024-04-19T23:05:08.717351+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[28910]: cluster 2024-04-19T23:05:08.727046+0000 mon.a (mon.0) 3772 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[21528]: cluster 2024-04-19T23:05:08.300676+0000 mgr.y (mgr.24389) 760 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[21528]: audit 2024-04-19T23:05:08.717351+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:10.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:09 smithi113 bash[21528]: cluster 2024-04-19T23:05:08.727046+0000 mon.a (mon.0) 3772 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-04-19T23:05:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:09 smithi178 bash[23441]: cluster 2024-04-19T23:05:08.300676+0000 mgr.y (mgr.24389) 760 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 700 KiB data, 725 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:09 smithi178 bash[23441]: audit 2024-04-19T23:05:08.717351+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "100"}]': finished 2024-04-19T23:05:10.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:09 smithi178 bash[23441]: cluster 2024-04-19T23:05:08.727046+0000 mon.a (mon.0) 3772 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-04-19T23:05:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[28910]: cluster 2024-04-19T23:05:10.302689+0000 mgr.y (mgr.24389) 761 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-04-19T23:05:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[28910]: cluster 2024-04-19T23:05:11.510693+0000 mon.a (mon.0) 3773 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_bytes: 100 B) 2024-04-19T23:05:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[28910]: cluster 2024-04-19T23:05:11.511168+0000 mon.a (mon.0) 3774 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:05:12.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[28910]: cluster 2024-04-19T23:05:11.523894+0000 mon.a (mon.0) 3775 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-04-19T23:05:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[21528]: cluster 2024-04-19T23:05:10.302689+0000 mgr.y (mgr.24389) 761 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-04-19T23:05:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[21528]: cluster 2024-04-19T23:05:11.510693+0000 mon.a (mon.0) 3773 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_bytes: 100 B) 2024-04-19T23:05:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[21528]: cluster 2024-04-19T23:05:11.511168+0000 mon.a (mon.0) 3774 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:05:12.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:11 smithi113 bash[21528]: cluster 2024-04-19T23:05:11.523894+0000 mon.a (mon.0) 3775 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-04-19T23:05:12.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:11 smithi178 bash[23441]: cluster 2024-04-19T23:05:10.302689+0000 mgr.y (mgr.24389) 761 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 4.9 KiB/s wr, 1 op/s 2024-04-19T23:05:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:11 smithi178 bash[23441]: cluster 2024-04-19T23:05:11.510693+0000 mon.a (mon.0) 3773 : cluster 3 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' is full (reached quota's max_bytes: 100 B) 2024-04-19T23:05:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:11 smithi178 bash[23441]: cluster 2024-04-19T23:05:11.511168+0000 mon.a (mon.0) 3774 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:05:12.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:11 smithi178 bash[23441]: cluster 2024-04-19T23:05:11.523894+0000 mon.a (mon.0) 3775 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-04-19T23:05:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:13 smithi113 bash[21528]: cluster 2024-04-19T23:05:12.303535+0000 mgr.y (mgr.24389) 762 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:05:14.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:13 smithi113 bash[28910]: cluster 2024-04-19T23:05:12.303535+0000 mgr.y (mgr.24389) 762 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:05:14.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:13 smithi178 bash[23441]: cluster 2024-04-19T23:05:12.303535+0000 mgr.y (mgr.24389) 762 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-04-19T23:05:16.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:15 smithi113 bash[21528]: cluster 2024-04-19T23:05:14.304471+0000 mgr.y (mgr.24389) 763 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 776 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-04-19T23:05:16.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:15 smithi113 bash[28910]: cluster 2024-04-19T23:05:14.304471+0000 mgr.y (mgr.24389) 763 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 776 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-04-19T23:05:16.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:16.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:15 smithi178 bash[23441]: cluster 2024-04-19T23:05:14.304471+0000 mgr.y (mgr.24389) 763 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 703 MiB used, 715 GiB / 715 GiB avail; 776 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-04-19T23:05:17.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:16 smithi113 bash[21528]: audit 2024-04-19T23:05:15.670003+0000 mgr.y (mgr.24389) 764 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:17.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:16 smithi113 bash[28910]: audit 2024-04-19T23:05:15.670003+0000 mgr.y (mgr.24389) 764 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:17.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:16 smithi178 bash[23441]: audit 2024-04-19T23:05:15.670003+0000 mgr.y (mgr.24389) 764 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:17.749 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:18.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:17 smithi113 bash[28910]: cluster 2024-04-19T23:05:16.306488+0000 mgr.y (mgr.24389) 765 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:05:18.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:17 smithi113 bash[21528]: cluster 2024-04-19T23:05:16.306488+0000 mgr.y (mgr.24389) 765 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:05:18.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:17 smithi178 bash[23441]: cluster 2024-04-19T23:05:16.306488+0000 mgr.y (mgr.24389) 765 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:05:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:19 smithi113 bash[28910]: cluster 2024-04-19T23:05:18.307273+0000 mgr.y (mgr.24389) 766 : cluster 0 pgmap v1295: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-04-19T23:05:20.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:19 smithi113 bash[21528]: cluster 2024-04-19T23:05:18.307273+0000 mgr.y (mgr.24389) 766 : cluster 0 pgmap v1295: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-04-19T23:05:20.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:19 smithi178 bash[23441]: cluster 2024-04-19T23:05:18.307273+0000 mgr.y (mgr.24389) 766 : cluster 0 pgmap v1295: 176 pgs: 176 active+clean; 723 KiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-04-19T23:05:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:20 smithi113 bash[21528]: audit 2024-04-19T23:05:20.319342+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:21.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:20 smithi113 bash[28910]: audit 2024-04-19T23:05:20.319342+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:21.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:20 smithi178 bash[23441]: audit 2024-04-19T23:05:20.319342+0000 mon.a (mon.0) 3776 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:21 smithi113 bash[21528]: cluster 2024-04-19T23:05:20.309119+0000 mgr.y (mgr.24389) 767 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-04-19T23:05:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:21 smithi113 bash[28910]: cluster 2024-04-19T23:05:20.309119+0000 mgr.y (mgr.24389) 767 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-04-19T23:05:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:21 smithi178 bash[23441]: cluster 2024-04-19T23:05:20.309119+0000 mgr.y (mgr.24389) 767 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-04-19T23:05:23.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:22 smithi113 bash[21528]: cluster 2024-04-19T23:05:22.309911+0000 mgr.y (mgr.24389) 768 : cluster 0 pgmap v1297: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-04-19T23:05:23.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:22 smithi113 bash[28910]: cluster 2024-04-19T23:05:22.309911+0000 mgr.y (mgr.24389) 768 : cluster 0 pgmap v1297: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-04-19T23:05:23.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:22 smithi178 bash[23441]: cluster 2024-04-19T23:05:22.309911+0000 mgr.y (mgr.24389) 768 : cluster 0 pgmap v1297: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-04-19T23:05:25.676 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:25 smithi178 bash[23441]: cluster 2024-04-19T23:05:24.310695+0000 mgr.y (mgr.24389) 769 : cluster 0 pgmap v1298: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:25.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:25 smithi113 bash[28910]: cluster 2024-04-19T23:05:24.310695+0000 mgr.y (mgr.24389) 769 : cluster 0 pgmap v1298: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:25.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:25 smithi113 bash[21528]: cluster 2024-04-19T23:05:24.310695+0000 mgr.y (mgr.24389) 769 : cluster 0 pgmap v1298: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:26.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:26.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:26 smithi113 bash[21528]: audit 2024-04-19T23:05:25.677431+0000 mgr.y (mgr.24389) 770 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:26.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:26 smithi113 bash[28910]: audit 2024-04-19T23:05:25.677431+0000 mgr.y (mgr.24389) 770 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:26.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:26 smithi178 bash[23441]: audit 2024-04-19T23:05:25.677431+0000 mgr.y (mgr.24389) 770 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:27.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:27 smithi113 bash[21528]: cluster 2024-04-19T23:05:26.312786+0000 mgr.y (mgr.24389) 771 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:27 smithi113 bash[28910]: cluster 2024-04-19T23:05:26.312786+0000 mgr.y (mgr.24389) 771 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:27.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:27.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:27 smithi178 bash[23441]: cluster 2024-04-19T23:05:26.312786+0000 mgr.y (mgr.24389) 771 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:29.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:29 smithi113 bash[28910]: cluster 2024-04-19T23:05:28.313604+0000 mgr.y (mgr.24389) 772 : cluster 0 pgmap v1300: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:29.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:29 smithi113 bash[21528]: cluster 2024-04-19T23:05:28.313604+0000 mgr.y (mgr.24389) 772 : cluster 0 pgmap v1300: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:29.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:29 smithi178 bash[23441]: cluster 2024-04-19T23:05:28.313604+0000 mgr.y (mgr.24389) 772 : cluster 0 pgmap v1300: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:31.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:31 smithi113 bash[28910]: cluster 2024-04-19T23:05:30.315498+0000 mgr.y (mgr.24389) 773 : cluster 0 pgmap v1301: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:31.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:31 smithi113 bash[21528]: cluster 2024-04-19T23:05:30.315498+0000 mgr.y (mgr.24389) 773 : cluster 0 pgmap v1301: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:31.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:31 smithi178 bash[23441]: cluster 2024-04-19T23:05:30.315498+0000 mgr.y (mgr.24389) 773 : cluster 0 pgmap v1301: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-04-19T23:05:33.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:33 smithi113 bash[28910]: cluster 2024-04-19T23:05:32.316270+0000 mgr.y (mgr.24389) 774 : cluster 0 pgmap v1302: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:33.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:33 smithi113 bash[21528]: cluster 2024-04-19T23:05:32.316270+0000 mgr.y (mgr.24389) 774 : cluster 0 pgmap v1302: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:33.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:33 smithi178 bash[23441]: cluster 2024-04-19T23:05:32.316270+0000 mgr.y (mgr.24389) 774 : cluster 0 pgmap v1302: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:35.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:35 smithi178 bash[23441]: cluster 2024-04-19T23:05:34.317038+0000 mgr.y (mgr.24389) 775 : cluster 0 pgmap v1303: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:35.688 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:35 smithi178 bash[23441]: audit 2024-04-19T23:05:35.352470+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:35.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:35 smithi113 bash[21528]: cluster 2024-04-19T23:05:34.317038+0000 mgr.y (mgr.24389) 775 : cluster 0 pgmap v1303: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:35.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:35 smithi113 bash[21528]: audit 2024-04-19T23:05:35.352470+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:35.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:35 smithi113 bash[28910]: cluster 2024-04-19T23:05:34.317038+0000 mgr.y (mgr.24389) 775 : cluster 0 pgmap v1303: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:35.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:35 smithi113 bash[28910]: audit 2024-04-19T23:05:35.352470+0000 mon.a (mon.0) 3777 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:36.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:36.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:36 smithi113 bash[28910]: audit 2024-04-19T23:05:35.688714+0000 mgr.y (mgr.24389) 776 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:36.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:36 smithi113 bash[21528]: audit 2024-04-19T23:05:35.688714+0000 mgr.y (mgr.24389) 776 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:36.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:36 smithi178 bash[23441]: audit 2024-04-19T23:05:35.688714+0000 mgr.y (mgr.24389) 776 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:37 smithi113 bash[28910]: cluster 2024-04-19T23:05:36.318899+0000 mgr.y (mgr.24389) 777 : cluster 0 pgmap v1304: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:37.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:37 smithi113 bash[21528]: cluster 2024-04-19T23:05:36.318899+0000 mgr.y (mgr.24389) 777 : cluster 0 pgmap v1304: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:37.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:37.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:37 smithi178 bash[23441]: cluster 2024-04-19T23:05:36.318899+0000 mgr.y (mgr.24389) 777 : cluster 0 pgmap v1304: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:38.749 INFO:tasks.workunit.client.0.smithi113.stderr:+ pid=132043 2024-04-19T23:05:38.749 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_bytes 0 2024-04-19T23:05:38.749 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put two /etc/passwd 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/1976181003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a41005e0 msgr2=0x7fe4a4100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- 172.21.15.113:0/1976181003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a41005e0 0x7fe4a4100a60 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009960 tx=0x7fe4a001c7c0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/1976181003 shutdown_connections 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- 172.21.15.113:0/1976181003 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a4100fa0 0x7fe4a410d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- 172.21.15.113:0/1976181003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a41005e0 0x7fe4a4100a60 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- 172.21.15.113:0/1976181003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a4106670 0x7fe4a4106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.879 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/1976181003 >> 172.21.15.113:0/1976181003 conn(0x7fe4a40fc130 msgr2=0x7fe4a40fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/1976181003 shutdown_connections 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/1976181003 wait complete. 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 Processor -- start 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- start start 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a4106670 0x7fe4a41a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a4112810 con 0x7fe4a4100fa0 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a4112690 con 0x7fe4a4106670 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a4112990 con 0x7fe4a41005e0 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a92f1640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:38.880 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a92f1640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:54916/0 (socket says 172.21.15.113:54916) 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49628/0 (socket says 172.21.15.113:49628) 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a92f1640 1 -- 172.21.15.113:0/2720963411 learned_addr learned my addr 172.21.15.113:0/2720963411 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 -- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 msgr2=0x7fe4a419c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 -- 172.21.15.113:0/2720963411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a4106670 msgr2=0x7fe4a41a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a4106670 0x7fe4a41a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a41a1010 con 0x7fe4a4100fa0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a92f1640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4a8af0640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fe4a001c5f0 tx=0x7fe4a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00bc020 con 0x7fe4a4100fa0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fe4a00a55c0 con 0x7fe4a4100fa0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a41a12a0 con 0x7fe4a4100fa0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00b2040 con 0x7fe4a4100fa0 2024-04-19T23:05:38.881 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a41a1750 con 0x7fe4a4100fa0 2024-04-19T23:05:38.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.876+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a4068660 con 0x7fe4a4100fa0 2024-04-19T23:05:38.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fe4a00bf070 con 0x7fe4a4100fa0 2024-04-19T23:05:38.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4967fc640 1 --2- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 0x7fe4900704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:38.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(790..790 src has 276..790) ==== 7656+0+0 (secure 0 0 0) 0x7fe4a0128350 con 0x7fe4a4100fa0 2024-04-19T23:05:38.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4a92f1640 1 --2- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 0x7fe4900704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:38.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=791}) -- 0x7fe4900792e0 con 0x7fe4a4100fa0 2024-04-19T23:05:38.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.880+0000 7fe4a92f1640 1 --2- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 0x7fe4900704e0 secure :-1 s=READY pgs=3136 cs=0 l=1 rev1=1 crypto rx=0x7fe49800afd0 tx=0x7fe49800a3b0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:38.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:38.884+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe4a00164d0 con 0x7fe4a4100fa0 2024-04-19T23:05:39.058 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:39.056+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"} v 0) -- 0x7fe4a41a8c70 con 0x7fe4a4100fa0 2024-04-19T23:05:39.413 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:39.412+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v791) ==== 217+0+0 (secure 0 0 0) 0x7fe4a00f5660 con 0x7fe4a4100fa0 2024-04-19T23:05:39.414 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:39.412+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 8 ==== osd_map(791..791 src has 276..791) ==== 628+0+0 (secure 0 0 0) 0x7fe4a015c6f0 con 0x7fe4a4100fa0 2024-04-19T23:05:39.415 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:39.412+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=792}) -- 0x7fe49007a240 con 0x7fe4a4100fa0 2024-04-19T23:05:39.526 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:39.524+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"} v 0) -- 0x7fe4a4061dd0 con 0x7fe4a4100fa0 2024-04-19T23:05:39.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:39 smithi113 bash[28910]: cluster 2024-04-19T23:05:38.319669+0000 mgr.y (mgr.24389) 778 : cluster 0 pgmap v1305: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:39.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:39 smithi113 bash[28910]: audit 2024-04-19T23:05:39.060927+0000 mon.a (mon.0) 3778 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:39.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:39 smithi113 bash[21528]: cluster 2024-04-19T23:05:38.319669+0000 mgr.y (mgr.24389) 778 : cluster 0 pgmap v1305: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:39.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:39 smithi113 bash[21528]: audit 2024-04-19T23:05:39.060927+0000 mon.a (mon.0) 3778 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:39.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:39 smithi178 bash[23441]: cluster 2024-04-19T23:05:38.319669+0000 mgr.y (mgr.24389) 778 : cluster 0 pgmap v1305: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:05:39.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:39 smithi178 bash[23441]: audit 2024-04-19T23:05:39.060927+0000 mon.a (mon.0) 3778 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:40.442 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.440+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v792) ==== 217+0+0 (secure 0 0 0) 0x7fe4a00f9310 con 0x7fe4a4100fa0 2024-04-19T23:05:40.443 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:05:40.444 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 <== mon.0 v2:172.21.15.113:3300/0 10 ==== osd_map(792..792 src has 276..792) ==== 628+0+0 (secure 0 0 0) 0x7fe4a01261f0 con 0x7fe4a4100fa0 2024-04-19T23:05:40.444 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4967fc640 1 -- 172.21.15.113:0/2720963411 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=793}) -- 0x7fe49007a2f0 con 0x7fe4a4100fa0 2024-04-19T23:05:40.446 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 msgr2=0x7fe4900704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 0x7fe4900704e0 secure :-1 s=READY pgs=3136 cs=0 l=1 rev1=1 crypto rx=0x7fe49800afd0 tx=0x7fe49800a3b0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 msgr2=0x7fe4a419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fe4a001c5f0 tx=0x7fe4a0004430 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 shutdown_connections 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> v2:172.21.15.113:6800/3719359025 conn(0x7fe49006e020 0x7fe4900704e0 secure :-1 s=CLOSED pgs=3136 cs=0 l=1 rev1=1 crypto rx=0x7fe49800afd0 tx=0x7fe49800a3b0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a4106670 0x7fe4a41a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe4a4100fa0 0x7fe4a419c5a0 secure :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fe4a001c5f0 tx=0x7fe4a0004430 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 --2- 172.21.15.113:0/2720963411 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe4a41005e0 0x7fe4a419c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 >> 172.21.15.113:0/2720963411 conn(0x7fe4a40fc130 msgr2=0x7fe4a40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:40.447 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 shutdown_connections 2024-04-19T23:05:40.448 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.444+0000 7fe4ab555640 1 -- 172.21.15.113:0/2720963411 wait complete. 2024-04-19T23:05:40.466 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_objects 0 2024-04-19T23:05:40.588 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/1507845226 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c410bcf0 msgr2=0x7fd8c410e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:40.588 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/1507845226 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c410bcf0 0x7fd8c410e190 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009cb0 tx=0x7fd8bc01cd30 comp rx=0 tx=0).stop 2024-04-19T23:05:40.588 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/1507845226 shutdown_connections 2024-04-19T23:05:40.588 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/1507845226 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c410bcf0 0x7fd8c410e190 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.588 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/1507845226 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c410b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/1507845226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c41028c0 0x7fd8c4102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/1507845226 >> 172.21.15.113:0/1507845226 conn(0x7fd8c40fc130 msgr2=0x7fd8c40fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/1507845226 shutdown_connections 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/1507845226 wait complete. 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 Processor -- start 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- start start 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c410bcf0 0x7fd8c419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c4113970 con 0x7fd8c41031e0 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c41137f0 con 0x7fd8c410bcf0 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c9ea7640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c4113af0 con 0x7fd8c41028c0 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:40.589 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:54928/0 (socket says 172.21.15.113:54928) 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 -- 172.21.15.113:0/2268531660 learned_addr learned my addr 172.21.15.113:0/2268531660 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49652/0 (socket says 172.21.15.113:49652) 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 -- 172.21.15.113:0/2268531660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c410bcf0 msgr2=0x7fd8c419e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c410bcf0 0x7fd8c419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 -- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 msgr2=0x7fd8c419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8c37fe640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c419ed40 con 0x7fd8c41028c0 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.584+0000 7fd8bbfff640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c37fe640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c970 tx=0x7fd8b400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4007c70 con 0x7fd8c41028c0 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c419f030 con 0x7fd8c41028c0 2024-04-19T23:05:40.590 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd8b4007e10 con 0x7fd8c41028c0 2024-04-19T23:05:40.591 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40187e0 con 0x7fd8c41028c0 2024-04-19T23:05:40.591 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c41a6910 con 0x7fd8c41028c0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c4068ab0 con 0x7fd8c41028c0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fd8b400f450 con 0x7fd8c41028c0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 --2- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 0x7fd8b00704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8bbfff640 1 --2- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 0x7fd8b00704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(792..792 src has 276..792) ==== 7656+0+0 (secure 0 0 0) 0x7fd8b408eb60 con 0x7fd8c41028c0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=793}) -- 0x7fd8b00792e0 con 0x7fd8c41028c0 2024-04-19T23:05:40.592 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.588+0000 7fd8bbfff640 1 --2- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 0x7fd8b00704e0 secure :-1 s=READY pgs=3137 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40fdc80 tx=0x7fd8ac0091e0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:40.595 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.592+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd8b4014030 con 0x7fd8c41028c0 2024-04-19T23:05:40.771 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:40.768+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"} v 0) -- 0x7fd8c419b0f0 con 0x7fd8c41028c0 2024-04-19T23:05:40.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[21528]: audit 2024-04-19T23:05:39.415406+0000 mon.a (mon.0) 3779 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:40.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[21528]: cluster 2024-04-19T23:05:39.425355+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-04-19T23:05:40.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[21528]: audit 2024-04-19T23:05:39.528971+0000 mon.a (mon.0) 3781 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:40.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[28910]: audit 2024-04-19T23:05:39.415406+0000 mon.a (mon.0) 3779 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:40.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[28910]: cluster 2024-04-19T23:05:39.425355+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-04-19T23:05:40.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:40 smithi113 bash[28910]: audit 2024-04-19T23:05:39.528971+0000 mon.a (mon.0) 3781 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:40 smithi178 bash[23441]: audit 2024-04-19T23:05:39.415406+0000 mon.a (mon.0) 3779 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:40 smithi178 bash[23441]: cluster 2024-04-19T23:05:39.425355+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-04-19T23:05:40.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:40 smithi178 bash[23441]: audit 2024-04-19T23:05:39.528971+0000 mon.a (mon.0) 3781 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:05:41.448 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.448+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 7 ==== osd_map(793..793 src has 276..793) ==== 628+0+0 (secure 0 0 0) 0x7fd8b4059970 con 0x7fd8c41028c0 2024-04-19T23:05:41.449 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.448+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=794}) -- 0x7fd8b0079e10 con 0x7fd8c41028c0 2024-04-19T23:05:41.456 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.452+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v793) ==== 221+0+0 (secure 0 0 0) 0x7fd8b405bfd0 con 0x7fd8c41028c0 2024-04-19T23:05:41.525 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.524+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 9 ==== osd_map(794..794 src has 276..794) ==== 628+0+0 (secure 0 0 0) 0x7fd8b4059bd0 con 0x7fd8c41028c0 2024-04-19T23:05:41.526 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.524+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=795}) -- 0x7fd8b007a470 con 0x7fd8c41028c0 2024-04-19T23:05:41.577 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:41.576+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"} v 0) -- 0x7fd8c4061dd0 con 0x7fd8c41028c0 2024-04-19T23:05:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[28910]: cluster 2024-04-19T23:05:40.321620+0000 mgr.y (mgr.24389) 779 : cluster 0 pgmap v1307: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:05:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[28910]: audit 2024-04-19T23:05:40.444075+0000 mon.a (mon.0) 3782 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:41.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[28910]: cluster 2024-04-19T23:05:40.454985+0000 mon.a (mon.0) 3783 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[28910]: audit 2024-04-19T23:05:40.773755+0000 mon.c (mon.2) 978 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[28910]: audit 2024-04-19T23:05:40.774264+0000 mon.a (mon.0) 3784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[21528]: cluster 2024-04-19T23:05:40.321620+0000 mgr.y (mgr.24389) 779 : cluster 0 pgmap v1307: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[21528]: audit 2024-04-19T23:05:40.444075+0000 mon.a (mon.0) 3782 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[21528]: cluster 2024-04-19T23:05:40.454985+0000 mon.a (mon.0) 3783 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[21528]: audit 2024-04-19T23:05:40.773755+0000 mon.c (mon.2) 978 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:41.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:41 smithi113 bash[21528]: audit 2024-04-19T23:05:40.774264+0000 mon.a (mon.0) 3784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:41 smithi178 bash[23441]: cluster 2024-04-19T23:05:40.321620+0000 mgr.y (mgr.24389) 779 : cluster 0 pgmap v1307: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:05:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:41 smithi178 bash[23441]: audit 2024-04-19T23:05:40.444075+0000 mon.a (mon.0) 3782 : audit 1 from='client.? 172.21.15.113:0/2720963411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:05:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:41 smithi178 bash[23441]: cluster 2024-04-19T23:05:40.454985+0000 mon.a (mon.0) 3783 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-04-19T23:05:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:41 smithi178 bash[23441]: audit 2024-04-19T23:05:40.773755+0000 mon.c (mon.2) 978 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:41.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:41 smithi178 bash[23441]: audit 2024-04-19T23:05:40.774264+0000 mon.a (mon.0) 3784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.524 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.524+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 10 ==== osd_map(795..795 src has 276..795) ==== 628+0+0 (secure 0 0 0) 0x7fd8b400f740 con 0x7fd8c41028c0 2024-04-19T23:05:42.531 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.528+0000 7fd8c17fa640 1 -- 172.21.15.113:0/2268531660 <== mon.2 v2:172.21.15.113:3301/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v795) ==== 221+0+0 (secure 0 0 0) 0x7fd8b40790d0 con 0x7fd8c41028c0 2024-04-19T23:05:42.531 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:05:42.536 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 msgr2=0x7fd8b00704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:42.536 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 0x7fd8b00704e0 secure :-1 s=READY pgs=3137 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40fdc80 tx=0x7fd8ac0091e0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.536 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 msgr2=0x7fd8c4199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:42.536 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c970 tx=0x7fd8b400ce30 comp rx=0 tx=0).stop 2024-04-19T23:05:42.536 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 shutdown_connections 2024-04-19T23:05:42.537 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd8b006e020 0x7fd8b00704e0 unknown :-1 s=CLOSED pgs=3137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.537 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c410bcf0 0x7fd8c419e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.537 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd8c41031e0 0x7fd8c419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.537 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 --2- 172.21.15.113:0/2268531660 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd8c41028c0 0x7fd8c4199d90 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.537 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 >> 172.21.15.113:0/2268531660 conn(0x7fd8c40fc130 msgr2=0x7fd8c410d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:42.539 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 shutdown_connections 2024-04-19T23:05:42.539 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.536+0000 7fd8c9ea7640 1 -- 172.21.15.113:0/2268531660 wait complete. 2024-04-19T23:05:42.557 INFO:tasks.workunit.client.0.smithi113.stderr:+ wait 132043 2024-04-19T23:05:42.557 INFO:tasks.workunit.client.0.smithi113.stderr:+ [ 0 -ne 0 ] 2024-04-19T23:05:42.557 INFO:tasks.workunit.client.0.smithi113.stderr:+ true 2024-04-19T23:05:42.557 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put three /etc/passwd 2024-04-19T23:05:42.599 INFO:tasks.workunit.client.0.smithi113.stderr:+ uuidgen 2024-04-19T23:05:42.599 INFO:tasks.workunit.client.0.smithi113.stderr:+ pp=6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f 2024-04-19T23:05:42.600 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool create 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f 12 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/190905232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c073b10 msgr2=0x7f040c073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- 172.21.15.113:0/190905232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c073b10 0x7f040c073ef0 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009930 tx=0x7f03fc01c870 comp rx=0 tx=0).stop 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/190905232 shutdown_connections 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- 172.21.15.113:0/190905232 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c10dfc0 0x7f040c1103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- 172.21.15.113:0/190905232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f040c074430 0x7f040c10da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- 172.21.15.113:0/190905232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c073b10 0x7f040c073ef0 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/190905232 >> 172.21.15.113:0/190905232 conn(0x7f040c0fd250 msgr2=0x7f040c0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/190905232 shutdown_connections 2024-04-19T23:05:42.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/190905232 wait complete. 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 Processor -- start 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- start start 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c074430 0x7f040c19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f040c10dfc0 0x7f040c1a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f040c115b10 con 0x7f040c073b10 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f040c115990 con 0x7f040c10dfc0 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f040c115c90 con 0x7f040c074430 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f0409d9b640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c074430 0x7f040c19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49708/0 (socket says 172.21.15.113:49708) 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 -- 172.21.15.113:0/1670794560 learned_addr learned my addr 172.21.15.113:0/1670794560 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 -- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c074430 msgr2=0x7f040c19c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c074430 0x7f040c19c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 -- 172.21.15.113:0/1670794560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f040c10dfc0 msgr2=0x7f040c1a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f040c10dfc0 0x7f040c1a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c1a0fc0 con 0x7f040c073b10 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f040a59c640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f03fc01cde0 tx=0x7f03fc0044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0bc020 con 0x7f040c073b10 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c1a1250 con 0x7f040c073b10 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f03fc0ad8f0 con 0x7f040c073b10 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0b2040 con 0x7f040c073b10 2024-04-19T23:05:42.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a8b90 con 0x7f040c073b10 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c075250 con 0x7f040c073b10 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.716+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f03fc0bf070 con 0x7f040c073b10 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.720+0000 7f04037fe640 1 --2- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 0x7f03f80704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.720+0000 7f0409d9b640 1 --2- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 0x7f03f80704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.720+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(795..795 src has 276..795) ==== 7656+0+0 (secure 0 0 0) 0x7f03fc128200 con 0x7f040c073b10 2024-04-19T23:05:42.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.720+0000 7f0409d9b640 1 --2- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 0x7f03f80704e0 secure :-1 s=READY pgs=3139 cs=0 l=1 rev1=1 crypto rx=0x7f040c0fef20 tx=0x7f0404007600 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:42.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.724+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f03fc0164f0 con 0x7f040c073b10 2024-04-19T23:05:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: audit 2024-04-19T23:05:41.446866+0000 mon.a (mon.0) 3785 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: cluster 2024-04-19T23:05:41.456498+0000 mon.a (mon.0) 3786 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-04-19T23:05:42.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: cluster 2024-04-19T23:05:41.518577+0000 mon.a (mon.0) 3787 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: cluster 2024-04-19T23:05:41.519014+0000 mon.a (mon.0) 3788 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: cluster 2024-04-19T23:05:41.531406+0000 mon.a (mon.0) 3789 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: audit 2024-04-19T23:05:41.579769+0000 mon.c (mon.2) 979 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[21528]: audit 2024-04-19T23:05:41.580386+0000 mon.a (mon.0) 3790 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: audit 2024-04-19T23:05:41.446866+0000 mon.a (mon.0) 3785 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: cluster 2024-04-19T23:05:41.456498+0000 mon.a (mon.0) 3786 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: cluster 2024-04-19T23:05:41.518577+0000 mon.a (mon.0) 3787 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: cluster 2024-04-19T23:05:41.519014+0000 mon.a (mon.0) 3788 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: cluster 2024-04-19T23:05:41.531406+0000 mon.a (mon.0) 3789 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: audit 2024-04-19T23:05:41.579769+0000 mon.c (mon.2) 979 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:42 smithi113 bash[28910]: audit 2024-04-19T23:05:41.580386+0000 mon.a (mon.0) 3790 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: audit 2024-04-19T23:05:41.446866+0000 mon.a (mon.0) 3785 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: cluster 2024-04-19T23:05:41.456498+0000 mon.a (mon.0) 3786 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: cluster 2024-04-19T23:05:41.518577+0000 mon.a (mon.0) 3787 : cluster 1 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' no longer out of quota; removing NO_QUOTA flag 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: cluster 2024-04-19T23:05:41.519014+0000 mon.a (mon.0) 3788 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: cluster 2024-04-19T23:05:41.531406+0000 mon.a (mon.0) 3789 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: audit 2024-04-19T23:05:41.579769+0000 mon.c (mon.2) 979 : audit 1 from='client.? 172.21.15.113:0/2268531660' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:42 smithi178 bash[23441]: audit 2024-04-19T23:05:41.580386+0000 mon.a (mon.0) 3790 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:05:42.900 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:42.900+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12} v 0) -- 0x7f040c068660 con 0x7f040c073b10 2024-04-19T23:05:43.544 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.540+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]=0 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' created v796) ==== 176+0+0 (secure 0 0 0) 0x7f040c068660 con 0x7f040c073b10 2024-04-19T23:05:43.660 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.656+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12} v 0) -- 0x7f040c1a8d60 con 0x7f040c073b10 2024-04-19T23:05:43.660 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04037fe640 1 -- 172.21.15.113:0/1670794560 <== mon.0 v2:172.21.15.113:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]=0 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' already exists v796) ==== 183+0+0 (secure 0 0 0) 0x7f03fc0f5510 con 0x7f040c073b10 2024-04-19T23:05:43.660 INFO:tasks.workunit.client.0.smithi113.stderr:pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' already exists 2024-04-19T23:05:43.662 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 msgr2=0x7f03f80704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 0x7f03f80704e0 secure :-1 s=READY pgs=3139 cs=0 l=1 rev1=1 crypto rx=0x7f040c0fef20 tx=0x7f0404007600 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 msgr2=0x7f040c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f03fc01cde0 tx=0x7f03fc0044e0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 shutdown_connections 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> v2:172.21.15.113:6800/3719359025 conn(0x7f03f806e020 0x7f03f80704e0 unknown :-1 s=CLOSED pgs=3139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f040c10dfc0 0x7f040c1a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f040c074430 0x7f040c19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 --2- 172.21.15.113:0/1670794560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c073b10 0x7f040c19c010 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 >> 172.21.15.113:0/1670794560 conn(0x7f040c0fd250 msgr2=0x7f040c10f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 shutdown_connections 2024-04-19T23:05:43.663 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.660+0000 7f04108de640 1 -- 172.21.15.113:0/1670794560 wait complete. 2024-04-19T23:05:43.677 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool application enable 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f rados 2024-04-19T23:05:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[28910]: cluster 2024-04-19T23:05:42.322469+0000 mgr.y (mgr.24389) 780 : cluster 0 pgmap v1311: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[28910]: audit 2024-04-19T23:05:42.524994+0000 mon.a (mon.0) 3791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[28910]: cluster 2024-04-19T23:05:42.533257+0000 mon.a (mon.0) 3792 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-04-19T23:05:43.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[28910]: audit 2024-04-19T23:05:42.903225+0000 mon.a (mon.0) 3793 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:43.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[21528]: cluster 2024-04-19T23:05:42.322469+0000 mgr.y (mgr.24389) 780 : cluster 0 pgmap v1311: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[21528]: audit 2024-04-19T23:05:42.524994+0000 mon.a (mon.0) 3791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[21528]: cluster 2024-04-19T23:05:42.533257+0000 mon.a (mon.0) 3792 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-04-19T23:05:43.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:43 smithi113 bash[21528]: audit 2024-04-19T23:05:42.903225+0000 mon.a (mon.0) 3793 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:43.800 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- 172.21.15.113:0/237416170 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f649410df40 msgr2=0x7f6494110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- 172.21.15.113:0/237416170 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f649410df40 0x7f6494110390 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f648c009bf0 tx=0x7f648c01cb30 comp rx=0 tx=0).stop 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- 172.21.15.113:0/237416170 shutdown_connections 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- 172.21.15.113:0/237416170 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f649410df40 0x7f6494110390 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- 172.21.15.113:0/237416170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 0x7f649410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- 172.21.15.113:0/237416170 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6494073c20 0x7f6494074000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- 172.21.15.113:0/237416170 >> 172.21.15.113:0/237416170 conn(0x7f64940fd250 msgr2=0x7f64940ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- 172.21.15.113:0/237416170 shutdown_connections 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- 172.21.15.113:0/237416170 wait complete. 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 Processor -- start 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- start start 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 0x7f649419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:43.801 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 0x7f64941a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6494115bb0 con 0x7f6494073c20 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6494115a30 con 0x7f6494074540 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6499231640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f6494115d30 con 0x7f649410df40 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6492d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 0x7f64941a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6492d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49730/0 (socket says 172.21.15.113:49730) 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6492d9d640 1 -- 172.21.15.113:0/152702327 learned_addr learned my addr 172.21.15.113:0/152702327 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649259c640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 0x7f649419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 -- 172.21.15.113:0/152702327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 msgr2=0x7f649419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 0x7f649419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 -- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 msgr2=0x7f649419bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64941a0fa0 con 0x7f649410df40 2024-04-19T23:05:43.802 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f6492d9d640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f649359e640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 0x7f64941a08c0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f648c01c960 tx=0x7f648c0a5b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0ba020 con 0x7f649410df40 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.796+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f648c0add60 con 0x7f649410df40 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b2040 con 0x7f649410df40 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64941a1230 con 0x7f649410df40 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64941a1690 con 0x7f649410df40 2024-04-19T23:05:43.803 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6494068660 con 0x7f649410df40 2024-04-19T23:05:43.804 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f648c0bd020 con 0x7f649410df40 2024-04-19T23:05:43.804 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f647bfff640 1 --2- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 0x7f647c0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:43.804 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(796..796 src has 276..796) ==== 8031+0+0 (secure 0 0 0) 0x7f648c129130 con 0x7f649410df40 2024-04-19T23:05:43.805 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f6492d9d640 1 --2- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 0x7f647c0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:43.805 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.800+0000 7f6492d9d640 1 --2- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 0x7f647c0704e0 secure :-1 s=READY pgs=3140 cs=0 l=1 rev1=1 crypto rx=0x7f64880096c0 tx=0x7f6488009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:43 smithi178 bash[23441]: cluster 2024-04-19T23:05:42.322469+0000 mgr.y (mgr.24389) 780 : cluster 0 pgmap v1311: 176 pgs: 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:05:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:43 smithi178 bash[23441]: audit 2024-04-19T23:05:42.524994+0000 mon.a (mon.0) 3791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:05:43.805 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:43 smithi178 bash[23441]: cluster 2024-04-19T23:05:42.533257+0000 mon.a (mon.0) 3792 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-04-19T23:05:43.806 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:43 smithi178 bash[23441]: audit 2024-04-19T23:05:42.903225+0000 mon.a (mon.0) 3793 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:43.807 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.804+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f648c0c4020 con 0x7f649410df40 2024-04-19T23:05:43.983 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:43.980+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"} v 0) -- 0x7f64941a8b70 con 0x7f649410df40 2024-04-19T23:05:44.566 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:44.564+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]=0 enabled application 'rados' on pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' v797) ==== 213+0+0 (secure 0 0 0) 0x7f648c0167b0 con 0x7f649410df40 2024-04-19T23:05:44.685 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:44.684+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"} v 0) -- 0x7f6494061dd0 con 0x7f649410df40 2024-04-19T23:05:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[21528]: audit 2024-04-19T23:05:43.545701+0000 mon.a (mon.0) 3794 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]': finished 2024-04-19T23:05:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[21528]: cluster 2024-04-19T23:05:43.552854+0000 mon.a (mon.0) 3795 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-04-19T23:05:45.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[21528]: audit 2024-04-19T23:05:43.662502+0000 mon.a (mon.0) 3796 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[21528]: audit 2024-04-19T23:05:43.985897+0000 mon.c (mon.2) 980 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[21528]: audit 2024-04-19T23:05:43.986612+0000 mon.a (mon.0) 3797 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[28910]: audit 2024-04-19T23:05:43.545701+0000 mon.a (mon.0) 3794 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]': finished 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[28910]: cluster 2024-04-19T23:05:43.552854+0000 mon.a (mon.0) 3795 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[28910]: audit 2024-04-19T23:05:43.662502+0000 mon.a (mon.0) 3796 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[28910]: audit 2024-04-19T23:05:43.985897+0000 mon.c (mon.2) 980 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:44 smithi113 bash[28910]: audit 2024-04-19T23:05:43.986612+0000 mon.a (mon.0) 3797 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:44 smithi178 bash[23441]: audit 2024-04-19T23:05:43.545701+0000 mon.a (mon.0) 3794 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]': finished 2024-04-19T23:05:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:44 smithi178 bash[23441]: cluster 2024-04-19T23:05:43.552854+0000 mon.a (mon.0) 3795 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-04-19T23:05:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:44 smithi178 bash[23441]: audit 2024-04-19T23:05:43.662502+0000 mon.a (mon.0) 3796 : audit 1 from='client.? 172.21.15.113:0/1670794560' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pg_num": 12}]: dispatch 2024-04-19T23:05:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:44 smithi178 bash[23441]: audit 2024-04-19T23:05:43.985897+0000 mon.c (mon.2) 980 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:44 smithi178 bash[23441]: audit 2024-04-19T23:05:43.986612+0000 mon.a (mon.0) 3797 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:45.567 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.564+0000 7f647bfff640 1 -- 172.21.15.113:0/152702327 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]=0 enabled application 'rados' on pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' v798) ==== 213+0+0 (secure 0 0 0) 0x7f648c0f62d0 con 0x7f649410df40 2024-04-19T23:05:45.567 INFO:tasks.workunit.client.0.smithi113.stderr:enabled application 'rados' on pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' 2024-04-19T23:05:45.571 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 msgr2=0x7f647c0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:45.571 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 0x7f647c0704e0 secure :-1 s=READY pgs=3140 cs=0 l=1 rev1=1 crypto rx=0x7f64880096c0 tx=0x7f6488009260 comp rx=0 tx=0).stop 2024-04-19T23:05:45.571 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 msgr2=0x7f64941a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:45.571 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 0x7f64941a08c0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f648c01c960 tx=0x7f648c0a5b70 comp rx=0 tx=0).stop 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 shutdown_connections 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> v2:172.21.15.113:6800/3719359025 conn(0x7f647c06e020 0x7f647c0704e0 unknown :-1 s=CLOSED pgs=3140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f649410df40 0x7f64941a08c0 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6494074540 0x7f649419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 --2- 172.21.15.113:0/152702327 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6494073c20 0x7f649419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 >> 172.21.15.113:0/152702327 conn(0x7f64940fd250 msgr2=0x7f649410f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:45.572 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.568+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 shutdown_connections 2024-04-19T23:05:45.573 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.572+0000 7f6499231640 1 -- 172.21.15.113:0/152702327 wait complete. 2024-04-19T23:05:45.593 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f max_objects 10 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/1931232315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f24107f90 msgr2=0x7f2f24108370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/1931232315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f24107f90 0x7f2f24108370 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009cb0 tx=0x7f2f1c01cca0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/1931232315 shutdown_connections 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/1931232315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f2410d0b0 0x7f2f24114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/1931232315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24108940 0x7f2f2410c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/1931232315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f24107f90 0x7f2f24108370 unknown :-1 s=CLOSED pgs=3274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/1931232315 >> 172.21.15.113:0/1931232315 conn(0x7f2f240775a0 msgr2=0x7f2f24106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:45.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/1931232315 shutdown_connections 2024-04-19T23:05:45.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/1931232315 wait complete. 2024-04-19T23:05:45.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 Processor -- start 2024-04-19T23:05:45.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- start start 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24107f90 0x7f2f241a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 0x7f2f241a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24119f80 con 0x7f2f24108940 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24119e00 con 0x7f2f24107f90 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2411a100 con 0x7f2f2410d0b0 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:54988/0 (socket says 172.21.15.113:54988) 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 -- 172.21.15.113:0/3883911017 learned_addr learned my addr 172.21.15.113:0/3883911017 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f28d68640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 0x7f2f241a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29569640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24107f90 0x7f2f241a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 -- 172.21.15.113:0/3883911017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24107f90 msgr2=0x7f2f241a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:45.717 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24107f90 0x7f2f241a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 -- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 msgr2=0x7f2f241a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 0x7f2f241a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f241a5490 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f28d68640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 0x7f2f241a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f29d6a640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e970 tx=0x7f2f2000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000ccc0 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f2f2000ce60 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f241a5780 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20010430 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.712+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241ad060 con 0x7f2f2410d0b0 2024-04-19T23:05:45.718 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24068ab0 con 0x7f2f2410d0b0 2024-04-19T23:05:45.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f2f20004ee0 con 0x7f2f2410d0b0 2024-04-19T23:05:45.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f1a7fc640 1 --2- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 0x7f2f100704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:05:45.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(798..798 src has 276..798) ==== 8044+0+0 (secure 0 0 0) 0x7f2f2008eaf0 con 0x7f2f2410d0b0 2024-04-19T23:05:45.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f29569640 1 --2- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 0x7f2f100704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:05:45.719 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.716+0000 7f2f29569640 1 --2- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 0x7f2f100704e0 secure :-1 s=READY pgs=3141 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c01d180 tx=0x7f2f1c01b4e0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:05:45.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.720+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2f2005bd00 con 0x7f2f2410d0b0 2024-04-19T23:05:45.895 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:45.892+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"} v 0) -- 0x7f2f241ad230 con 0x7f2f2410d0b0 2024-04-19T23:05:46.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: cluster 2024-04-19T23:05:44.323238+0000 mgr.y (mgr.24389) 781 : cluster 0 pgmap v1314: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: cluster 2024-04-19T23:05:44.545652+0000 mon.a (mon.0) 3798 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: audit 2024-04-19T23:05:44.557120+0000 mon.a (mon.0) 3799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: cluster 2024-04-19T23:05:44.567409+0000 mon.a (mon.0) 3800 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: audit 2024-04-19T23:05:44.687584+0000 mon.c (mon.2) 981 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[28910]: audit 2024-04-19T23:05:44.688213+0000 mon.a (mon.0) 3801 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: cluster 2024-04-19T23:05:44.323238+0000 mgr.y (mgr.24389) 781 : cluster 0 pgmap v1314: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: cluster 2024-04-19T23:05:44.545652+0000 mon.a (mon.0) 3798 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: audit 2024-04-19T23:05:44.557120+0000 mon.a (mon.0) 3799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: cluster 2024-04-19T23:05:44.567409+0000 mon.a (mon.0) 3800 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: audit 2024-04-19T23:05:44.687584+0000 mon.c (mon.2) 981 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:45 smithi113 bash[21528]: audit 2024-04-19T23:05:44.688213+0000 mon.a (mon.0) 3801 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: cluster 2024-04-19T23:05:44.323238+0000 mgr.y (mgr.24389) 781 : cluster 0 pgmap v1314: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: cluster 2024-04-19T23:05:44.545652+0000 mon.a (mon.0) 3798 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: audit 2024-04-19T23:05:44.557120+0000 mon.a (mon.0) 3799 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: cluster 2024-04-19T23:05:44.567409+0000 mon.a (mon.0) 3800 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: audit 2024-04-19T23:05:44.687584+0000 mon.c (mon.2) 981 : audit 1 from='client.? 172.21.15.113:0/152702327' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:45 smithi178 bash[23441]: audit 2024-04-19T23:05:44.688213+0000 mon.a (mon.0) 3801 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]: dispatch 2024-04-19T23:05:46.599 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:46.596+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f v799) ==== 223+0+0 (secure 0 0 0) 0x7f2f2005f9b0 con 0x7f2f2410d0b0 2024-04-19T23:05:46.707 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:46.704+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"} v 0) -- 0x7f2f241ad480 con 0x7f2f2410d0b0 2024-04-19T23:05:47.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[28910]: audit 2024-04-19T23:05:45.560181+0000 mon.a (mon.0) 3802 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:47.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[28910]: cluster 2024-04-19T23:05:45.568676+0000 mon.a (mon.0) 3803 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[28910]: audit 2024-04-19T23:05:45.700155+0000 mgr.y (mgr.24389) 782 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[28910]: audit 2024-04-19T23:05:45.897984+0000 mon.c (mon.2) 982 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[28910]: audit 2024-04-19T23:05:45.898504+0000 mon.a (mon.0) 3804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[21528]: audit 2024-04-19T23:05:45.560181+0000 mon.a (mon.0) 3802 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[21528]: cluster 2024-04-19T23:05:45.568676+0000 mon.a (mon.0) 3803 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[21528]: audit 2024-04-19T23:05:45.700155+0000 mgr.y (mgr.24389) 782 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[21528]: audit 2024-04-19T23:05:45.897984+0000 mon.c (mon.2) 982 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:46 smithi113 bash[21528]: audit 2024-04-19T23:05:45.898504+0000 mon.a (mon.0) 3804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:46 smithi178 bash[23441]: audit 2024-04-19T23:05:45.560181+0000 mon.a (mon.0) 3802 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "app": "rados"}]': finished 2024-04-19T23:05:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:46 smithi178 bash[23441]: cluster 2024-04-19T23:05:45.568676+0000 mon.a (mon.0) 3803 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-04-19T23:05:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:46 smithi178 bash[23441]: audit 2024-04-19T23:05:45.700155+0000 mgr.y (mgr.24389) 782 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:46 smithi178 bash[23441]: audit 2024-04-19T23:05:45.897984+0000 mon.c (mon.2) 982 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:46 smithi178 bash[23441]: audit 2024-04-19T23:05:45.898504+0000 mon.a (mon.0) 3804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.600 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.596+0000 7f2f1a7fc640 1 -- 172.21.15.113:0/3883911017 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f v800) ==== 223+0+0 (secure 0 0 0) 0x7f2f200641e0 con 0x7f2f2410d0b0 2024-04-19T23:05:47.600 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_objects = 10 for pool 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 msgr2=0x7f2f100704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 0x7f2f100704e0 secure :-1 s=READY pgs=3141 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c01d180 tx=0x7f2f1c01b4e0 comp rx=0 tx=0).stop 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 msgr2=0x7f2f241a4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e970 tx=0x7f2f2000ee30 comp rx=0 tx=0).stop 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 shutdown_connections 2024-04-19T23:05:47.604 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> v2:172.21.15.113:6800/3719359025 conn(0x7f2f1006e020 0x7f2f100704e0 unknown :-1 s=CLOSED pgs=3141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2f2410d0b0 0x7f2f241a4db0 unknown :-1 s=CLOSED pgs=3275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f24108940 0x7f2f241a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 --2- 172.21.15.113:0/3883911017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f24107f90 0x7f2f241a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 >> 172.21.15.113:0/3883911017 conn(0x7f2f240775a0 msgr2=0x7f2f24077980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 shutdown_connections 2024-04-19T23:05:47.605 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:05:47.604+0000 7f2f2b7cd640 1 -- 172.21.15.113:0/3883911017 wait complete. 2024-04-19T23:05:47.625 INFO:tasks.workunit.client.0.smithi113.stderr:+ sleep 30 2024-04-19T23:05:47.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:47.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[28910]: cluster 2024-04-19T23:05:46.324039+0000 mgr.y (mgr.24389) 783 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[28910]: audit 2024-04-19T23:05:46.591191+0000 mon.a (mon.0) 3805 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[28910]: cluster 2024-04-19T23:05:46.601440+0000 mon.a (mon.0) 3806 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[28910]: audit 2024-04-19T23:05:46.710093+0000 mon.c (mon.2) 983 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[28910]: audit 2024-04-19T23:05:46.710806+0000 mon.a (mon.0) 3807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21528]: cluster 2024-04-19T23:05:46.324039+0000 mgr.y (mgr.24389) 783 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21528]: audit 2024-04-19T23:05:46.591191+0000 mon.a (mon.0) 3805 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21528]: cluster 2024-04-19T23:05:46.601440+0000 mon.a (mon.0) 3806 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21528]: audit 2024-04-19T23:05:46.710093+0000 mon.c (mon.2) 983 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:47.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:47 smithi113 bash[21528]: audit 2024-04-19T23:05:46.710806+0000 mon.a (mon.0) 3807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:47 smithi178 bash[23441]: cluster 2024-04-19T23:05:46.324039+0000 mgr.y (mgr.24389) 783 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:48.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:47 smithi178 bash[23441]: audit 2024-04-19T23:05:46.591191+0000 mon.a (mon.0) 3805 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:47 smithi178 bash[23441]: cluster 2024-04-19T23:05:46.601440+0000 mon.a (mon.0) 3806 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-04-19T23:05:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:47 smithi178 bash[23441]: audit 2024-04-19T23:05:46.710093+0000 mon.c (mon.2) 983 : audit 1 from='client.? 172.21.15.113:0/3883911017' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:48.055 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:47 smithi178 bash[23441]: audit 2024-04-19T23:05:46.710806+0000 mon.a (mon.0) 3807 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]: dispatch 2024-04-19T23:05:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:48 smithi113 bash[28910]: audit 2024-04-19T23:05:47.593781+0000 mon.a (mon.0) 3808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:48 smithi113 bash[28910]: cluster 2024-04-19T23:05:47.601220+0000 mon.a (mon.0) 3809 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-04-19T23:05:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:48 smithi113 bash[21528]: audit 2024-04-19T23:05:47.593781+0000 mon.a (mon.0) 3808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:48 smithi113 bash[21528]: cluster 2024-04-19T23:05:47.601220+0000 mon.a (mon.0) 3809 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-04-19T23:05:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:48 smithi178 bash[23441]: audit 2024-04-19T23:05:47.593781+0000 mon.a (mon.0) 3808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "field": "max_objects", "val": "10"}]': finished 2024-04-19T23:05:49.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:48 smithi178 bash[23441]: cluster 2024-04-19T23:05:47.601220+0000 mon.a (mon.0) 3809 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-04-19T23:05:50.049 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:49 smithi113 bash[21528]: cluster 2024-04-19T23:05:48.324794+0000 mgr.y (mgr.24389) 784 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:50.050 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:49 smithi113 bash[28910]: cluster 2024-04-19T23:05:48.324794+0000 mgr.y (mgr.24389) 784 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:49 smithi178 bash[23441]: cluster 2024-04-19T23:05:48.324794+0000 mgr.y (mgr.24389) 784 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-04-19T23:05:51.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[21528]: cluster 2024-04-19T23:05:50.326765+0000 mgr.y (mgr.24389) 785 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-19T23:05:51.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[21528]: audit 2024-04-19T23:05:50.389953+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:51.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[21528]: audit 2024-04-19T23:05:50.392360+0000 mon.a (mon.0) 3811 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:51.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[28910]: cluster 2024-04-19T23:05:50.326765+0000 mgr.y (mgr.24389) 785 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-19T23:05:51.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[28910]: audit 2024-04-19T23:05:50.389953+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:51.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:51 smithi113 bash[28910]: audit 2024-04-19T23:05:50.392360+0000 mon.a (mon.0) 3811 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:51.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:51 smithi178 bash[23441]: cluster 2024-04-19T23:05:50.326765+0000 mgr.y (mgr.24389) 785 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-19T23:05:51.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:51 smithi178 bash[23441]: audit 2024-04-19T23:05:50.389953+0000 mon.a (mon.0) 3810 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:05:51.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:51 smithi178 bash[23441]: audit 2024-04-19T23:05:50.392360+0000 mon.a (mon.0) 3811 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:05:52.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:52 smithi113 bash[28910]: cluster 2024-04-19T23:05:51.521974+0000 mon.a (mon.0) 3812 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:52.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:52 smithi113 bash[21528]: cluster 2024-04-19T23:05:51.521974+0000 mon.a (mon.0) 3812 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:52.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:52 smithi178 bash[23441]: cluster 2024-04-19T23:05:51.521974+0000 mon.a (mon.0) 3812 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-19T23:05:53.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:53 smithi113 bash[28910]: cluster 2024-04-19T23:05:52.327642+0000 mgr.y (mgr.24389) 786 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 0 op/s 2024-04-19T23:05:53.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:53 smithi113 bash[21528]: cluster 2024-04-19T23:05:52.327642+0000 mgr.y (mgr.24389) 786 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 0 op/s 2024-04-19T23:05:53.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:53 smithi178 bash[23441]: cluster 2024-04-19T23:05:52.327642+0000 mgr.y (mgr.24389) 786 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 756 B/s rd, 0 op/s 2024-04-19T23:05:55.708 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:55 smithi178 bash[23441]: cluster 2024-04-19T23:05:54.328483+0000 mgr.y (mgr.24389) 787 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:05:55.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:55 smithi113 bash[21528]: cluster 2024-04-19T23:05:54.328483+0000 mgr.y (mgr.24389) 787 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:05:55.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:55 smithi113 bash[28910]: cluster 2024-04-19T23:05:54.328483+0000 mgr.y (mgr.24389) 787 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:05:56.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:05:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:05:56.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:56 smithi113 bash[21528]: audit 2024-04-19T23:05:55.709718+0000 mgr.y (mgr.24389) 788 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:56.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:56 smithi113 bash[28910]: audit 2024-04-19T23:05:55.709718+0000 mgr.y (mgr.24389) 788 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:56.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:56 smithi178 bash[23441]: audit 2024-04-19T23:05:55.709718+0000 mgr.y (mgr.24389) 788 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:05:57.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:57 smithi113 bash[28910]: cluster 2024-04-19T23:05:56.330462+0000 mgr.y (mgr.24389) 789 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:05:57.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:57 smithi113 bash[21528]: cluster 2024-04-19T23:05:56.330462+0000 mgr.y (mgr.24389) 789 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:05:57.798 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:05:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:05:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:05:57.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:57 smithi178 bash[23441]: cluster 2024-04-19T23:05:56.330462+0000 mgr.y (mgr.24389) 789 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:05:59.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:05:59 smithi113 bash[21528]: cluster 2024-04-19T23:05:58.331239+0000 mgr.y (mgr.24389) 790 : cluster 0 pgmap v1325: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-04-19T23:05:59.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:05:59 smithi113 bash[28910]: cluster 2024-04-19T23:05:58.331239+0000 mgr.y (mgr.24389) 790 : cluster 0 pgmap v1325: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-04-19T23:05:59.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:05:59 smithi178 bash[23441]: cluster 2024-04-19T23:05:58.331239+0000 mgr.y (mgr.24389) 790 : cluster 0 pgmap v1325: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-04-19T23:06:01.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:01 smithi113 bash[28910]: cluster 2024-04-19T23:06:00.333156+0000 mgr.y (mgr.24389) 791 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:01.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:01 smithi113 bash[21528]: cluster 2024-04-19T23:06:00.333156+0000 mgr.y (mgr.24389) 791 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:01.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:01 smithi178 bash[23441]: cluster 2024-04-19T23:06:00.333156+0000 mgr.y (mgr.24389) 791 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:03.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:03 smithi113 bash[21528]: cluster 2024-04-19T23:06:02.333976+0000 mgr.y (mgr.24389) 792 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:03.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:03 smithi113 bash[28910]: cluster 2024-04-19T23:06:02.333976+0000 mgr.y (mgr.24389) 792 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:03.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:03 smithi178 bash[23441]: cluster 2024-04-19T23:06:02.333976+0000 mgr.y (mgr.24389) 792 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:05.720 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:05 smithi178 bash[23441]: cluster 2024-04-19T23:06:04.334778+0000 mgr.y (mgr.24389) 793 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:05.720 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:05 smithi178 bash[23441]: audit 2024-04-19T23:06:05.424743+0000 mon.a (mon.0) 3813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:05 smithi113 bash[28910]: cluster 2024-04-19T23:06:04.334778+0000 mgr.y (mgr.24389) 793 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:05.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:05 smithi113 bash[28910]: audit 2024-04-19T23:06:05.424743+0000 mon.a (mon.0) 3813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:05 smithi113 bash[21528]: cluster 2024-04-19T23:06:04.334778+0000 mgr.y (mgr.24389) 793 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:05.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:05 smithi113 bash[21528]: audit 2024-04-19T23:06:05.424743+0000 mon.a (mon.0) 3813 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:06.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:06.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:06 smithi113 bash[21528]: audit 2024-04-19T23:06:05.721322+0000 mgr.y (mgr.24389) 794 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:06.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:06 smithi113 bash[28910]: audit 2024-04-19T23:06:05.721322+0000 mgr.y (mgr.24389) 794 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:06.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:06 smithi178 bash[23441]: audit 2024-04-19T23:06:05.721322+0000 mgr.y (mgr.24389) 794 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:07.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:07 smithi113 bash[21528]: cluster 2024-04-19T23:06:06.336764+0000 mgr.y (mgr.24389) 795 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:07.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:07 smithi113 bash[21528]: audit 2024-04-19T23:06:06.749641+0000 mon.a (mon.0) 3814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:06:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:07 smithi113 bash[28910]: cluster 2024-04-19T23:06:06.336764+0000 mgr.y (mgr.24389) 795 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:07.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:07 smithi113 bash[28910]: audit 2024-04-19T23:06:06.749641+0000 mon.a (mon.0) 3814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:06:07.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:07 smithi178 bash[23441]: cluster 2024-04-19T23:06:06.336764+0000 mgr.y (mgr.24389) 795 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:07.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:07 smithi178 bash[23441]: audit 2024-04-19T23:06:06.749641+0000 mon.a (mon.0) 3814 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:06:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[28910]: audit 2024-04-19T23:06:07.529085+0000 mon.a (mon.0) 3815 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:06:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[28910]: audit 2024-04-19T23:06:07.530908+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:06:08.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[28910]: audit 2024-04-19T23:06:07.540877+0000 mon.a (mon.0) 3817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[21528]: audit 2024-04-19T23:06:07.529085+0000 mon.a (mon.0) 3815 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:06:08.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[21528]: audit 2024-04-19T23:06:07.530908+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:06:08.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:08 smithi113 bash[21528]: audit 2024-04-19T23:06:07.540877+0000 mon.a (mon.0) 3817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:08.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:08 smithi178 bash[23441]: audit 2024-04-19T23:06:07.529085+0000 mon.a (mon.0) 3815 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:06:08.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:08 smithi178 bash[23441]: audit 2024-04-19T23:06:07.530908+0000 mon.a (mon.0) 3816 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:06:08.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:08 smithi178 bash[23441]: audit 2024-04-19T23:06:07.540877+0000 mon.a (mon.0) 3817 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:09.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:09 smithi113 bash[21528]: cluster 2024-04-19T23:06:08.337556+0000 mgr.y (mgr.24389) 796 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:09.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:09 smithi113 bash[28910]: cluster 2024-04-19T23:06:08.337556+0000 mgr.y (mgr.24389) 796 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:09.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:09 smithi178 bash[23441]: cluster 2024-04-19T23:06:08.337556+0000 mgr.y (mgr.24389) 796 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:11 smithi113 bash[21528]: cluster 2024-04-19T23:06:10.339492+0000 mgr.y (mgr.24389) 797 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:11.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:11 smithi113 bash[28910]: cluster 2024-04-19T23:06:10.339492+0000 mgr.y (mgr.24389) 797 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:11.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:11 smithi178 bash[23441]: cluster 2024-04-19T23:06:10.339492+0000 mgr.y (mgr.24389) 797 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:13.817 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:13 smithi178 bash[23441]: cluster 2024-04-19T23:06:12.340267+0000 mgr.y (mgr.24389) 798 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:14.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:13 smithi113 bash[28910]: cluster 2024-04-19T23:06:12.340267+0000 mgr.y (mgr.24389) 798 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:14.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:13 smithi113 bash[21528]: cluster 2024-04-19T23:06:12.340267+0000 mgr.y (mgr.24389) 798 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:15.804 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:15.804 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:15 smithi178 bash[23441]: cluster 2024-04-19T23:06:14.341018+0000 mgr.y (mgr.24389) 799 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:16.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:15 smithi113 bash[28910]: cluster 2024-04-19T23:06:14.341018+0000 mgr.y (mgr.24389) 799 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:16.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:15 smithi113 bash[21528]: cluster 2024-04-19T23:06:14.341018+0000 mgr.y (mgr.24389) 799 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:17.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:16 smithi113 bash[28910]: audit 2024-04-19T23:06:15.729750+0000 mgr.y (mgr.24389) 800 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:17.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:16 smithi113 bash[21528]: audit 2024-04-19T23:06:15.729750+0000 mgr.y (mgr.24389) 800 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:17.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:16 smithi178 bash[23441]: audit 2024-04-19T23:06:15.729750+0000 mgr.y (mgr.24389) 800 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:17.627 INFO:tasks.workunit.client.0.smithi113.stderr:+ seq 1 10 2024-04-19T23:06:17.628 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj1 /etc/passwd 2024-04-19T23:06:17.675 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj2 /etc/passwd 2024-04-19T23:06:17.715 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj3 /etc/passwd 2024-04-19T23:06:17.753 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj4 /etc/passwd 2024-04-19T23:06:17.791 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj5 /etc/passwd 2024-04-19T23:06:17.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:17.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:17 smithi113 bash[28910]: cluster 2024-04-19T23:06:16.343009+0000 mgr.y (mgr.24389) 801 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:17.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:17 smithi113 bash[21528]: cluster 2024-04-19T23:06:16.343009+0000 mgr.y (mgr.24389) 801 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:17.829 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj6 /etc/passwd 2024-04-19T23:06:17.867 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj7 /etc/passwd 2024-04-19T23:06:17.903 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj8 /etc/passwd 2024-04-19T23:06:17.940 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj9 /etc/passwd 2024-04-19T23:06:17.979 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f put obj10 /etc/passwd 2024-04-19T23:06:18.017 INFO:tasks.workunit.client.0.smithi113.stderr:+ sleep 30 2024-04-19T23:06:18.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:17 smithi178 bash[23441]: cluster 2024-04-19T23:06:16.343009+0000 mgr.y (mgr.24389) 801 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:20.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:19 smithi113 bash[21528]: cluster 2024-04-19T23:06:18.343748+0000 mgr.y (mgr.24389) 802 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:20.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:19 smithi113 bash[28910]: cluster 2024-04-19T23:06:18.343748+0000 mgr.y (mgr.24389) 802 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:20.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:19 smithi178 bash[23441]: cluster 2024-04-19T23:06:18.343748+0000 mgr.y (mgr.24389) 802 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 747 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:21.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:20 smithi113 bash[21528]: audit 2024-04-19T23:06:20.458409+0000 mon.a (mon.0) 3818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:21.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:20 smithi113 bash[28910]: audit 2024-04-19T23:06:20.458409+0000 mon.a (mon.0) 3818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:21.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:20 smithi178 bash[23441]: audit 2024-04-19T23:06:20.458409+0000 mon.a (mon.0) 3818 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[21528]: cluster 2024-04-19T23:06:20.345711+0000 mgr.y (mgr.24389) 803 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[21528]: cluster 2024-04-19T23:06:21.528884+0000 mon.a (mon.0) 3819 : cluster 3 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' is full (reached quota's max_objects: 10) 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[21528]: cluster 2024-04-19T23:06:21.529366+0000 mon.a (mon.0) 3820 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[21528]: cluster 2024-04-19T23:06:21.540196+0000 mon.a (mon.0) 3821 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[28910]: cluster 2024-04-19T23:06:20.345711+0000 mgr.y (mgr.24389) 803 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[28910]: cluster 2024-04-19T23:06:21.528884+0000 mon.a (mon.0) 3819 : cluster 3 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' is full (reached quota's max_objects: 10) 2024-04-19T23:06:22.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[28910]: cluster 2024-04-19T23:06:21.529366+0000 mon.a (mon.0) 3820 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:06:22.048 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:21 smithi113 bash[28910]: cluster 2024-04-19T23:06:21.540196+0000 mon.a (mon.0) 3821 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-04-19T23:06:22.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:21 smithi178 bash[23441]: cluster 2024-04-19T23:06:20.345711+0000 mgr.y (mgr.24389) 803 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-04-19T23:06:22.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:21 smithi178 bash[23441]: cluster 2024-04-19T23:06:21.528884+0000 mon.a (mon.0) 3819 : cluster 3 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' is full (reached quota's max_objects: 10) 2024-04-19T23:06:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:21 smithi178 bash[23441]: cluster 2024-04-19T23:06:21.529366+0000 mon.a (mon.0) 3820 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-04-19T23:06:22.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:21 smithi178 bash[23441]: cluster 2024-04-19T23:06:21.540196+0000 mon.a (mon.0) 3821 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-04-19T23:06:24.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:23 smithi113 bash[21528]: cluster 2024-04-19T23:06:22.346550+0000 mgr.y (mgr.24389) 804 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:24.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:23 smithi113 bash[28910]: cluster 2024-04-19T23:06:22.346550+0000 mgr.y (mgr.24389) 804 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:24.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:23 smithi178 bash[23441]: cluster 2024-04-19T23:06:22.346550+0000 mgr.y (mgr.24389) 804 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:26.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:25 smithi113 bash[21528]: cluster 2024-04-19T23:06:24.347335+0000 mgr.y (mgr.24389) 805 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:26.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:25 smithi113 bash[28910]: cluster 2024-04-19T23:06:24.347335+0000 mgr.y (mgr.24389) 805 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:26.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:26.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:25 smithi178 bash[23441]: cluster 2024-04-19T23:06:24.347335+0000 mgr.y (mgr.24389) 805 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 864 KiB data, 712 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:27.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:26 smithi113 bash[21528]: audit 2024-04-19T23:06:25.738037+0000 mgr.y (mgr.24389) 806 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:27.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:26 smithi113 bash[28910]: audit 2024-04-19T23:06:25.738037+0000 mgr.y (mgr.24389) 806 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:27.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:26 smithi178 bash[23441]: audit 2024-04-19T23:06:25.738037+0000 mgr.y (mgr.24389) 806 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:27.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:27.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:27 smithi113 bash[28910]: cluster 2024-04-19T23:06:26.349379+0000 mgr.y (mgr.24389) 807 : cluster 0 pgmap v1340: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:27.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:27 smithi113 bash[21528]: cluster 2024-04-19T23:06:26.349379+0000 mgr.y (mgr.24389) 807 : cluster 0 pgmap v1340: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:28.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:27 smithi178 bash[23441]: cluster 2024-04-19T23:06:26.349379+0000 mgr.y (mgr.24389) 807 : cluster 0 pgmap v1340: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:30.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:29 smithi113 bash[28910]: cluster 2024-04-19T23:06:28.350333+0000 mgr.y (mgr.24389) 808 : cluster 0 pgmap v1341: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:30.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:29 smithi113 bash[21528]: cluster 2024-04-19T23:06:28.350333+0000 mgr.y (mgr.24389) 808 : cluster 0 pgmap v1341: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:30.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:29 smithi178 bash[23441]: cluster 2024-04-19T23:06:28.350333+0000 mgr.y (mgr.24389) 808 : cluster 0 pgmap v1341: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-04-19T23:06:32.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:31 smithi113 bash[28910]: cluster 2024-04-19T23:06:30.352379+0000 mgr.y (mgr.24389) 809 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:06:32.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:31 smithi113 bash[21528]: cluster 2024-04-19T23:06:30.352379+0000 mgr.y (mgr.24389) 809 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:06:32.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:31 smithi178 bash[23441]: cluster 2024-04-19T23:06:30.352379+0000 mgr.y (mgr.24389) 809 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-04-19T23:06:34.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:33 smithi113 bash[21528]: cluster 2024-04-19T23:06:32.353323+0000 mgr.y (mgr.24389) 810 : cluster 0 pgmap v1343: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-04-19T23:06:34.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:33 smithi113 bash[28910]: cluster 2024-04-19T23:06:32.353323+0000 mgr.y (mgr.24389) 810 : cluster 0 pgmap v1343: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-04-19T23:06:34.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:33 smithi178 bash[23441]: cluster 2024-04-19T23:06:32.353323+0000 mgr.y (mgr.24389) 810 : cluster 0 pgmap v1343: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[21528]: cluster 2024-04-19T23:06:34.354264+0000 mgr.y (mgr.24389) 811 : cluster 0 pgmap v1344: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[21528]: audit 2024-04-19T23:06:35.497055+0000 mon.a (mon.0) 3822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[21528]: audit 2024-04-19T23:06:35.499759+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[28910]: cluster 2024-04-19T23:06:34.354264+0000 mgr.y (mgr.24389) 811 : cluster 0 pgmap v1344: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[28910]: audit 2024-04-19T23:06:35.497055+0000 mon.a (mon.0) 3822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:36.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:35 smithi113 bash[28910]: audit 2024-04-19T23:06:35.499759+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:36.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:35 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:35 smithi178 bash[23441]: cluster 2024-04-19T23:06:34.354264+0000 mgr.y (mgr.24389) 811 : cluster 0 pgmap v1344: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:36.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:35 smithi178 bash[23441]: audit 2024-04-19T23:06:35.497055+0000 mon.a (mon.0) 3822 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:06:36.054 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:35 smithi178 bash[23441]: audit 2024-04-19T23:06:35.499759+0000 mon.a (mon.0) 3823 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:37.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:36 smithi113 bash[21528]: audit 2024-04-19T23:06:35.747650+0000 mgr.y (mgr.24389) 812 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:37.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:36 smithi113 bash[28910]: audit 2024-04-19T23:06:35.747650+0000 mgr.y (mgr.24389) 812 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:37.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:36 smithi178 bash[23441]: audit 2024-04-19T23:06:35.747650+0000 mgr.y (mgr.24389) 812 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:37.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:37 smithi113 bash[21528]: cluster 2024-04-19T23:06:36.356407+0000 mgr.y (mgr.24389) 813 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:37.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:37 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:37] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:37.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:37 smithi113 bash[28910]: cluster 2024-04-19T23:06:36.356407+0000 mgr.y (mgr.24389) 813 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:38.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:37 smithi178 bash[23441]: cluster 2024-04-19T23:06:36.356407+0000 mgr.y (mgr.24389) 813 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:40.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:39 smithi113 bash[21528]: cluster 2024-04-19T23:06:38.357368+0000 mgr.y (mgr.24389) 814 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:40.061 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:39 smithi113 bash[28910]: cluster 2024-04-19T23:06:38.357368+0000 mgr.y (mgr.24389) 814 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:40.061 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:39 smithi178 bash[23441]: cluster 2024-04-19T23:06:38.357368+0000 mgr.y (mgr.24389) 814 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:42.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:41 smithi113 bash[28910]: cluster 2024-04-19T23:06:40.359333+0000 mgr.y (mgr.24389) 815 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:42.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:41 smithi113 bash[21528]: cluster 2024-04-19T23:06:40.359333+0000 mgr.y (mgr.24389) 815 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:42.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:41 smithi178 bash[23441]: cluster 2024-04-19T23:06:40.359333+0000 mgr.y (mgr.24389) 815 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:44.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:43 smithi113 bash[28910]: cluster 2024-04-19T23:06:42.360120+0000 mgr.y (mgr.24389) 816 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:44.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:43 smithi113 bash[21528]: cluster 2024-04-19T23:06:42.360120+0000 mgr.y (mgr.24389) 816 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:44.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:43 smithi178 bash[23441]: cluster 2024-04-19T23:06:42.360120+0000 mgr.y (mgr.24389) 816 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:46.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:45 smithi113 bash[28910]: cluster 2024-04-19T23:06:44.360904+0000 mgr.y (mgr.24389) 817 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:46.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:45 smithi113 bash[21528]: cluster 2024-04-19T23:06:44.360904+0000 mgr.y (mgr.24389) 817 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:46.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:45 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:46.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:45 smithi178 bash[23441]: cluster 2024-04-19T23:06:44.360904+0000 mgr.y (mgr.24389) 817 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:47.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:46 smithi113 bash[21528]: audit 2024-04-19T23:06:45.759032+0000 mgr.y (mgr.24389) 818 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:47.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:46 smithi113 bash[28910]: audit 2024-04-19T23:06:45.759032+0000 mgr.y (mgr.24389) 818 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:47.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:46 smithi178 bash[23441]: audit 2024-04-19T23:06:45.759032+0000 mgr.y (mgr.24389) 818 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:47.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:47 smithi113 bash[21528]: cluster 2024-04-19T23:06:46.362830+0000 mgr.y (mgr.24389) 819 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:47.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:47 smithi113 bash[28910]: cluster 2024-04-19T23:06:46.362830+0000 mgr.y (mgr.24389) 819 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:47.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:47 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:47] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:48.018 INFO:tasks.workunit.client.0.smithi113.stderr:+ rados -p 46f4c55d-95df-4d19-ae41-b63f718ffdb6 put threemore /etc/passwd 2024-04-19T23:06:48.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:47 smithi178 bash[23441]: cluster 2024-04-19T23:06:46.362830+0000 mgr.y (mgr.24389) 819 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:06:48.066 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_bytes 0 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/1303842307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc107710 msgr2=0x7fc3bc107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/1303842307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc107710 0x7fc3bc107af0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0098a0 tx=0x7fc3ac01c700 comp rx=0 tx=0).stop 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/1303842307 shutdown_connections 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/1303842307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc10e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/1303842307 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc101710 0x7fc3bc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/1303842307 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc107710 0x7fc3bc107af0 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/1303842307 >> 172.21.15.113:0/1303842307 conn(0x7fc3bc0fd240 msgr2=0x7fc3bc0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/1303842307 shutdown_connections 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/1303842307 wait complete. 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 Processor -- start 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- start start 2024-04-19T23:06:48.192 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc107710 0x7fc3bc19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc113940 con 0x7fc3bc1020d0 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1137c0 con 0x7fc3bc107710 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3c0bd4640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc113ac0 con 0x7fc3bc101710 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:60956/0 (socket says 172.21.15.113:60956) 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 -- 172.21.15.113:0/4066852822 learned_addr learned my addr 172.21.15.113:0/4066852822 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3b9d9b640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 -- 172.21.15.113:0/4066852822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc107710 msgr2=0x7fc3bc19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc107710 0x7fc3bc19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 -- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 msgr2=0x7fc3bc19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:48.193 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc19ee90 con 0x7fc3bc101710 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3b9d9b640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ba59c640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0194e0 tx=0x7fc3ac0044c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.187+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac005300 con 0x7fc3bc101710 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fc3ac0a5970 con 0x7fc3bc101710 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc19f120 con 0x7fc3bc101710 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0046d0 con 0x7fc3bc101710 2024-04-19T23:06:48.194 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1a6a60 con 0x7fc3bc101710 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc102e50 con 0x7fc3bc101710 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fc3ac0c1020 con 0x7fc3bc101710 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 --2- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 0x7fc3a40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(801..801 src has 276..801) ==== 8044+0+0 (secure 0 0 0) 0x7fc3ac128e20 con 0x7fc3bc101710 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3b9d9b640 1 --2- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 0x7fc3a40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=802}) -- 0x7fc3a4079b00 con 0x7fc3bc101710 2024-04-19T23:06:48.195 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.191+0000 7fc3b9d9b640 1 --2- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 0x7fc3a40704e0 secure :-1 s=READY pgs=3153 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00096c0 tx=0x7fc3b0009260 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:06:48.198 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.195+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc3ac0c8060 con 0x7fc3bc101710 2024-04-19T23:06:48.374 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.371+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc3bc068ab0 con 0x7fc3bc101710 2024-04-19T23:06:48.689 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.687+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 7 ==== osd_map(802..802 src has 276..802) ==== 628+0+0 (secure 0 0 0) 0x7fc3ac126b40 con 0x7fc3bc101710 2024-04-19T23:06:48.689 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.687+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=803}) -- 0x7fc3a407a6b0 con 0x7fc3bc101710 2024-04-19T23:06:48.696 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.695+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v802) ==== 217+0+0 (secure 0 0 0) 0x7fc3ac016410 con 0x7fc3bc101710 2024-04-19T23:06:48.807 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:48.803+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc3bc061dd0 con 0x7fc3bc101710 2024-04-19T23:06:49.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:48 smithi113 bash[28910]: audit 2024-04-19T23:06:48.377428+0000 mon.c (mon.2) 984 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:48 smithi113 bash[28910]: audit 2024-04-19T23:06:48.378055+0000 mon.a (mon.0) 3824 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:48 smithi113 bash[21528]: audit 2024-04-19T23:06:48.377428+0000 mon.c (mon.2) 984 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:48 smithi113 bash[21528]: audit 2024-04-19T23:06:48.378055+0000 mon.a (mon.0) 3824 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:48 smithi178 bash[23441]: audit 2024-04-19T23:06:48.377428+0000 mon.c (mon.2) 984 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:48 smithi178 bash[23441]: audit 2024-04-19T23:06:48.378055+0000 mon.a (mon.0) 3824 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:49.701 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.699+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 9 ==== osd_map(803..803 src has 276..803) ==== 628+0+0 (secure 0 0 0) 0x7fc3ac0f39d0 con 0x7fc3bc101710 2024-04-19T23:06:49.701 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.699+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=804}) -- 0x7fc3a407ab20 con 0x7fc3bc101710 2024-04-19T23:06:49.708 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.707+0000 7fc3ab7fe640 1 -- 172.21.15.113:0/4066852822 <== mon.2 v2:172.21.15.113:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v803) ==== 217+0+0 (secure 0 0 0) 0x7fc3ac10e020 con 0x7fc3bc101710 2024-04-19T23:06:49.709 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_bytes = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:06:49.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 msgr2=0x7fc3a40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:49.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 0x7fc3a40704e0 secure :-1 s=READY pgs=3153 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00096c0 tx=0x7fc3b0009260 comp rx=0 tx=0).stop 2024-04-19T23:06:49.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 msgr2=0x7fc3bc199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:49.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0194e0 tx=0x7fc3ac0044c0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 shutdown_connections 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> v2:172.21.15.113:6800/3719359025 conn(0x7fc3a406e020 0x7fc3a40704e0 unknown :-1 s=CLOSED pgs=3153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc107710 0x7fc3bc19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3bc1020d0 0x7fc3bc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 --2- 172.21.15.113:0/4066852822 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3bc101710 0x7fc3bc199ee0 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 >> 172.21.15.113:0/4066852822 conn(0x7fc3bc0fd240 msgr2=0x7fc3bc0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.711+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 shutdown_connections 2024-04-19T23:06:49.715 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.715+0000 7fc3c0bd4640 1 -- 172.21.15.113:0/4066852822 wait complete. 2024-04-19T23:06:49.738 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool set-quota 46f4c55d-95df-4d19-ae41-b63f718ffdb6 max_objects 0 2024-04-19T23:06:49.863 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/106503351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 msgr2=0x7eff5c106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- 172.21.15.113:0/106503351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c106a50 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009960 tx=0x7eff4c01c7c0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/106503351 shutdown_connections 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- 172.21.15.113:0/106503351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c100fa0 0x7eff5c10d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- 172.21.15.113:0/106503351 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c1005e0 0x7eff5c100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- 172.21.15.113:0/106503351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c106a50 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/106503351 >> 172.21.15.113:0/106503351 conn(0x7eff5c0fc130 msgr2=0x7eff5c0fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/106503351 shutdown_connections 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/106503351 wait complete. 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 Processor -- start 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- start start 2024-04-19T23:06:49.864 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c1005e0 0x7eff5c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c112870 con 0x7eff5c106670 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c1126f0 con 0x7eff5c1005e0 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7eff5c1129f0 con 0x7eff5c100fa0 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:60984/0 (socket says 172.21.15.113:60984) 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 -- 172.21.15.113:0/2194457963 learned_addr learned my addr 172.21.15.113:0/2194457963 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 -- 172.21.15.113:0/2194457963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c1005e0 msgr2=0x7eff5c199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5b7fe640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c1005e0 0x7eff5c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c1005e0 0x7eff5c199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 -- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 msgr2=0x7eff5c19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c19e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:49.865 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c19ee90 con 0x7eff5c100fa0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5bfff640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff5affd640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7eff5000e9f0 tx=0x7eff5000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000cd80 con 0x7eff5c100fa0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c19f180 con 0x7eff5c100fa0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7eff500108e0 con 0x7eff5c100fa0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500188c0 con 0x7eff5c100fa0 2024-04-19T23:06:49.866 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.859+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c1a6a60 con 0x7eff5c100fa0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c068660 con 0x7eff5c100fa0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7eff50010430 con 0x7eff5c100fa0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff58ff9640 1 --2- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 0x7eff440704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(803..803 src has 276..803) ==== 8044+0+0 (secure 0 0 0) 0x7eff5008ec50 con 0x7eff5c100fa0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff5b7fe640 1 --2- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 0x7eff440704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=804}) -- 0x7eff44079b00 con 0x7eff5c100fa0 2024-04-19T23:06:49.867 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.863+0000 7eff5b7fe640 1 --2- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 0x7eff440704e0 secure :-1 s=READY pgs=3154 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009230 tx=0x7eff4c000bd0 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:06:49.870 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:49.867+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7eff50094020 con 0x7eff5c100fa0 2024-04-19T23:06:50.044 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:50.043+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"} v 0) -- 0x7eff5c1a6cf0 con 0x7eff5c100fa0 2024-04-19T23:06:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[21528]: cluster 2024-04-19T23:06:48.363608+0000 mgr.y (mgr.24389) 820 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[21528]: audit 2024-04-19T23:06:48.689826+0000 mon.a (mon.0) 3825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[21528]: cluster 2024-04-19T23:06:48.698467+0000 mon.a (mon.0) 3826 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-04-19T23:06:50.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[21528]: audit 2024-04-19T23:06:48.810862+0000 mon.c (mon.2) 985 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[21528]: audit 2024-04-19T23:06:48.811562+0000 mon.a (mon.0) 3827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[28910]: cluster 2024-04-19T23:06:48.363608+0000 mgr.y (mgr.24389) 820 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[28910]: audit 2024-04-19T23:06:48.689826+0000 mon.a (mon.0) 3825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[28910]: cluster 2024-04-19T23:06:48.698467+0000 mon.a (mon.0) 3826 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[28910]: audit 2024-04-19T23:06:48.810862+0000 mon.c (mon.2) 985 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:49 smithi113 bash[28910]: audit 2024-04-19T23:06:48.811562+0000 mon.a (mon.0) 3827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:49 smithi178 bash[23441]: cluster 2024-04-19T23:06:48.363608+0000 mgr.y (mgr.24389) 820 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 864 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:06:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:49 smithi178 bash[23441]: audit 2024-04-19T23:06:48.689826+0000 mon.a (mon.0) 3825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:49 smithi178 bash[23441]: cluster 2024-04-19T23:06:48.698467+0000 mon.a (mon.0) 3826 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-04-19T23:06:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:49 smithi178 bash[23441]: audit 2024-04-19T23:06:48.810862+0000 mon.c (mon.2) 985 : audit 1 from='client.? 172.21.15.113:0/4066852822' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:49 smithi178 bash[23441]: audit 2024-04-19T23:06:48.811562+0000 mon.a (mon.0) 3827 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]: dispatch 2024-04-19T23:06:50.711 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:50.707+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 7 ==== osd_map(804..804 src has 276..804) ==== 628+0+0 (secure 0 0 0) 0x7eff5008c970 con 0x7eff5c100fa0 2024-04-19T23:06:50.711 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:50.711+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=805}) -- 0x7eff4407a650 con 0x7eff5c100fa0 2024-04-19T23:06:50.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:50.719+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v804) ==== 221+0+0 (secure 0 0 0) 0x7eff5005fb50 con 0x7eff5c100fa0 2024-04-19T23:06:50.831 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:50.827+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"} v 0) -- 0x7eff5c1a6f40 con 0x7eff5c100fa0 2024-04-19T23:06:51.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[28910]: audit 2024-04-19T23:06:49.702575+0000 mon.a (mon.0) 3828 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[28910]: cluster 2024-04-19T23:06:49.710529+0000 mon.a (mon.0) 3829 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[28910]: audit 2024-04-19T23:06:50.047902+0000 mon.c (mon.2) 986 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[28910]: audit 2024-04-19T23:06:50.048426+0000 mon.a (mon.0) 3830 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[28910]: audit 2024-04-19T23:06:50.532364+0000 mon.a (mon.0) 3831 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[21528]: audit 2024-04-19T23:06:49.702575+0000 mon.a (mon.0) 3828 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[21528]: cluster 2024-04-19T23:06:49.710529+0000 mon.a (mon.0) 3829 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[21528]: audit 2024-04-19T23:06:50.047902+0000 mon.c (mon.2) 986 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[21528]: audit 2024-04-19T23:06:50.048426+0000 mon.a (mon.0) 3830 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:50 smithi113 bash[21528]: audit 2024-04-19T23:06:50.532364+0000 mon.a (mon.0) 3831 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:50 smithi178 bash[23441]: audit 2024-04-19T23:06:49.702575+0000 mon.a (mon.0) 3828 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_bytes", "val": "0"}]': finished 2024-04-19T23:06:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:50 smithi178 bash[23441]: cluster 2024-04-19T23:06:49.710529+0000 mon.a (mon.0) 3829 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-04-19T23:06:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:50 smithi178 bash[23441]: audit 2024-04-19T23:06:50.047902+0000 mon.c (mon.2) 986 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:50 smithi178 bash[23441]: audit 2024-04-19T23:06:50.048426+0000 mon.a (mon.0) 3830 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:51.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:50 smithi178 bash[23441]: audit 2024-04-19T23:06:50.532364+0000 mon.a (mon.0) 3831 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:06:51.713 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.711+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 9 ==== osd_map(805..805 src has 276..805) ==== 628+0+0 (secure 0 0 0) 0x7eff500598f0 con 0x7eff5c100fa0 2024-04-19T23:06:51.714 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.711+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=806}) -- 0x7eff4407ac90 con 0x7eff5c100fa0 2024-04-19T23:06:51.720 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.719+0000 7eff58ff9640 1 -- 172.21.15.113:0/2194457963 <== mon.2 v2:172.21.15.113:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 v805) ==== 221+0+0 (secure 0 0 0) 0x7eff50064380 con 0x7eff5c100fa0 2024-04-19T23:06:51.720 INFO:tasks.workunit.client.0.smithi113.stderr:set-quota max_objects = 0 for pool 46f4c55d-95df-4d19-ae41-b63f718ffdb6 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 msgr2=0x7eff440704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 0x7eff440704e0 secure :-1 s=READY pgs=3154 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009230 tx=0x7eff4c000bd0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 msgr2=0x7eff5c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7eff5000e9f0 tx=0x7eff5000eeb0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 shutdown_connections 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> v2:172.21.15.113:6800/3719359025 conn(0x7eff4406e020 0x7eff440704e0 unknown :-1 s=CLOSED pgs=3154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff5c106670 0x7eff5c19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff5c100fa0 0x7eff5c19a420 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 --2- 172.21.15.113:0/2194457963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c1005e0 0x7eff5c199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 >> 172.21.15.113:0/2194457963 conn(0x7eff5c0fc130 msgr2=0x7eff5c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:06:51.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 shutdown_connections 2024-04-19T23:06:51.726 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:06:51.723+0000 7eff61d35640 1 -- 172.21.15.113:0/2194457963 wait complete. 2024-04-19T23:06:51.746 INFO:tasks.workunit.client.0.smithi113.stderr:+ sleep 30 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[28910]: cluster 2024-04-19T23:06:50.365611+0000 mgr.y (mgr.24389) 821 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[28910]: audit 2024-04-19T23:06:50.711405+0000 mon.a (mon.0) 3832 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[28910]: cluster 2024-04-19T23:06:50.721172+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[28910]: audit 2024-04-19T23:06:50.834338+0000 mon.c (mon.2) 987 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[28910]: audit 2024-04-19T23:06:50.834800+0000 mon.a (mon.0) 3834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:52.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[21528]: cluster 2024-04-19T23:06:50.365611+0000 mgr.y (mgr.24389) 821 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-19T23:06:52.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[21528]: audit 2024-04-19T23:06:50.711405+0000 mon.a (mon.0) 3832 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:52.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[21528]: cluster 2024-04-19T23:06:50.721172+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-04-19T23:06:52.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[21528]: audit 2024-04-19T23:06:50.834338+0000 mon.c (mon.2) 987 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:52.048 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:51 smithi113 bash[21528]: audit 2024-04-19T23:06:50.834800+0000 mon.a (mon.0) 3834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:52.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:51 smithi178 bash[23441]: cluster 2024-04-19T23:06:50.365611+0000 mgr.y (mgr.24389) 821 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-04-19T23:06:52.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:51 smithi178 bash[23441]: audit 2024-04-19T23:06:50.711405+0000 mon.a (mon.0) 3832 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:52.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:51 smithi178 bash[23441]: cluster 2024-04-19T23:06:50.721172+0000 mon.a (mon.0) 3833 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-04-19T23:06:52.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:51 smithi178 bash[23441]: audit 2024-04-19T23:06:50.834338+0000 mon.c (mon.2) 987 : audit 1 from='client.? 172.21.15.113:0/2194457963' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:52.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:51 smithi178 bash[23441]: audit 2024-04-19T23:06:50.834800+0000 mon.a (mon.0) 3834 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]: dispatch 2024-04-19T23:06:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:52 smithi113 bash[28910]: audit 2024-04-19T23:06:51.714070+0000 mon.a (mon.0) 3835 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:53.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:52 smithi113 bash[28910]: cluster 2024-04-19T23:06:51.722195+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-04-19T23:06:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:52 smithi113 bash[21528]: audit 2024-04-19T23:06:51.714070+0000 mon.a (mon.0) 3835 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:53.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:52 smithi113 bash[21528]: cluster 2024-04-19T23:06:51.722195+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-04-19T23:06:53.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:52 smithi178 bash[23441]: audit 2024-04-19T23:06:51.714070+0000 mon.a (mon.0) 3835 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "field": "max_objects", "val": "0"}]': finished 2024-04-19T23:06:53.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:52 smithi178 bash[23441]: cluster 2024-04-19T23:06:51.722195+0000 mon.a (mon.0) 3836 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-04-19T23:06:54.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:53 smithi113 bash[21528]: cluster 2024-04-19T23:06:52.366445+0000 mgr.y (mgr.24389) 822 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:06:54.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:53 smithi113 bash[28910]: cluster 2024-04-19T23:06:52.366445+0000 mgr.y (mgr.24389) 822 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:06:54.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:53 smithi178 bash[23441]: cluster 2024-04-19T23:06:52.366445+0000 mgr.y (mgr.24389) 822 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-04-19T23:06:56.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:55 smithi113 bash[21528]: cluster 2024-04-19T23:06:54.367229+0000 mgr.y (mgr.24389) 823 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 2.1 KiB/s wr, 1 op/s 2024-04-19T23:06:56.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:55 smithi113 bash[28910]: cluster 2024-04-19T23:06:54.367229+0000 mgr.y (mgr.24389) 823 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 2.1 KiB/s wr, 1 op/s 2024-04-19T23:06:56.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:06:55 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:06:56.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:55 smithi178 bash[23441]: cluster 2024-04-19T23:06:54.367229+0000 mgr.y (mgr.24389) 823 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 2.1 KiB/s wr, 1 op/s 2024-04-19T23:06:57.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:56 smithi113 bash[28910]: audit 2024-04-19T23:06:55.769491+0000 mgr.y (mgr.24389) 824 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:57.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:56 smithi113 bash[21528]: audit 2024-04-19T23:06:55.769491+0000 mgr.y (mgr.24389) 824 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:57.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:56 smithi178 bash[23441]: audit 2024-04-19T23:06:55.769491+0000 mgr.y (mgr.24389) 824 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:06:57.755 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:06:57 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:06:57] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:06:58.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:57 smithi113 bash[21528]: cluster 2024-04-19T23:06:56.369211+0000 mgr.y (mgr.24389) 825 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-04-19T23:06:58.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:57 smithi113 bash[28910]: cluster 2024-04-19T23:06:56.369211+0000 mgr.y (mgr.24389) 825 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-04-19T23:06:58.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:57 smithi178 bash[23441]: cluster 2024-04-19T23:06:56.369211+0000 mgr.y (mgr.24389) 825 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.8 KiB/s wr, 1 op/s 2024-04-19T23:07:00.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:06:59 smithi113 bash[21528]: cluster 2024-04-19T23:06:58.370022+0000 mgr.y (mgr.24389) 826 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:07:00.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:06:59 smithi113 bash[28910]: cluster 2024-04-19T23:06:58.370022+0000 mgr.y (mgr.24389) 826 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:07:00.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:06:59 smithi178 bash[23441]: cluster 2024-04-19T23:06:58.370022+0000 mgr.y (mgr.24389) 826 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-04-19T23:07:02.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:01 smithi113 bash[28910]: cluster 2024-04-19T23:07:00.372040+0000 mgr.y (mgr.24389) 827 : cluster 0 pgmap v1361: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:07:02.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:01 smithi113 bash[21528]: cluster 2024-04-19T23:07:00.372040+0000 mgr.y (mgr.24389) 827 : cluster 0 pgmap v1361: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:07:02.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:01 smithi178 bash[23441]: cluster 2024-04-19T23:07:00.372040+0000 mgr.y (mgr.24389) 827 : cluster 0 pgmap v1361: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-19T23:07:04.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:03 smithi113 bash[21528]: cluster 2024-04-19T23:07:02.372835+0000 mgr.y (mgr.24389) 828 : cluster 0 pgmap v1362: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-04-19T23:07:04.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:03 smithi113 bash[28910]: cluster 2024-04-19T23:07:02.372835+0000 mgr.y (mgr.24389) 828 : cluster 0 pgmap v1362: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-04-19T23:07:04.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:03 smithi178 bash[23441]: cluster 2024-04-19T23:07:02.372835+0000 mgr.y (mgr.24389) 828 : cluster 0 pgmap v1362: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 0 op/s 2024-04-19T23:07:06.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:05 smithi113 bash[28910]: cluster 2024-04-19T23:07:04.373667+0000 mgr.y (mgr.24389) 829 : cluster 0 pgmap v1363: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:06.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:05 smithi113 bash[28910]: audit 2024-04-19T23:07:05.565311+0000 mon.a (mon.0) 3837 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:05 smithi113 bash[21528]: cluster 2024-04-19T23:07:04.373667+0000 mgr.y (mgr.24389) 829 : cluster 0 pgmap v1363: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:06.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:05 smithi113 bash[21528]: audit 2024-04-19T23:07:05.565311+0000 mon.a (mon.0) 3837 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:06.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:07:05 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:07:06.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:05 smithi178 bash[23441]: cluster 2024-04-19T23:07:04.373667+0000 mgr.y (mgr.24389) 829 : cluster 0 pgmap v1363: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:06.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:05 smithi178 bash[23441]: audit 2024-04-19T23:07:05.565311+0000 mon.a (mon.0) 3837 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:07.046 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:06 smithi113 bash[28910]: audit 2024-04-19T23:07:05.777310+0000 mgr.y (mgr.24389) 830 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:07.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:06 smithi113 bash[21528]: audit 2024-04-19T23:07:05.777310+0000 mgr.y (mgr.24389) 830 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:07.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:06 smithi178 bash[23441]: audit 2024-04-19T23:07:05.777310+0000 mgr.y (mgr.24389) 830 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:07.783 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:07 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:07:07] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:07:08.046 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:07 smithi113 bash[21528]: cluster 2024-04-19T23:07:06.375633+0000 mgr.y (mgr.24389) 831 : cluster 0 pgmap v1364: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:08.047 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:07 smithi113 bash[21528]: audit 2024-04-19T23:07:07.620025+0000 mon.a (mon.0) 3838 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:07:08.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:07 smithi113 bash[28910]: cluster 2024-04-19T23:07:06.375633+0000 mgr.y (mgr.24389) 831 : cluster 0 pgmap v1364: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:08.047 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:07 smithi113 bash[28910]: audit 2024-04-19T23:07:07.620025+0000 mon.a (mon.0) 3838 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:07:08.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:07 smithi178 bash[23441]: cluster 2024-04-19T23:07:06.375633+0000 mgr.y (mgr.24389) 831 : cluster 0 pgmap v1364: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:08.053 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:07 smithi178 bash[23441]: audit 2024-04-19T23:07:07.620025+0000 mon.a (mon.0) 3838 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.146773+0000 mon.a (mon.0) 3839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.153182+0000 mon.a (mon.0) 3840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.159338+0000 mon.a (mon.0) 3841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.166010+0000 mon.a (mon.0) 3842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: cluster 2024-04-19T23:07:08.376406+0000 mgr.y (mgr.24389) 832 : cluster 0 pgmap v1365: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.841601+0000 mon.a (mon.0) 3843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.843441+0000 mon.a (mon.0) 3844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:07:09.547 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[21528]: audit 2024-04-19T23:07:08.853726+0000 mon.a (mon.0) 3845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.146773+0000 mon.a (mon.0) 3839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.153182+0000 mon.a (mon.0) 3840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.159338+0000 mon.a (mon.0) 3841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.166010+0000 mon.a (mon.0) 3842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: cluster 2024-04-19T23:07:08.376406+0000 mgr.y (mgr.24389) 832 : cluster 0 pgmap v1365: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.841601+0000 mon.a (mon.0) 3843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.843441+0000 mon.a (mon.0) 3844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:07:09.548 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:09 smithi113 bash[28910]: audit 2024-04-19T23:07:08.853726+0000 mon.a (mon.0) 3845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.146773+0000 mon.a (mon.0) 3839 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.153182+0000 mon.a (mon.0) 3840 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.159338+0000 mon.a (mon.0) 3841 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.166010+0000 mon.a (mon.0) 3842 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: cluster 2024-04-19T23:07:08.376406+0000 mgr.y (mgr.24389) 832 : cluster 0 pgmap v1365: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.841601+0000 mon.a (mon.0) 3843 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-19T23:07:09.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.843441+0000 mon.a (mon.0) 3844 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-19T23:07:09.554 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:09 smithi178 bash[23441]: audit 2024-04-19T23:07:08.853726+0000 mon.a (mon.0) 3845 : audit 1 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' 2024-04-19T23:07:11.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:11 smithi113 bash[28910]: cluster 2024-04-19T23:07:10.378331+0000 mgr.y (mgr.24389) 833 : cluster 0 pgmap v1366: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:11.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:11 smithi113 bash[21528]: cluster 2024-04-19T23:07:10.378331+0000 mgr.y (mgr.24389) 833 : cluster 0 pgmap v1366: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:11.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:11 smithi178 bash[23441]: cluster 2024-04-19T23:07:10.378331+0000 mgr.y (mgr.24389) 833 : cluster 0 pgmap v1366: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:13.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:13 smithi113 bash[21528]: cluster 2024-04-19T23:07:12.379208+0000 mgr.y (mgr.24389) 834 : cluster 0 pgmap v1367: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:13.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:13 smithi113 bash[28910]: cluster 2024-04-19T23:07:12.379208+0000 mgr.y (mgr.24389) 834 : cluster 0 pgmap v1367: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:13.803 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:07:13 smithi178 bash[50863]: logger=cleanup t=2024-04-19T23:07:13.545853077Z level=info msg="Completed cleanup jobs" duration=35.984398ms 2024-04-19T23:07:13.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:13 smithi178 bash[23441]: cluster 2024-04-19T23:07:12.379208+0000 mgr.y (mgr.24389) 834 : cluster 0 pgmap v1367: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:15.787 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:15 smithi178 bash[23441]: cluster 2024-04-19T23:07:14.380045+0000 mgr.y (mgr.24389) 835 : cluster 0 pgmap v1368: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:15.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:15 smithi113 bash[28910]: cluster 2024-04-19T23:07:14.380045+0000 mgr.y (mgr.24389) 835 : cluster 0 pgmap v1368: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:15.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:15 smithi113 bash[21528]: cluster 2024-04-19T23:07:14.380045+0000 mgr.y (mgr.24389) 835 : cluster 0 pgmap v1368: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:16.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:07:15 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:07:17.797 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:17 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:07:17] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:07:17.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:17 smithi113 bash[28910]: audit 2024-04-19T23:07:15.788555+0000 mgr.y (mgr.24389) 836 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:17.798 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:17 smithi113 bash[28910]: cluster 2024-04-19T23:07:16.382079+0000 mgr.y (mgr.24389) 837 : cluster 0 pgmap v1369: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:17.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:17 smithi113 bash[21528]: audit 2024-04-19T23:07:15.788555+0000 mgr.y (mgr.24389) 836 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:17.798 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:17 smithi113 bash[21528]: cluster 2024-04-19T23:07:16.382079+0000 mgr.y (mgr.24389) 837 : cluster 0 pgmap v1369: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:17 smithi178 bash[23441]: audit 2024-04-19T23:07:15.788555+0000 mgr.y (mgr.24389) 836 : audit 0 from='client.24403 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-04-19T23:07:17.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:17 smithi178 bash[23441]: cluster 2024-04-19T23:07:16.382079+0000 mgr.y (mgr.24389) 837 : cluster 0 pgmap v1369: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:19.796 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:19 smithi113 bash[28910]: cluster 2024-04-19T23:07:18.382911+0000 mgr.y (mgr.24389) 838 : cluster 0 pgmap v1370: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:19.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:19 smithi113 bash[21528]: cluster 2024-04-19T23:07:18.382911+0000 mgr.y (mgr.24389) 838 : cluster 0 pgmap v1370: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:19.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:19 smithi178 bash[23441]: cluster 2024-04-19T23:07:18.382911+0000 mgr.y (mgr.24389) 838 : cluster 0 pgmap v1370: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:21.747 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool delete 46f4c55d-95df-4d19-ae41-b63f718ffdb6 46f4c55d-95df-4d19-ae41-b63f718ffdb6 --yes-i-really-really-mean-it 2024-04-19T23:07:21.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:21 smithi113 bash[21528]: cluster 2024-04-19T23:07:20.384928+0000 mgr.y (mgr.24389) 839 : cluster 0 pgmap v1371: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:21.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:21 smithi113 bash[21528]: audit 2024-04-19T23:07:20.598015+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:21.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:21 smithi113 bash[28910]: cluster 2024-04-19T23:07:20.384928+0000 mgr.y (mgr.24389) 839 : cluster 0 pgmap v1371: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:21.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:21 smithi113 bash[28910]: audit 2024-04-19T23:07:20.598015+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:21.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:21 smithi178 bash[23441]: cluster 2024-04-19T23:07:20.384928+0000 mgr.y (mgr.24389) 839 : cluster 0 pgmap v1371: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-19T23:07:21.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:21 smithi178 bash[23441]: audit 2024-04-19T23:07:20.598015+0000 mon.a (mon.0) 3846 : audit 0 from='mgr.24389 172.21.15.113:0/3267991328' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/3613717515 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd038069e80 msgr2=0x7fd03806a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- 172.21.15.113:0/3613717515 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd038069e80 0x7fd03806a2e0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7fd028009960 tx=0x7fd02801c7c0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/3613717515 shutdown_connections 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- 172.21.15.113:0/3613717515 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd03806a820 0x7fd03810e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- 172.21.15.113:0/3613717515 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd038069e80 0x7fd03806a2e0 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- 172.21.15.113:0/3613717515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0381078c0 0x7fd038107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/3613717515 >> 172.21.15.113:0/3613717515 conn(0x7fd038077500 msgr2=0x7fd038077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:07:21.882 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/3613717515 shutdown_connections 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/3613717515 wait complete. 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 Processor -- start 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- start start 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 0x7fd03819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd038113930 con 0x7fd038069e80 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381137b0 con 0x7fd03806a820 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7fd038113ab0 con 0x7fd0381078c0 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:21.883 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03e384640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47658/0 (socket says 172.21.15.113:47658) 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03e384640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:51466/0 (socket says 172.21.15.113:51466) 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 -- 172.21.15.113:0/4100254925 learned_addr learned my addr 172.21.15.113:0/4100254925 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03d382640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 0x7fd03819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 -- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 msgr2=0x7fd03819e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 -- 172.21.15.113:0/4100254925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 msgr2=0x7fd03819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 0x7fd03819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03819ee00 con 0x7fd038069e80 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03e384640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:07:21.884 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03d382640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 0x7fd03819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03db83640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c970 tx=0x7fd03400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034007bb0 con 0x7fd038069e80 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03819f0f0 con 0x7fd038069e80 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7fd034007d50 con 0x7fd038069e80 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03400f450 con 0x7fd038069e80 2024-04-19T23:07:21.885 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0381a69d0 con 0x7fd038069e80 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.878+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd038102e30 con 0x7fd038069e80 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7fd034004f00 con 0x7fd038069e80 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd02effd640 1 --2- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 0x7fd0240704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(805..805 src has 276..805) ==== 8044+0+0 (secure 0 0 0) 0x7fd03408e550 con 0x7fd038069e80 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd03d382640 1 --2- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 0x7fd0240704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:21.886 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=806}) -- 0x7fd024079b00 con 0x7fd038069e80 2024-04-19T23:07:21.887 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.882+0000 7fd03d382640 1 --2- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 0x7fd0240704e0 secure :-1 s=READY pgs=3155 cs=0 l=1 rev1=1 crypto rx=0x7fd02801c5f0 tx=0x7fd028019560 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:07:21.889 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:21.886+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd034014030 con 0x7fd038069e80 2024-04-19T23:07:22.059 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.054+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0381a6c00 con 0x7fd038069e80 2024-04-19T23:07:22.467 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.462+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]=0 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' removed v806) ==== 248+0+0 (secure 0 0 0) 0x7fd03405f390 con 0x7fd038069e80 2024-04-19T23:07:22.470 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.466+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 8 ==== osd_map(806..806 src has 276..806) ==== 296+0+0 (secure 0 0 0) 0x7fd0340c26f0 con 0x7fd038069e80 2024-04-19T23:07:22.470 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.466+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=807}) -- 0x7fd02407a750 con 0x7fd038069e80 2024-04-19T23:07:22.577 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.574+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd03819b1b0 con 0x7fd038069e80 2024-04-19T23:07:22.577 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.574+0000 7fd02effd640 1 -- 172.21.15.113:0/4100254925 <== mon.0 v2:172.21.15.113:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]=0 pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' does not exist v806) ==== 255+0+0 (secure 0 0 0) 0x7fd03408c270 con 0x7fd038069e80 2024-04-19T23:07:22.578 INFO:tasks.workunit.client.0.smithi113.stderr:pool '46f4c55d-95df-4d19-ae41-b63f718ffdb6' does not exist 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 msgr2=0x7fd0240704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 0x7fd0240704e0 secure :-1 s=READY pgs=3155 cs=0 l=1 rev1=1 crypto rx=0x7fd02801c5f0 tx=0x7fd028019560 comp rx=0 tx=0).stop 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 msgr2=0x7fd038199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c970 tx=0x7fd03400ce30 comp rx=0 tx=0).stop 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 shutdown_connections 2024-04-19T23:07:22.580 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> v2:172.21.15.113:6800/3719359025 conn(0x7fd02406e020 0x7fd0240704e0 unknown :-1 s=CLOSED pgs=3155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0381078c0 0x7fd03819e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd03806a820 0x7fd03819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 --2- 172.21.15.113:0/4100254925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd038069e80 0x7fd038199e50 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 >> 172.21.15.113:0/4100254925 conn(0x7fd038077500 msgr2=0x7fd0381052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 shutdown_connections 2024-04-19T23:07:22.581 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.578+0000 7fd03fde7640 1 -- 172.21.15.113:0/4100254925 wait complete. 2024-04-19T23:07:22.596 INFO:tasks.workunit.client.0.smithi113.stderr:+ ceph osd pool delete 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f 6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f --yes-i-really-really-mean-it 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1518157585 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 msgr2=0x7f404010e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1518157585 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f404010e190 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f4038009cb0 tx=0x7f403801cd30 comp rx=0 tx=0).stop 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1518157585 shutdown_connections 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1518157585 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f404010e190 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1518157585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f404010b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1518157585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40401028c0 0x7f4040102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1518157585 >> 172.21.15.113:0/1518157585 conn(0x7f40400fc130 msgr2=0x7f40400fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:07:22.721 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1518157585 shutdown_connections 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1518157585 wait complete. 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 Processor -- start 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- start start 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40401028c0 0x7f4040100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f40401139c0 con 0x7f40401031e0 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4040113840 con 0x7f40401028c0 2024-04-19T23:07:22.722 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 -- 0x7f4040113b40 con 0x7f404010bcf0 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404546c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:51472/0 (socket says 172.21.15.113:51472) 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404546c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47672/0 (socket says 172.21.15.113:47672) 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 -- 172.21.15.113:0/1338154216 learned_addr learned my addr 172.21.15.113:0/1338154216 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-19T23:07:22.723 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 -- 172.21.15.113:0/1338154216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40401028c0 msgr2=0x7f4040100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40401028c0 0x7f4040100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 -- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 msgr2=0x7f4040100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40401a8330 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404546c640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f404646e640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f4038098860 tx=0x7f40380045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40380b2040 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(26 keys) ==== 1093+0+0 (secure 0 0 0) 0x7f40380047d0 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40380ab670 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40401a85c0 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.714+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40401a89f0 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4040068ab0 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 21) ==== 92140+0+0 (secure 0 0 0) 0x7f40380bd060 con 0x7f404010bcf0 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4036ffd640 1 --2- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 0x7f402c0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:07:22.724 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(806..806 src has 276..806) ==== 7656+0+0 (secure 0 0 0) 0x7f40381284b0 con 0x7f404010bcf0 2024-04-19T23:07:22.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4045c6d640 1 --2- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 0x7f402c0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:07:22.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=807}) -- 0x7f402c0792e0 con 0x7f404010bcf0 2024-04-19T23:07:22.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.718+0000 7f4045c6d640 1 --2- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 0x7f402c0704e0 secure :-1 s=READY pgs=3156 cs=0 l=1 rev1=1 crypto rx=0x7f403c0058d0 tx=0x7f403c005860 comp rx=0 tx=0).ready entity=mgr.24389 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:07:22.725 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.722+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f40380169b0 con 0x7f404010bcf0 2024-04-19T23:07:22.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:22 smithi113 bash[21528]: audit 2024-04-19T23:07:22.062944+0000 mon.a (mon.0) 3847 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:22.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:22 smithi113 bash[28910]: audit 2024-04-19T23:07:22.062944+0000 mon.a (mon.0) 3847 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:22.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:22 smithi178 bash[23441]: audit 2024-04-19T23:07:22.062944+0000 mon.a (mon.0) 3847 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:22.899 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:22.898+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40401a8d10 con 0x7f404010bcf0 2024-04-19T23:07:23.472 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.470+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 7 ==== osd_map(807..807 src has 276..807) ==== 296+0+0 (secure 0 0 0) 0x7f4038126350 con 0x7f404010bcf0 2024-04-19T23:07:23.472 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.470+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=808}) -- 0x7f402c079ba0 con 0x7f404010bcf0 2024-04-19T23:07:23.481 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.478+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]=0 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' removed v807) ==== 248+0+0 (secure 0 0 0) 0x7f40380f5840 con 0x7f404010bcf0 2024-04-19T23:07:23.596 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.594+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40401a8f90 con 0x7f404010bcf0 2024-04-19T23:07:23.598 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.594+0000 7f4036ffd640 1 -- 172.21.15.113:0/1338154216 <== mon.2 v2:172.21.15.113:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]=0 pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' does not exist v807) ==== 255+0+0 (secure 0 0 0) 0x7f403810e020 con 0x7f404010bcf0 2024-04-19T23:07:23.598 INFO:tasks.workunit.client.0.smithi113.stderr:pool '6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f' does not exist 2024-04-19T23:07:23.600 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 msgr2=0x7f402c0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:23.600 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 0x7f402c0704e0 secure :-1 s=READY pgs=3156 cs=0 l=1 rev1=1 crypto rx=0x7f403c0058d0 tx=0x7f403c005860 comp rx=0 tx=0).stop 2024-04-19T23:07:23.600 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 msgr2=0x7f4040100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f4038098860 tx=0x7f40380045e0 comp rx=0 tx=0).stop 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 shutdown_connections 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> v2:172.21.15.113:6800/3719359025 conn(0x7f402c06e020 0x7f402c0704e0 unknown :-1 s=CLOSED pgs=3156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f404010bcf0 0x7f4040100fa0 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40401031e0 0x7f4040100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 --2- 172.21.15.113:0/1338154216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40401028c0 0x7f4040100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 >> 172.21.15.113:0/1338154216 conn(0x7f40400fc130 msgr2=0x7f404010d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 shutdown_connections 2024-04-19T23:07:23.601 INFO:tasks.workunit.client.0.smithi113.stderr:2024-04-19T23:07:23.598+0000 7f4047ed1640 1 -- 172.21.15.113:0/1338154216 wait complete. 2024-04-19T23:07:23.615 INFO:tasks.workunit.client.0.smithi113.stderr:+ echo OK 2024-04-19T23:07:23.616 INFO:tasks.workunit.client.0.smithi113.stdout:OK 2024-04-19T23:07:23.617 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-19T23:07:23.617 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T23:07:23.672 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-04-19T23:07:23.672 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-19T23:07:23.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: cluster 2024-04-19T23:07:22.385785+0000 mgr.y (mgr.24389) 840 : cluster 0 pgmap v1372: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:23.796 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: audit 2024-04-19T23:07:22.469784+0000 mon.a (mon.0) 3848 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: cluster 2024-04-19T23:07:22.478665+0000 mon.a (mon.0) 3849 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: audit 2024-04-19T23:07:22.580489+0000 mon.a (mon.0) 3850 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: audit 2024-04-19T23:07:22.903039+0000 mon.c (mon.2) 988 : audit 1 from='client.? 172.21.15.113:0/1338154216' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[21528]: audit 2024-04-19T23:07:22.903566+0000 mon.a (mon.0) 3851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: cluster 2024-04-19T23:07:22.385785+0000 mgr.y (mgr.24389) 840 : cluster 0 pgmap v1372: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: audit 2024-04-19T23:07:22.469784+0000 mon.a (mon.0) 3848 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: cluster 2024-04-19T23:07:22.478665+0000 mon.a (mon.0) 3849 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: audit 2024-04-19T23:07:22.580489+0000 mon.a (mon.0) 3850 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: audit 2024-04-19T23:07:22.903039+0000 mon.c (mon.2) 988 : audit 1 from='client.? 172.21.15.113:0/1338154216' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.797 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:23 smithi113 bash[28910]: audit 2024-04-19T23:07:22.903566+0000 mon.a (mon.0) 3851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: cluster 2024-04-19T23:07:22.385785+0000 mgr.y (mgr.24389) 840 : cluster 0 pgmap v1372: 188 pgs: 188 active+clean; 876 KiB data, 730 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: audit 2024-04-19T23:07:22.469784+0000 mon.a (mon.0) 3848 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]': finished 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: cluster 2024-04-19T23:07:22.478665+0000 mon.a (mon.0) 3849 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: audit 2024-04-19T23:07:22.580489+0000 mon.a (mon.0) 3850 : audit 1 from='client.? 172.21.15.113:0/4100254925' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "pool2": "46f4c55d-95df-4d19-ae41-b63f718ffdb6", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: audit 2024-04-19T23:07:22.903039+0000 mon.c (mon.2) 988 : audit 1 from='client.? 172.21.15.113:0/1338154216' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:23.803 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:23 smithi178 bash[23441]: audit 2024-04-19T23:07:22.903566+0000 mon.a (mon.0) 3851 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "pool2": "6aef5ed0-2e9e-4ce1-90d9-b5e6e1014e9f", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-19T23:07:24.032 DEBUG:teuthology.parallel:result is None 2024-04-19T23:07:24.032 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T23:07:24.044 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T23:07:24.044 DEBUG:teuthology.orchestra.run.smithi113:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-19T23:07:24.102 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T23:07:24.102 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-19T23:07:24.112 INFO:tasks.cephadm:Teardown begin 2024-04-19T23:07:24.112 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-19T23:07:24.155 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-19T23:07:24.170 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-19T23:07:24.171 DEBUG:teuthology.orchestra.run.smithi113:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-19T23:07:24.204 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-19T23:07:24.218 INFO:tasks.cephadm:Stopping all daemons... 2024-04-19T23:07:24.218 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-19T23:07:24.218 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a 2024-04-19T23:07:24.296 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:24 smithi113 systemd[1]: Stopping Ceph mon.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:24.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21528]: debug 2024-04-19T23:07:24.414+0000 7f11df219700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-19T23:07:24.543 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21528]: debug 2024-04-19T23:07:24.414+0000 7f11df219700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-19T23:07:24.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE Bus STOPPING 2024-04-19T23:07:24.544 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T23:07:24.544 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE Bus STOPPED 2024-04-19T23:07:24.544 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE Bus STARTING 2024-04-19T23:07:24.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE Serving on http://:::9283 2024-04-19T23:07:24.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:24 smithi113 bash[21785]: [19/Apr/2024:23:07:24] ENGINE Bus STARTED 2024-04-19T23:07:25.866 INFO:journalctl@ceph.mon.a.smithi113.stdout:Apr 19 23:07:25 smithi113 bash[132608]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-mon-a 2024-04-19T23:07:25.871 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.a.service' 2024-04-19T23:07:25.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:25.898 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-19T23:07:25.898 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-04-19T23:07:25.898 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.c 2024-04-19T23:07:26.053 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:07:25 smithi178 bash[47837]: debug there is no tcmu-runner data available 2024-04-19T23:07:26.124 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE Bus STOPPING 2024-04-19T23:07:26.124 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:25 smithi113 systemd[1]: Stopping Ceph mon.c for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:26.125 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[28910]: debug 2024-04-19T23:07:26.102+0000 7f7d38efb700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-19T23:07:26.125 INFO:journalctl@ceph.mon.c.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[28910]: debug 2024-04-19T23:07:26.102+0000 7f7d38efb700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-04-19T23:07:26.542 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-04-19T23:07:26.542 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE Bus STOPPED 2024-04-19T23:07:26.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE Bus STARTING 2024-04-19T23:07:26.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE Serving on http://:::9283 2024-04-19T23:07:26.543 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:26 smithi113 bash[21785]: [19/Apr/2024:23:07:26] ENGINE Bus STARTED 2024-04-19T23:07:27.195 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.c.service' 2024-04-19T23:07:27.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:27.222 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-04-19T23:07:27.222 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-04-19T23:07:27.222 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.b 2024-04-19T23:07:27.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:27 smithi178 systemd[1]: Stopping Ceph mon.b for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:27.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:27 smithi178 bash[23441]: debug 2024-04-19T23:07:27.343+0000 7f64e39f4700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-19T23:07:27.553 INFO:journalctl@ceph.mon.b.smithi178.stdout:Apr 19 23:07:27 smithi178 bash[23441]: debug 2024-04-19T23:07:27.343+0000 7f64e39f4700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-04-19T23:07:27.796 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:27 smithi113 bash[21785]: ::ffff:172.21.15.178 - - [19/Apr/2024:23:07:27] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-04-19T23:07:28.313 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mon.b.service' 2024-04-19T23:07:28.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:28.348 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-04-19T23:07:28.348 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-19T23:07:28.348 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y 2024-04-19T23:07:28.767 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:28 smithi113 systemd[1]: Stopping Ceph mgr.y for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:28.767 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:28 smithi113 bash[21785]: debug 2024-04-19T23:07:28.502+0000 7fdee667d700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:07:28.767 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:28 smithi113 bash[21785]: debug 2024-04-19T23:07:28.502+0000 7fdee667d700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-19T23:07:29.442 INFO:journalctl@ceph.mgr.y.smithi113.stdout:Apr 19 23:07:29 smithi113 bash[132842]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-mgr-y 2024-04-19T23:07:29.446 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.y.service' 2024-04-19T23:07:29.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:29.468 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-19T23:07:29.468 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-19T23:07:29.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.x 2024-04-19T23:07:29.803 INFO:journalctl@ceph.mgr.x.smithi178.stdout:Apr 19 23:07:29 smithi178 systemd[1]: Stopping Ceph mgr.x for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:30.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@mgr.x.service' 2024-04-19T23:07:30.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:30.382 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-19T23:07:30.382 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-19T23:07:30.382 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.0 2024-04-19T23:07:30.797 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:30 smithi113 systemd[1]: Stopping Ceph osd.0 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:30.797 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:30 smithi113 bash[31937]: debug 2024-04-19T23:07:30.526+0000 7f8080717700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:07:30.797 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:30 smithi113 bash[31937]: debug 2024-04-19T23:07:30.526+0000 7f8080717700 -1 osd.0 807 *** Got signal Terminated *** 2024-04-19T23:07:30.797 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:30 smithi113 bash[31937]: debug 2024-04-19T23:07:30.526+0000 7f8080717700 -1 osd.0 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:07:37.046 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:36 smithi113 bash[132942]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-0 2024-04-19T23:07:37.046 INFO:journalctl@ceph.osd.0.smithi113.stdout:Apr 19 23:07:36 smithi113 bash[133006]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-0 2024-04-19T23:07:38.869 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.0.service' 2024-04-19T23:07:38.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:38.898 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-19T23:07:38.898 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-19T23:07:38.898 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.1 2024-04-19T23:07:39.297 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:38 smithi113 systemd[1]: Stopping Ceph osd.1 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:39.297 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:39 smithi113 bash[37270]: debug 2024-04-19T23:07:39.082+0000 7ffb78dfa700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:07:39.297 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:39 smithi113 bash[37270]: debug 2024-04-19T23:07:39.082+0000 7ffb78dfa700 -1 osd.1 807 *** Got signal Terminated *** 2024-04-19T23:07:39.297 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:39 smithi113 bash[37270]: debug 2024-04-19T23:07:39.082+0000 7ffb78dfa700 -1 osd.1 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:07:45.796 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:45 smithi113 bash[133140]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-1 2024-04-19T23:07:45.796 INFO:journalctl@ceph.osd.1.smithi113.stdout:Apr 19 23:07:45 smithi113 bash[133204]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-1 2024-04-19T23:07:47.529 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.1.service' 2024-04-19T23:07:47.557 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:47.558 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-19T23:07:47.558 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-19T23:07:47.558 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.2 2024-04-19T23:07:47.796 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:47 smithi113 systemd[1]: Stopping Ceph osd.2 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:47.797 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:47 smithi113 bash[42907]: debug 2024-04-19T23:07:47.757+0000 7f211cdf9700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:07:47.797 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:47 smithi113 bash[42907]: debug 2024-04-19T23:07:47.757+0000 7f211cdf9700 -1 osd.2 807 *** Got signal Terminated *** 2024-04-19T23:07:47.797 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:47 smithi113 bash[42907]: debug 2024-04-19T23:07:47.757+0000 7f211cdf9700 -1 osd.2 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:07:54.296 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:53 smithi113 bash[133340]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-2 2024-04-19T23:07:54.297 INFO:journalctl@ceph.osd.2.smithi113.stdout:Apr 19 23:07:54 smithi113 bash[133404]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-2 2024-04-19T23:07:56.045 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.2.service' 2024-04-19T23:07:56.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:07:56.073 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-19T23:07:56.073 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-19T23:07:56.073 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.3 2024-04-19T23:07:56.296 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:56 smithi113 systemd[1]: Stopping Ceph osd.3 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:07:56.297 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:56 smithi113 bash[48401]: debug 2024-04-19T23:07:56.265+0000 7fb517890700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:07:56.297 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:56 smithi113 bash[48401]: debug 2024-04-19T23:07:56.265+0000 7fb517890700 -1 osd.3 807 *** Got signal Terminated *** 2024-04-19T23:07:56.297 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:56 smithi113 bash[48401]: debug 2024-04-19T23:07:56.265+0000 7fb517890700 -1 osd.3 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:07:57.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:07:56 smithi178 bash[43677]: debug 2024-04-19T23:07:56.927+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:07:57.937 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:07:57 smithi178 bash[26981]: debug 2024-04-19T23:07:57.659+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:07:58.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:07:57 smithi178 bash[43677]: debug 2024-04-19T23:07:57.935+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:07:58.674 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:07:58 smithi178 bash[32291]: debug 2024-04-19T23:07:58.395+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:07:58.674 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:07:58 smithi178 bash[37884]: debug 2024-04-19T23:07:58.631+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:07:58.947 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:07:58 smithi178 bash[26981]: debug 2024-04-19T23:07:58.671+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:07:59.046 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:58 smithi113 bash[48401]: debug 2024-04-19T23:07:58.753+0000 7fb513e84700 -1 osd.3 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.267169+0000 front 2024-04-19T23:07:33.267054+0000 (oldest deadline 2024-04-19T23:07:58.567242+0000) 2024-04-19T23:07:59.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:07:58 smithi178 bash[43677]: debug 2024-04-19T23:07:58.943+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:07:59.684 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:07:59 smithi178 bash[26981]: debug 2024-04-19T23:07:59.639+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:07:59.684 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:07:59 smithi178 bash[32291]: debug 2024-04-19T23:07:59.407+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:07:59.959 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:07:59 smithi178 bash[37884]: debug 2024-04-19T23:07:59.683+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:00.296 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:07:59 smithi113 bash[48401]: debug 2024-04-19T23:07:59.805+0000 7fb513e84700 -1 osd.3 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.267169+0000 front 2024-04-19T23:07:33.267054+0000 (oldest deadline 2024-04-19T23:07:58.567242+0000) 2024-04-19T23:08:00.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:07:59 smithi178 bash[43677]: debug 2024-04-19T23:07:59.959+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:00.729 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:00 smithi178 bash[32291]: debug 2024-04-19T23:08:00.407+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:00.730 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:00 smithi178 bash[26981]: debug 2024-04-19T23:08:00.623+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:01.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:00 smithi178 bash[37884]: debug 2024-04-19T23:08:00.727+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:01.053 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:00 smithi178 bash[43677]: debug 2024-04-19T23:08:00.930+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:01.296 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:08:00 smithi113 bash[48401]: debug 2024-04-19T23:08:00.797+0000 7fb513e84700 -1 osd.3 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.267169+0000 front 2024-04-19T23:07:33.267054+0000 (oldest deadline 2024-04-19T23:07:58.567242+0000) 2024-04-19T23:08:01.728 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:01 smithi178 bash[32291]: debug 2024-04-19T23:08:01.430+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:01.728 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:01 smithi178 bash[26981]: debug 2024-04-19T23:08:01.634+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:01.979 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:01 smithi178 bash[37884]: debug 2024-04-19T23:08:01.726+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:02.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:01 smithi178 bash[43677]: debug 2024-04-19T23:08:01.978+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:02.687 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:08:02 smithi113 bash[133537]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-3 2024-04-19T23:08:02.687 INFO:journalctl@ceph.osd.3.smithi113.stdout:Apr 19 23:08:02 smithi113 bash[133602]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-3 2024-04-19T23:08:02.750 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:02 smithi178 bash[32291]: debug 2024-04-19T23:08:02.406+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:02.750 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:02 smithi178 bash[26981]: debug 2024-04-19T23:08:02.594+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:03.029 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:02 smithi178 bash[37884]: debug 2024-04-19T23:08:02.750+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:03.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:03 smithi178 bash[43677]: debug 2024-04-19T23:08:03.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:03.742 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:03 smithi178 bash[32291]: debug 2024-04-19T23:08:03.414+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:03.742 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:03 smithi178 bash[26981]: debug 2024-04-19T23:08:03.546+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:03.999 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:03 smithi178 bash[37884]: debug 2024-04-19T23:08:03.742+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:04.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[43677]: debug 2024-04-19T23:08:03.998+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:04.468 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.3.service' 2024-04-19T23:08:04.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:04.495 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-19T23:08:04.495 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-19T23:08:04.495 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.4 2024-04-19T23:08:04.698 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:04 smithi178 systemd[1]: Stopping Ceph osd.4 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:04.698 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[26981]: debug 2024-04-19T23:08:04.526+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:04.698 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[32291]: debug 2024-04-19T23:08:04.374+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:04.802 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[37884]: debug 2024-04-19T23:08:04.698+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:04.802 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[26981]: debug 2024-04-19T23:08:04.706+0000 7fd172acb700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:08:04.803 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[26981]: debug 2024-04-19T23:08:04.706+0000 7fd172acb700 -1 osd.4 807 *** Got signal Terminated *** 2024-04-19T23:08:04.803 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:04 smithi178 bash[26981]: debug 2024-04-19T23:08:04.706+0000 7fd172acb700 -1 osd.4 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:08:05.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[43677]: debug 2024-04-19T23:08:05.014+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:05.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[43677]: debug 2024-04-19T23:08:05.014+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:05.706 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[32291]: debug 2024-04-19T23:08:05.410+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:05.706 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[26981]: debug 2024-04-19T23:08:05.530+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:05.706 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[26981]: debug 2024-04-19T23:08:05.530+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:39.069845+0000 front 2024-04-19T23:07:39.070099+0000 (oldest deadline 2024-04-19T23:08:05.470400+0000) 2024-04-19T23:08:06.020 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[37884]: debug 2024-04-19T23:08:05.706+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:06.020 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:05 smithi178 bash[37884]: debug 2024-04-19T23:08:05.706+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:06.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[43677]: debug 2024-04-19T23:08:06.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:06.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[43677]: debug 2024-04-19T23:08:06.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:06.743 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[32291]: debug 2024-04-19T23:08:06.426+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:06.743 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[26981]: debug 2024-04-19T23:08:06.558+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:06.743 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[26981]: debug 2024-04-19T23:08:06.558+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:39.069845+0000 front 2024-04-19T23:07:39.070099+0000 (oldest deadline 2024-04-19T23:08:05.470400+0000) 2024-04-19T23:08:07.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[37884]: debug 2024-04-19T23:08:06.742+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:07.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:06 smithi178 bash[37884]: debug 2024-04-19T23:08:06.742+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:07.461 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[43677]: debug 2024-04-19T23:08:07.058+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:07.461 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[43677]: debug 2024-04-19T23:08:07.058+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:07.731 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[26981]: debug 2024-04-19T23:08:07.582+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:07.732 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[26981]: debug 2024-04-19T23:08:07.582+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:39.069845+0000 front 2024-04-19T23:07:39.070099+0000 (oldest deadline 2024-04-19T23:08:05.470400+0000) 2024-04-19T23:08:07.732 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[32291]: debug 2024-04-19T23:08:07.462+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:08.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[37884]: debug 2024-04-19T23:08:07.730+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:08.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:07 smithi178 bash[37884]: debug 2024-04-19T23:08:07.730+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:08.462 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[43677]: debug 2024-04-19T23:08:08.090+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:08.463 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[43677]: debug 2024-04-19T23:08:08.090+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:08.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[32291]: debug 2024-04-19T23:08:08.462+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:08.803 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[26981]: debug 2024-04-19T23:08:08.626+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:08.803 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[26981]: debug 2024-04-19T23:08:08.626+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:39.069845+0000 front 2024-04-19T23:07:39.070099+0000 (oldest deadline 2024-04-19T23:08:05.470400+0000) 2024-04-19T23:08:08.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[37884]: debug 2024-04-19T23:08:08.710+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:08.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:08 smithi178 bash[37884]: debug 2024-04-19T23:08:08.710+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:09.461 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[43677]: debug 2024-04-19T23:08:09.134+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:09.461 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[43677]: debug 2024-04-19T23:08:09.134+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:09.802 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[26981]: debug 2024-04-19T23:08:09.634+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:33.268762+0000 front 2024-04-19T23:07:33.268453+0000 (oldest deadline 2024-04-19T23:07:57.368414+0000) 2024-04-19T23:08:09.802 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[26981]: debug 2024-04-19T23:08:09.634+0000 7fd16f0bf700 -1 osd.4 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:39.069845+0000 front 2024-04-19T23:07:39.070099+0000 (oldest deadline 2024-04-19T23:08:05.470400+0000) 2024-04-19T23:08:09.803 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[32291]: debug 2024-04-19T23:08:09.458+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:09.803 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[32291]: debug 2024-04-19T23:08:09.458+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:09.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[37884]: debug 2024-04-19T23:08:09.690+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:09.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:09 smithi178 bash[37884]: debug 2024-04-19T23:08:09.690+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:10.405 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[43677]: debug 2024-04-19T23:08:10.118+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:10.405 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[43677]: debug 2024-04-19T23:08:10.118+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:10.736 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[32291]: debug 2024-04-19T23:08:10.470+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:10.736 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[32291]: debug 2024-04-19T23:08:10.470+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:11.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[37884]: debug 2024-04-19T23:08:10.734+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:11.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[37884]: debug 2024-04-19T23:08:10.734+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:11.053 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[53019]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-4 2024-04-19T23:08:11.053 INFO:journalctl@ceph.osd.4.smithi178.stdout:Apr 19 23:08:10 smithi178 bash[53084]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-4 2024-04-19T23:08:11.507 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[43677]: debug 2024-04-19T23:08:11.158+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:11.507 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[43677]: debug 2024-04-19T23:08:11.158+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:11.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[32291]: debug 2024-04-19T23:08:11.506+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:11.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[32291]: debug 2024-04-19T23:08:11.506+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:11.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[37884]: debug 2024-04-19T23:08:11.738+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:11.803 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[37884]: debug 2024-04-19T23:08:11.738+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:12.156 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[51610]: ts=2024-04-19T23:08:11.858Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.113:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.113:8765: connect: connection refused" 2024-04-19T23:08:12.156 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[51610]: ts=2024-04-19T23:08:11.865Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.113:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.113:8765: connect: connection refused" 2024-04-19T23:08:12.156 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[51610]: ts=2024-04-19T23:08:11.865Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.113:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.113:8765: connect: connection refused" 2024-04-19T23:08:12.157 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[51610]: ts=2024-04-19T23:08:11.866Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.113:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.113:8765: connect: connection refused" 2024-04-19T23:08:12.157 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:11 smithi178 bash[51610]: ts=2024-04-19T23:08:11.867Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.113:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.113:8765: connect: connection refused" 2024-04-19T23:08:12.503 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[43677]: debug 2024-04-19T23:08:12.154+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:12.504 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[43677]: debug 2024-04-19T23:08:12.154+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:12.801 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[37884]: debug 2024-04-19T23:08:12.742+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:12.801 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[37884]: debug 2024-04-19T23:08:12.742+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:12.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[32291]: debug 2024-04-19T23:08:12.502+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:12.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:12 smithi178 bash[32291]: debug 2024-04-19T23:08:12.502+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:12.804 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.4.service' 2024-04-19T23:08:12.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:12.832 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-19T23:08:12.832 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-19T23:08:12.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.5 2024-04-19T23:08:13.052 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:12 smithi178 systemd[1]: Stopping Ceph osd.5 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:13.052 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[32291]: debug 2024-04-19T23:08:13.018+0000 7f39c0e8f700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:08:13.052 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[32291]: debug 2024-04-19T23:08:13.018+0000 7f39c0e8f700 -1 osd.5 807 *** Got signal Terminated *** 2024-04-19T23:08:13.052 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[32291]: debug 2024-04-19T23:08:13.018+0000 7f39c0e8f700 -1 osd.5 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:08:13.491 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[43677]: debug 2024-04-19T23:08:13.158+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:13.491 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[43677]: debug 2024-04-19T23:08:13.158+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:13.768 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[32291]: debug 2024-04-19T23:08:13.490+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:13.769 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[32291]: debug 2024-04-19T23:08:13.490+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:14.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[37884]: debug 2024-04-19T23:08:13.766+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:14.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:13 smithi178 bash[37884]: debug 2024-04-19T23:08:13.766+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:14.501 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[43677]: debug 2024-04-19T23:08:14.114+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:14.501 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[43677]: debug 2024-04-19T23:08:14.114+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:14.799 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[32291]: debug 2024-04-19T23:08:14.498+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:14.799 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[32291]: debug 2024-04-19T23:08:14.498+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:14.799 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[32291]: debug 2024-04-19T23:08:14.498+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:48.899595+0000 front 2024-04-19T23:07:48.899696+0000 (oldest deadline 2024-04-19T23:08:14.100163+0000) 2024-04-19T23:08:15.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[37884]: debug 2024-04-19T23:08:14.798+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:15.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:14 smithi178 bash[37884]: debug 2024-04-19T23:08:14.798+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:15.465 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[43677]: debug 2024-04-19T23:08:15.066+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:15.465 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[43677]: debug 2024-04-19T23:08:15.066+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:15.797 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[32291]: debug 2024-04-19T23:08:15.466+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:15.797 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[32291]: debug 2024-04-19T23:08:15.466+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:15.797 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[32291]: debug 2024-04-19T23:08:15.466+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:48.899595+0000 front 2024-04-19T23:07:48.899696+0000 (oldest deadline 2024-04-19T23:08:14.100163+0000) 2024-04-19T23:08:16.052 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[43677]: debug 2024-04-19T23:08:16.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:16.052 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[43677]: debug 2024-04-19T23:08:16.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:16.053 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[37884]: debug 2024-04-19T23:08:15.794+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:16.053 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:15 smithi178 bash[37884]: debug 2024-04-19T23:08:15.794+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:16.798 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[32291]: debug 2024-04-19T23:08:16.450+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:16.799 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[32291]: debug 2024-04-19T23:08:16.450+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:16.799 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[32291]: debug 2024-04-19T23:08:16.450+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:48.899595+0000 front 2024-04-19T23:07:48.899696+0000 (oldest deadline 2024-04-19T23:08:14.100163+0000) 2024-04-19T23:08:17.052 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[43677]: debug 2024-04-19T23:08:17.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:17.052 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[43677]: debug 2024-04-19T23:08:17.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:17.052 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[43677]: debug 2024-04-19T23:08:17.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:17.053 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[37884]: debug 2024-04-19T23:08:16.798+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:17.053 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[37884]: debug 2024-04-19T23:08:16.798+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:17.053 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:16 smithi178 bash[37884]: debug 2024-04-19T23:08:16.798+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:17.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[32291]: debug 2024-04-19T23:08:17.406+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:34.896893+0000 front 2024-04-19T23:07:34.896741+0000 (oldest deadline 2024-04-19T23:07:58.396457+0000) 2024-04-19T23:08:17.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[32291]: debug 2024-04-19T23:08:17.406+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:42.999093+0000 front 2024-04-19T23:07:42.999134+0000 (oldest deadline 2024-04-19T23:08:08.898877+0000) 2024-04-19T23:08:17.786 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[32291]: debug 2024-04-19T23:08:17.406+0000 7f39bd483700 -1 osd.5 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:48.899595+0000 front 2024-04-19T23:07:48.899696+0000 (oldest deadline 2024-04-19T23:08:14.100163+0000) 2024-04-19T23:08:18.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[37884]: debug 2024-04-19T23:08:17.786+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:18.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[37884]: debug 2024-04-19T23:08:17.786+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:18.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:17 smithi178 bash[37884]: debug 2024-04-19T23:08:17.786+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:18.552 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[43677]: debug 2024-04-19T23:08:18.054+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:18.552 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[43677]: debug 2024-04-19T23:08:18.054+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:18.552 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[43677]: debug 2024-04-19T23:08:18.054+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:19.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[37884]: debug 2024-04-19T23:08:18.766+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:19.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[37884]: debug 2024-04-19T23:08:18.766+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:19.052 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:18 smithi178 bash[37884]: debug 2024-04-19T23:08:18.766+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:19.302 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[53217]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-5 2024-04-19T23:08:19.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[43677]: debug 2024-04-19T23:08:19.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:19.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[43677]: debug 2024-04-19T23:08:19.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:19.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[43677]: debug 2024-04-19T23:08:19.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:19.802 INFO:journalctl@ceph.osd.5.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[53280]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-5 2024-04-19T23:08:20.094 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[37884]: debug 2024-04-19T23:08:19.806+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:20.094 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[37884]: debug 2024-04-19T23:08:19.806+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:20.094 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:19 smithi178 bash[37884]: debug 2024-04-19T23:08:19.806+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:20.094 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[43677]: debug 2024-04-19T23:08:20.002+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:20.095 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[43677]: debug 2024-04-19T23:08:20.002+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:20.095 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[43677]: debug 2024-04-19T23:08:20.002+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:21.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.5.service' 2024-04-19T23:08:21.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:21.090 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-19T23:08:21.090 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-19T23:08:21.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.6 2024-04-19T23:08:21.141 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[37884]: debug 2024-04-19T23:08:20.846+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:21.142 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[37884]: debug 2024-04-19T23:08:20.846+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:21.142 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:20 smithi178 bash[37884]: debug 2024-04-19T23:08:20.846+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:21.142 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:21.142 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:21.142 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:21.552 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 systemd[1]: Stopping Ceph osd.6 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:21.552 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.274+0000 7f527c263700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:08:21.552 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.274+0000 7f527c263700 -1 osd.6 807 *** Got signal Terminated *** 2024-04-19T23:08:21.552 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.274+0000 7f527c263700 -1 osd.6 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:08:22.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.834+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:22.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.834+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:22.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[37884]: debug 2024-04-19T23:08:21.834+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:22.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.986+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:22.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.986+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:22.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:21 smithi178 bash[43677]: debug 2024-04-19T23:08:21.986+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:23.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[37884]: debug 2024-04-19T23:08:22.866+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:23.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[37884]: debug 2024-04-19T23:08:22.866+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:23.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[37884]: debug 2024-04-19T23:08:22.866+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:23.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[43677]: debug 2024-04-19T23:08:22.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:23.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[43677]: debug 2024-04-19T23:08:22.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:23.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[43677]: debug 2024-04-19T23:08:22.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:23.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:22 smithi178 bash[43677]: debug 2024-04-19T23:08:22.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:24.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:23 smithi178 bash[37884]: debug 2024-04-19T23:08:23.882+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:24.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:23 smithi178 bash[37884]: debug 2024-04-19T23:08:23.882+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:23 smithi178 bash[37884]: debug 2024-04-19T23:08:23.882+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:23 smithi178 bash[37884]: debug 2024-04-19T23:08:23.882+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:59.396878+0000 front 2024-04-19T23:07:59.396670+0000 (oldest deadline 2024-04-19T23:08:22.896370+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[43677]: debug 2024-04-19T23:08:24.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[43677]: debug 2024-04-19T23:08:24.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[43677]: debug 2024-04-19T23:08:24.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:24.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[43677]: debug 2024-04-19T23:08:24.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:25.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[37884]: debug 2024-04-19T23:08:24.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:25.302 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[37884]: debug 2024-04-19T23:08:24.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[37884]: debug 2024-04-19T23:08:24.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:24 smithi178 bash[37884]: debug 2024-04-19T23:08:24.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:59.396878+0000 front 2024-04-19T23:07:59.396670+0000 (oldest deadline 2024-04-19T23:08:22.896370+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[43677]: debug 2024-04-19T23:08:25.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[43677]: debug 2024-04-19T23:08:25.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[43677]: debug 2024-04-19T23:08:25.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:25.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[43677]: debug 2024-04-19T23:08:25.050+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[37884]: debug 2024-04-19T23:08:25.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.492555+0000 front 2024-04-19T23:07:32.492722+0000 (oldest deadline 2024-04-19T23:07:57.792166+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[37884]: debug 2024-04-19T23:08:25.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.693930+0000 front 2024-04-19T23:07:43.693897+0000 (oldest deadline 2024-04-19T23:08:05.393385+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[37884]: debug 2024-04-19T23:08:25.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:50.595316+0000 front 2024-04-19T23:07:50.595543+0000 (oldest deadline 2024-04-19T23:08:15.895176+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:25 smithi178 bash[37884]: debug 2024-04-19T23:08:25.886+0000 7f527484f700 -1 osd.6 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:59.396878+0000 front 2024-04-19T23:07:59.396670+0000 (oldest deadline 2024-04-19T23:08:22.896370+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:26.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:26.304 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:26.304 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.018+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:27.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:27.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:27.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:27.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:26 smithi178 bash[43677]: debug 2024-04-19T23:08:26.982+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:27.802 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[53413]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-6 2024-04-19T23:08:27.802 INFO:journalctl@ceph.osd.6.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[53477]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-6 2024-04-19T23:08:28.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[43677]: debug 2024-04-19T23:08:27.994+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:28.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[43677]: debug 2024-04-19T23:08:27.994+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:28.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[43677]: debug 2024-04-19T23:08:27.994+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:28.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:27 smithi178 bash[43677]: debug 2024-04-19T23:08:27.994+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:29.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:28 smithi178 bash[43677]: debug 2024-04-19T23:08:28.958+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:29.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:28 smithi178 bash[43677]: debug 2024-04-19T23:08:28.958+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:29.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:28 smithi178 bash[43677]: debug 2024-04-19T23:08:28.958+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:29.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:28 smithi178 bash[43677]: debug 2024-04-19T23:08:28.958+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:29.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.6.service' 2024-04-19T23:08:29.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:29.464 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-19T23:08:29.464 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-19T23:08:29.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.7 2024-04-19T23:08:29.802 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:29 smithi178 systemd[1]: Stopping Ceph osd.7 for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:29.802 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:29 smithi178 bash[43677]: debug 2024-04-19T23:08:29.622+0000 7ff0f554a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:08:29.802 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:29 smithi178 bash[43677]: debug 2024-04-19T23:08:29.622+0000 7ff0f554a700 -1 osd.7 807 *** Got signal Terminated *** 2024-04-19T23:08:29.803 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:29 smithi178 bash[43677]: debug 2024-04-19T23:08:29.622+0000 7ff0f554a700 -1 osd.7 807 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-19T23:08:30.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:30 smithi178 bash[43677]: debug 2024-04-19T23:08:30.006+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:30.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:30 smithi178 bash[43677]: debug 2024-04-19T23:08:30.006+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:30.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:30 smithi178 bash[43677]: debug 2024-04-19T23:08:30.006+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:30.303 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:30 smithi178 bash[43677]: debug 2024-04-19T23:08:30.006+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:31.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:31 smithi178 bash[43677]: debug 2024-04-19T23:08:31.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:31.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:31 smithi178 bash[43677]: debug 2024-04-19T23:08:31.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:31.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:31 smithi178 bash[43677]: debug 2024-04-19T23:08:31.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:31.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:31 smithi178 bash[43677]: debug 2024-04-19T23:08:31.026+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:32.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:32 smithi178 bash[43677]: debug 2024-04-19T23:08:32.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:32.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:32 smithi178 bash[43677]: debug 2024-04-19T23:08:32.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:32.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:32 smithi178 bash[43677]: debug 2024-04-19T23:08:32.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:32.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:32 smithi178 bash[43677]: debug 2024-04-19T23:08:32.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:33.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:33 smithi178 bash[43677]: debug 2024-04-19T23:08:33.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:33.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:33 smithi178 bash[43677]: debug 2024-04-19T23:08:33.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:33.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:33 smithi178 bash[43677]: debug 2024-04-19T23:08:33.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:33.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:33 smithi178 bash[43677]: debug 2024-04-19T23:08:33.030+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:34.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:34 smithi178 bash[43677]: debug 2024-04-19T23:08:34.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6803 osd.0 since back 2024-04-19T23:07:32.149747+0000 front 2024-04-19T23:07:32.149967+0000 (oldest deadline 2024-04-19T23:07:56.849421+0000) 2024-04-19T23:08:34.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:34 smithi178 bash[43677]: debug 2024-04-19T23:08:34.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6807 osd.1 since back 2024-04-19T23:07:43.752427+0000 front 2024-04-19T23:07:43.752242+0000 (oldest deadline 2024-04-19T23:08:04.752772+0000) 2024-04-19T23:08:34.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:34 smithi178 bash[43677]: debug 2024-04-19T23:08:34.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6811 osd.2 since back 2024-04-19T23:07:52.255615+0000 front 2024-04-19T23:07:52.255963+0000 (oldest deadline 2024-04-19T23:08:16.955597+0000) 2024-04-19T23:08:34.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:34 smithi178 bash[43677]: debug 2024-04-19T23:08:34.022+0000 7ff0edb36700 -1 osd.7 807 heartbeat_check: no reply from 172.21.15.113:6815 osd.3 since back 2024-04-19T23:07:56.956758+0000 front 2024-04-19T23:07:56.956552+0000 (oldest deadline 2024-04-19T23:08:22.256316+0000) 2024-04-19T23:08:36.054 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:35 smithi178 bash[53612]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-7 2024-04-19T23:08:36.055 INFO:journalctl@ceph.osd.7.smithi178.stdout:Apr 19 23:08:35 smithi178 bash[53677]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-osd-7 2024-04-19T23:08:37.453 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@osd.7.service' 2024-04-19T23:08:37.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:37.480 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-19T23:08:37.480 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-04-19T23:08:37.480 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@rgw.foo.a 2024-04-19T23:08:37.796 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 23:08:37 smithi113 systemd[1]: Stopping Ceph rgw.foo.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:37.796 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 23:08:37 smithi113 bash[52810]: debug 2024-04-19T23:08:37.700+0000 7f0aeb580700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-19T23:08:37.796 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 23:08:37 smithi113 bash[52810]: debug 2024-04-19T23:08:37.700+0000 7f0af9dfeac0 -1 shutting down 2024-04-19T23:08:48.524 INFO:journalctl@ceph.rgw.foo.a.smithi113.stdout:Apr 19 23:08:48 smithi113 bash[133734]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-rgw-foo-a 2024-04-19T23:08:48.539 DEBUG:teuthology.orchestra.run.smithi113:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@rgw.foo.a.service' 2024-04-19T23:08:48.564 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:48.564 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-04-19T23:08:48.564 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-04-19T23:08:48.564 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@prometheus.a 2024-04-19T23:08:48.897 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 systemd[1]: Stopping Ceph prometheus.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.719Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.720Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-04-19T23:08:48.898 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.720Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-04-19T23:08:48.899 INFO:journalctl@ceph.prometheus.a.smithi178.stdout:Apr 19 23:08:48 smithi178 bash[51610]: ts=2024-04-19T23:08:48.720Z caller=main.go:1147 level=info msg="See you next time!" 2024-04-19T23:08:49.383 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@prometheus.a.service' 2024-04-19T23:08:49.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-19T23:08:49.406 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-04-19T23:08:49.407 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm rm-cluster --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 --force --keep-logs 2024-04-19T23:08:49.574 INFO:teuthology.orchestra.run.smithi113.stdout:Deleting cluster with fsid: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T23:08:54.399 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:54.399 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:54.652 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:54.653 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:54.915 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:54.915 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:54 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.294 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.294 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.546 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.546 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.546 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.546 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.900 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:55.901 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:55 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:56.159 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:56 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:56.159 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:56 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:56.160 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:56 smithi113 systemd[1]: Stopping Ceph node-exporter.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:57.447 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 bash[134144]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-node-exporter-a 2024-04-19T23:08:57.730 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-04-19T23:08:57.730 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 bash[134205]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-node-exporter-a 2024-04-19T23:08:57.730 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-04-19T23:08:57.730 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: Stopped Ceph node-exporter.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T23:08:57.730 INFO:journalctl@ceph.node-exporter.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:57.731 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:57.731 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:57 smithi113 systemd[1]: Stopping Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:08:57.992 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:57 smithi113 bash[59585]: ts=2024-04-19T23:08:57.888Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-04-19T23:08:59.085 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:58 smithi113 bash[134274]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-alertmanager-a 2024-04-19T23:08:59.085 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:59 smithi113 bash[134337]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-alertmanager-a 2024-04-19T23:08:59.085 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:59 smithi113 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-04-19T23:08:59.085 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:59 smithi113 systemd[1]: Stopped Ceph alertmanager.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T23:08:59.346 INFO:journalctl@ceph.alertmanager.a.smithi113.stdout:Apr 19 23:08:59 smithi113 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:08:59.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm rm-cluster --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 --force --keep-logs 2024-04-19T23:08:59.963 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T23:09:04.801 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:04.802 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:04.802 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.174 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.174 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.175 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:04 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.428 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.428 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.428 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.720 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.720 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.720 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.720 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.982 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.982 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:05.982 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:05 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:06.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:06 smithi178 systemd[1]: Stopping Ceph iscsi.iscsi.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:09:06.302 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:06 smithi178 bash[47837]: debug Shutdown received 2024-04-19T23:09:16.801 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:16 smithi178 bash[54146]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-iscsi-iscsi-a 2024-04-19T23:09:17.085 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:17.085 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:16 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:17.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:16 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-04-19T23:09:17.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:16 smithi178 bash[54212]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-iscsi-iscsi-a 2024-04-19T23:09:17.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:16 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-04-19T23:09:17.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:16 smithi178 systemd[1]: Stopped Ceph iscsi.iscsi.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T23:09:17.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi178.stdout:Apr 19 23:09:17 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:18.253 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:17 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:18.253 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:18 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:18.254 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:17 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:18.254 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:18 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:18.551 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:18 smithi178 systemd[1]: Stopping Ceph node-exporter.b for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:09:19.255 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:18 smithi178 bash[54428]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-node-exporter-b 2024-04-19T23:09:19.255 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-04-19T23:09:19.256 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:19 smithi178 bash[54521]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-node-exporter-b 2024-04-19T23:09:19.256 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-04-19T23:09:19.256 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: Stopped Ceph node-exporter.b for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T23:09:19.517 INFO:journalctl@ceph.node-exporter.b.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:19.518 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:19.518 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 systemd[1]: Stopping Ceph grafana.a for dd3df874-fe9c-11ee-bc92-c7b262605968... 2024-04-19T23:09:19.518 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 bash[50863]: logger=server t=2024-04-19T23:09:19.482305428Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-04-19T23:09:19.518 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 bash[50863]: logger=ticker t=2024-04-19T23:09:19.482367551Z level=info msg=stopped last_tick=2024-04-19T23:09:10Z 2024-04-19T23:09:19.518 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 bash[50863]: logger=tracing t=2024-04-19T23:09:19.482455277Z level=info msg="Closing tracing" 2024-04-19T23:09:20.244 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:19 smithi178 bash[54590]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-grafana-a 2024-04-19T23:09:20.244 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:20 smithi178 bash[54651]: Error response from daemon: No such container: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968-grafana-a 2024-04-19T23:09:20.245 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:20 smithi178 systemd[1]: ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@grafana.a.service: Deactivated successfully. 2024-04-19T23:09:20.245 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:20 smithi178 systemd[1]: Stopped Ceph grafana.a for dd3df874-fe9c-11ee-bc92-c7b262605968. 2024-04-19T23:09:20.508 INFO:journalctl@ceph.grafana.a.smithi178.stdout:Apr 19 23:09:20 smithi178 systemd[1]: /etc/systemd/system/ceph-dd3df874-fe9c-11ee-bc92-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-04-19T23:09:20.771 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-19T23:09:20.786 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-19T23:09:20.799 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-19T23:09:20.801 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi113/crash 2024-04-19T23:09:20.801 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash -- . 2024-04-19T23:09:20.842 INFO:teuthology.orchestra.run.smithi113.stderr:tar: /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash: Cannot open: No such file or directory 2024-04-19T23:09:20.842 INFO:teuthology.orchestra.run.smithi113.stderr:tar: Error is not recoverable: exiting now 2024-04-19T23:09:20.844 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi178/crash 2024-04-19T23:09:20.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash -- . 2024-04-19T23:09:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/crash: Cannot open: No such file or directory 2024-04-19T23:09:20.855 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2024-04-19T23:09:20.856 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-19T23:09:20.857 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-19T23:09:20.900 INFO:teuthology.orchestra.run.smithi113.stdout:2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T23:09:20.901 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-19T23:09:20.901 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[SEC\]' /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-19T23:09:20.960 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]' /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-19T23:09:21.019 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[WRN\]' /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-19T23:09:21.075 INFO:teuthology.orchestra.run.smithi113.stdout:2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm 2024-04-19T23:09:21.076 INFO:tasks.cephadm:Compressing logs... 2024-04-19T23:09:21.076 DEBUG:teuthology.orchestra.run.smithi113:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-19T23:09:21.124 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-19T23:09:21.131 INFO:teuthology.orchestra.run.smithi113.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-04-19T23:09:21.137 INFO:teuthology.orchestra.run.smithi178.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-04-19T23:09:21.143 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-19T23:09:21.144 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.y.log 2024-04-19T23:09:21.144 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.0.log 2024-04-19T23:09:21.144 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.2.log 2024-04-19T23:09:21.145 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.a.log 2024-04-19T23:09:21.145 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log 2024-04-19T23:09:21.147 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.3.log 2024-04-19T23:09:21.147 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.1.log 2024-04-19T23:09:21.147 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.3.log: 88.9%gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log 2024-04-19T23:09:21.147 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log.gz 2024-04-19T23:09:21.148 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log 2024-04-19T23:09:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-19T23:09:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.7.log 2024-04-19T23:09:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.6.log 2024-04-19T23:09:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log 2024-04-19T23:09:21.149 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.5.log 2024-04-19T23:09:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/tcmu-runner.log 2024-04-19T23:09:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log: /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.x.log 2024-04-19T23:09:21.150 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log 2024-04-19T23:09:21.150 INFO:teuthology.orchestra.run.smithi178.stderr: 67.3% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/tcmu-runner.log.gz 2024-04-19T23:09:21.151 INFO:teuthology.orchestra.run.smithi178.stderr: 81.1% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.cephadm.log.gz 2024-04-19T23:09:21.151 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log 2024-04-19T23:09:21.152 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log 2024-04-19T23:09:21.152 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.b.log 2024-04-19T23:09:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-19T23:09:21.154 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.c.log 2024-04-19T23:09:21.158 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log: 92.8% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log.gz 2024-04-19T23:09:21.158 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log 2024-04-19T23:09:21.158 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log: 87.1% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.log.gz 2024-04-19T23:09:21.158 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.4.log 2024-04-19T23:09:21.163 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-19T23:09:21.165 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.4.log: 92.3% 92.4% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log.gz 2024-04-19T23:09:21.165 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.x.log.gz 2024-04-19T23:09:21.165 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log.gz 2024-04-19T23:09:21.168 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.c.log: 91.0% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-volume.log.gz 2024-04-19T23:09:21.168 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-client.rgw.foo.a.log 2024-04-19T23:09:21.189 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log: /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-client.rgw.foo.a.log: 95.3% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph.audit.log.gz 2024-04-19T23:09:21.232 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-client.rgw.foo.a.log.gz 2024-04-19T23:09:21.606 INFO:teuthology.orchestra.run.smithi113.stderr: 90.8% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mgr.y.log.gz 2024-04-19T23:09:22.138 INFO:teuthology.orchestra.run.smithi178.stderr: 93.1% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.b.log.gz 2024-04-19T23:09:22.160 INFO:teuthology.orchestra.run.smithi113.stderr: 92.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.c.log.gz 2024-04-19T23:09:23.389 INFO:teuthology.orchestra.run.smithi113.stderr: 92.1% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-mon.a.log.gz 2024-04-19T23:09:27.630 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.0.log.gz 2024-04-19T23:09:27.661 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.6.log.gz 2024-04-19T23:09:28.266 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.2.log.gz 2024-04-19T23:09:28.398 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.4.log.gz 2024-04-19T23:09:28.412 INFO:teuthology.orchestra.run.smithi178.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.5.log.gz 2024-04-19T23:09:28.497 INFO:teuthology.orchestra.run.smithi178.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.7.log.gz 2024-04-19T23:09:28.498 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-04-19T23:09:28.499 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m7.370s 2024-04-19T23:09:28.499 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m28.338s 2024-04-19T23:09:28.499 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m1.093s 2024-04-19T23:09:28.552 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.1.log.gz 2024-04-19T23:09:28.783 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/dd3df874-fe9c-11ee-bc92-c7b262605968/ceph-osd.3.log.gz 2024-04-19T23:09:28.785 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-04-19T23:09:28.785 INFO:teuthology.orchestra.run.smithi113.stderr:real 0m7.659s 2024-04-19T23:09:28.785 INFO:teuthology.orchestra.run.smithi113.stderr:user 0m31.278s 2024-04-19T23:09:28.785 INFO:teuthology.orchestra.run.smithi113.stderr:sys 0m1.193s 2024-04-19T23:09:28.785 INFO:tasks.cephadm:Archiving logs... 2024-04-19T23:09:28.786 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi113/log 2024-04-19T23:09:28.787 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T23:09:32.493 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi178/log 2024-04-19T23:09:32.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T23:09:35.938 INFO:tasks.cephadm:Removing cluster... 2024-04-19T23:09:35.938 DEBUG:teuthology.orchestra.run.smithi113:> sudo cephadm rm-cluster --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 --force 2024-04-19T23:09:36.105 INFO:teuthology.orchestra.run.smithi113.stdout:Deleting cluster with fsid: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T23:09:37.472 DEBUG:teuthology.orchestra.run.smithi178:> sudo cephadm rm-cluster --fsid dd3df874-fe9c-11ee-bc92-c7b262605968 --force 2024-04-19T23:09:37.638 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: dd3df874-fe9c-11ee-bc92-c7b262605968 2024-04-19T23:09:38.992 INFO:tasks.cephadm:Teardown complete 2024-04-19T23:09:38.992 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T23:09:39.001 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T23:09:39.002 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T23:09:39.004 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T23:09:39.064 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T23:09:39.073 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T23:09:39.073 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:09:39.075 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================== 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout:*hv01.front.sepi 44.4.53.2 2 u 124 128 377 0.097 -4.517 0.387 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout:+hv02.front.sepi 63.231.80.2 3 u 130 128 377 0.104 -1.563 0.677 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout:+hv03.front.sepi 74.6.168.72 3 u 48 128 377 0.092 -3.758 0.462 2024-04-19T23:09:39.085 INFO:teuthology.orchestra.run.smithi113.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout:*hv01.front.sepi 44.4.53.2 2 u 108 128 377 0.085 -4.462 0.647 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout:+hv02.front.sepi 63.231.80.2 3 u 114 128 377 0.101 -2.671 0.673 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout:+hv03.front.sepi 74.6.168.72 3 u 124 128 377 0.112 -4.982 0.963 2024-04-19T23:09:39.087 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-19T23:09:39.088 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T23:09:39.098 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T23:09:39.098 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T23:09:39.115 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T23:09:39.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T23:09:39.133 INFO:teuthology.task.internal:Duration was 2718.366522 seconds 2024-04-19T23:09:39.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T23:09:39.149 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T23:09:39.149 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T23:09:39.152 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T23:09:39.190 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T23:09:39.190 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2024-04-19T23:09:39.191 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T23:09:39.240 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-04-19T23:09:39.240 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T23:09:39.251 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T23:09:39.251 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:09:39.288 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:09:39.355 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T23:09:39.355 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T23:09:39.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T23:09:39.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T23:09:39.576 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T23:09:39.577 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T23:09:39.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T23:09:39.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T23:09:39.612 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:09:39.632 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:09:39.640 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2024-04-19T23:09:39.655 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-04-19T23:09:39.686 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:09:39.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:09:39.699 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:09:39.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:09:39.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T23:09:39.742 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T23:09:39.743 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi113 2024-04-19T23:09:39.743 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T23:09:39.792 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896/remote/smithi178 2024-04-19T23:09:39.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T23:09:39.818 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T23:09:39.818 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T23:09:39.820 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T23:09:39.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T23:09:39.877 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T23:09:39.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T23:09:39.886 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T23:09:39.886 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T23:09:39.889 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T23:09:39.893 INFO:teuthology.orchestra.run.smithi113.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 23:09 /home/ubuntu/cephtest 2024-04-19T23:09:39.909 INFO:teuthology.orchestra.run.smithi178.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 23:09 /home/ubuntu/cephtest 2024-04-19T23:09:39.910 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T23:09:39.920 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T23:09:39.939 INFO:teuthology.nuke:Checking targets against current locks 2024-04-19T23:09:39.963 DEBUG:teuthology.nuke:shortname: smithi113 2024-04-19T23:09:39.964 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T23:09:39.989 DEBUG:teuthology.nuke:shortname: smithi178 2024-04-19T23:09:39.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T23:09:39.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 22:14:41.944310', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7kAqWEH0dEOxO8lsl1FJyGcFPc/N1mEFx0gYPpA9et/DinHwgcTJawNY4Xl7s04OseItQz66z+xOqLKpjf8J0='} 2024-04-19T23:09:40.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_21:08:02-orch-squid-distro-default-smithi/7663896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 22:14:41.945846', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLonbdgGqcvbKjHPN19W7Sjnz9rL1+zQo7/Do/zaz1jI2ksxJmB65CMJV5ppfAui14fR/OsfBwzp3omgsRO8QV0='} 2024-04-19T23:09:40.045 INFO:teuthology.orchestra.console.smithi113:Power off 2024-04-19T23:09:40.045 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T23:09:40.078 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-04-19T23:09:40.079 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:40.096 INFO:teuthology.orchestra.console.smithi178:Power off 2024-04-19T23:09:40.096 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T23:09:40.107 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-19T23:09:40.120 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-04-19T23:09:40.120 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:40.159 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-19T23:09:44.108 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:44.163 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:44.218 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-19T23:09:44.273 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-19T23:09:48.222 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:48.274 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T23:09:48.333 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-19T23:09:48.384 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-19T23:09:48.434 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-04-19T23:09:48.485 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-04-19T23:09:48.590 INFO:teuthology.run:Summary data: description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} duration: 2718.3665223121643 failure_reason: '"2024-04-19T22:50:00.332997+0000 mon.a (mon.0) 1076 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 17 stray daemon(s) not managed by cephadm" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-04-19T23:09:48.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T23:09:48.667 INFO:teuthology.run:FAIL